Automated Result for failed test does not show full error details

App Feedback
,
1

Recently I’ve finally gotten a chance to take a look at the automation reporter, and I’m pleased with what I’ve seen so far.

However, I’ve found that the error shown in Testiny for the AR isn’t the full error as reported by pytest.

Given the example junit file:

junit.xml 
<?xml version="1.0" encoding="utf-8"?>
<testsuites name="pytest tests">
    <testsuite name="pytest" errors="0" failures="1" skipped="0" tests="6" time="3.033"
               timestamp="2025-09-08T16:07:59.455534+00:00" hostname="hostname">
        <testcase classname="tests.test_assertion" name="test_assertion" time="0.000">
            <properties>
                <property name="requirement" value="RS-1"/>
            </properties>
        </testcase>
        <testcase classname="tests.test_assertion" name="test_two" time="0.000">
            <properties>
                <property name="requirement" value="RS-2"/>
            </properties>
        </testcase>
        <testcase classname="tests.test_assertion" name="test_three" time="3.002">
            <properties>
                <property name="requirement" value="RS-3"/>
            </properties>
        </testcase>
        <testcase classname="tests.test_assertion" name="test_four[1]" time="0.001">
            <properties>
                <property name="requirement" value="RS-4"/>
            </properties>
        </testcase>
        <testcase classname="tests.test_assertion" name="test_four[2]" time="0.001">
            <properties>
                <property name="requirement" value="RS-4"/>
            </properties>
            <failure message="Failed: Intentional failure for case 2">variation = 2, record_property = &lt;function
                record_property.&lt;locals&gt;.append_property at 0x783ba26a6de0&gt;

                @mark.parametrize("variation", [1, 2, 3])
                def test_four(variation, record_property):
                print(variation)
                record_property("requirement", "SCMRS-4")
                if variation == 2:
                &gt; pytest.fail(f"Intentional failure for case {variation}")
                E Failed: Intentional failure for case 2

                tests/test_assertion.py:25: Failed
            </failure>
        </testcase>
        <testcase classname="tests.test_assertion" name="test_four[3]" time="0.001">
            <properties>
                <property name="requirement" value="RS-4"/>
            </properties>
        </testcase>
    </testsuite>
</testsuites>

When the results are imported into Testiny using the reporter:

./testiny-importer-linux automation --project 1 --source "pytest-prototype-cicd" "--custom-result-fields=requirement" --junit junit.xml

In Testinty, I only see the message from the failure element:

image
image705×133 5.39 KB

I would have expected to see the full details of the failure as reported by pytest, but it seems either it wasn’t parsed or it failed to be parsed. The CLI reporter didn’t report any errors.

2

Hello Ben,

Currently the text content of the error/failure nodes is not included if a message attribute is set - but it makes sense to include both (most junit generators drop the error body into system-err )

We will try to include an improvement for this in one of the next releases.

Regards,
Michael

3

This issue got fixed with the recent v1.27.0 release.

Best regards,
Alex