Skip to main content

TestNG

Submit and collect your TestNG results in Testiny to track automated test runs. By integrating TestNG with Testiny, you can gain valuable insights into your testing process. Track automation results over time, identify frequently failing tests, and detect patterns in test failures to fix CI failures and find flaky tests.

TestNG

Run TestNG & Generate Reports​

TestNG can be run in different ways, such as command line, ant, Eclipse or IntelliJ’s IDEA. TestNG automatically outputs an XML file in the JUnit XML file format, so you simply need to run your tests:

java org.testng.TestNG mytests.xml

By default, the generated reports will be saved to the folder test-output. (Unless another directory is specified.)

Import Results to Testiny​

Make sure you've generated an API key and use the Testiny CLI to import the results to Testiny:

export TESTINY_API_KEY=****
npx @testiny/cli automation --project ID_OR_KEY --source "frontend" --testng test-output/*.xml

In the above example, the environment variable TESTINY_API_KEY is set to authenticate the request. The --project flag specifies the target Testiny project using its ID or key and the --source flag categorizes the test results (e.g., frontend, backend, integration tests, ...). The --testng flag specifies the format of the specified test result file(s).

Once executed, the Testiny CLI will automatically create a new automated test run in Testiny and import all results from the specified report(s).

More resources​

Here are some further resources to help you get started with integrating TestNG with Testiny, including CI/CD integration examples, a full automation guide, and the Testiny CLI.