How to Report Automated Test Runs

Now that we’ve scheduled and ran our automated test, we’ll see the different ways we can report on test automation in the qTest platform.

Test Run Analysis – qTest Launch

From each test automation host, you can select to view each of the schedule jobs by weeks and days. For example, I can view the Regression Tests on Thursday and my most recently ran test automation on Friday. On each day, I can see the Test Run, Test Case and the requirement that covers this Test Runs along with their test execution results.

Test Run Logs – qTest Manager

By clicking any of these links, I’m sent directly to qTest Manager, where more detail can be viewed. In this case, the Test Run item was selected and I can see the latest test execution results along with any other Test Run logs. From here, I can either decide to log a bug or view more reporting in a test-week grid view.

Simply, select the Test Runs and then click the Export button to get various Test Run reports.

Requirement Coverage – qTest Launch

In qTest Launch, I can also see any requirement or user story that’s linked to my automated test executions. By clicking this link ID, I’m brought over to the requirement section in qTest Manager. And in this example, we have a real-time integration turned on with Jira software. I can see all the linked Test Cases, both automated and manual, that are attached to this user story in Jira. By clicking the link, I’m brought over into Jira where I can see my test automation coverage directly on the Jira issue. I can now decide if this user story has already been moved into a Done state based of the test automation results from qTest Launch.

Advanced Test Automation Reporting – qTest Insights

For advanced test automation reporting, qTest insights will provide actionable data and your test automation activities across your qTest projects.

Quality Analysis

In quality analysis, you’ll be able to see the latest test automation results, the test automation results by the day they were ran, and a breakdown by the manual and automated test execution results by Project, Test Cycle, or by Module.

Coverage Analysis

Coverage analysis gives you key insights through heat map visualization, pie charts, and traceability grids, so you can always know which requirement is covered with test automation. The traceability grid can easily be filtered by Automated, Manual, or Both, to see which test map to each requirement for test automation coverage.

For more insights, click on any actionable data that you see with qTest insights. Each drill-down page contains a row of data that can be filtered and saved for later analysis.

Velocity Analysis

Velocity analysis gives you a good idea on how fast you’re moving, whether you’re looking at tests that are planned versus the executed or the amount of test automation Test Cases you’ve been creating over the past week. And lastly, with our personal and shared dashboards, you’ll be able to create quality, coverage, and velocity charts, all in one place around your test automation activities.

Get Started with QASymphony