Executions give you an insight in the results of an executed Plan as well as the ability to detect and analyze errors, both within the Plan or the system tested / automated with it. To open it, click in the Execution list view on any Plan’s name, you want to inspect.

General Execution Information

The Execution Report provides insight into an on-going or alreaedy concluded execution. THe following general information are directly shown on top:

1. The executed plans name
2. A link to the plan
3. The date when the plan was executed
4. The current status of the execution
5. The user initiating the execution
6. Click to find a table of all resolved parameters
7. Click to see on what agent(s) the plan was executed
8. A list of all execution parameters

Test Cases

If you are using TestSet and TestCase objects as shown in the example below, a panel will show the status of the individual test cases. You can open a test cases details by clicking on it. In addition, you can re-execute just the selected test cases instead of the whole test plan by ticking its checkbox after clicking on the execute button.

Execution tree

The Execution tree shows your Plan Execution steps as defined in the plan editor. Each node represents all executions of this node, a number shown next to it will indicate if the node was executed more than once (i.e. because it was part of a loop-control).

You can click each of the nodes to either see a list of all iterations of this node or directly see the steps details.

Execution steps

The execution steps show the details of the executed Plan, as shown in the following screenshot. By default, all steps (Keyword Calls & executed Controls) are in reverse chronological order.

You can use the search fields to filter the steps table as well as change the order:

You can toggle each Keyword call to display their input and output details, and the Keyword measurements details. Clicking the inspect icon on the right, the step will be shown in the execution tree.

Error

The error view displays an overview of the errors, grouped by message or code type, that occur during the Execution time:

Performance

The performance tab of the Execution view provides you with the most frequently required metrics like throughput and response time, as well as common metric and time range filters out of the box. This dashboard provides statistics over time and aggregated ones for the entire execution. The different charts and tables can be refreshed in real-time or browsed in a static version of the view. For more advanced queries like drill-downs based on custom dimensions, or raw measurement browsing, use custom graphical filters or Object Query Language (OQL).

For more general information and details on analytic dashboards check the dedicated analytics section.

Real-time monitoring

For an ongoing execution, the performance view will automatically cover the test’s current time range and be refreshed every 5 seconds, as illustrated in the screenshot below.

You are presented, from top to bottom and left to right with the following information:

• You are presented, from top to bottom and left to right, with the following information:
• A Performance overview chart showing aggregated results and overall measurements
• Aggregated Statuses chart showing the overall calls grouped by statuses
• Response Time chart showing the average response time by default. The metric can be changed using the button at the top right of the chart
• Throughput chart by measurements. The total throughput is displayed as a bar chart using the right axis
• Summary table of all metrics applicable to the measurements (including percentiles, median, counts, etc.) aggregated over the selected time interval
• Chart showing the number of parallel threads over time

See more details on Analytics Page Structure

Interacting with the dashboard

• You can change the refresh rate for running executions using the dedicated refresh icon at the top right of the view.
• Filtering can be done directly using the top filter selections. The measurements to be displayed or hidden can be selected from the statistics table or configured in the charts options. See more about filters here
• The time range selection can be done at different levels and will be applied to all dashboard widgets. See more about time range controls here.
• The grouping option allows for custom aggregations of the response times and throughput charts, together with the table view. See more about grouping here.
• The dashboard allows some global settings (like charts resolution and compare mode), but also measurements specific settings, like custom metrics, with the ability to hide or show specific data. See more about visual settings here.

Exporting measurements

In case you’d like to use your own toolset to process the raw data, you can use the export entry from the settings menu (top right of the screen). This will include the active filters and time range selection. You will find more details in the dedicated analytics documentation.

Execution control actions

While an execution is running or even after it finished actions are provided to quickly manage another execution or to stop the current execution:

1. Execute the same plan with identical parameters
2. Execute the same plan and select different parameters / test cases
3. This button is only shown while the execution is running. Clicking it will stop the current execution and show a red force stop button if it takes longer to end it. Using the red button Step can be instructed to also interrupt the current keyword execution and not wait for it to finish. Note: Currently this feature is only supported for K6 Keywords, the execution of all other Keyword types will continue until completion.

Use Legacy page

You can optionally continue to use the Legacy Execution Report page.

There are two ways to access it:

1. Globally (admin setting):
   An admin can configure the Step properties by setting ui.reporting.force.legacy to true (default is false). This will deactivate the Beta Execution Report for all users.

2. Individually:
   Each user can switch back to the legacy view by deselecting the “Beta” toggle in the top right corner of the Execution Report page. This preference will be stored in the browser.