Executions give you an insight in the results of an executed Plan as well as the ability to detect and analyze errors, both within the Plan or the system tested / automated with it.

Execution steps

On the Execution list view, clicking on the Plan name of an Execution redirects you to the details of that execution. The Execution steps view shows the details of the executed Plan, as shown in the following screenshot. By default, the Keyword calls are in reverse chronological order.

You can use the search fields to filter the Execution steps table as well as change the chronological order display:

If you are using TestSet and TestCase objects as shown in the above example, the Execution steps will be grouped by test case. You can open a test case details by clicking on it. In addition, you can re-execute just the selected test cases instead of the whole test plan by ticking its checkbox and clicking on the execute button.

You can toggle each Keyword call to display their input and output details, and the Keyword measurements details:

Clicking the right search in interactive session icon in the measurement details will open the analytics charts view of that Keyword. You can also view each Keyword call details by clicking on the icon next to each Keyword name:

Execution tree

The Execution tree shows your Plan Execution steps in a chronological order tree style. You can expand each of the nodes to display the details:

Performance

The performance tab of the Execution view provides you with the most frequently required metrics like throughput and response time, as well as common metric and time range filters out of the box. This dashboard provides statistics over time and aggregated ones for the entire execution. The different charts and tables can be refreshed in real-time or browsed in a static version of the view. For more advanced queries like drill-downs based on custom dimensions, or raw measurement browsing, use custom graphical filters or Object Query Language (OQL).

For more general information and details on analytic dashboards check the dedicated analytics section.

Real-time monitoring

For an ongoing execution, the performance view will automatically cover the test’s current time range and be refreshed every 5 seconds, as illustrated in the screenshot below.

You are presented, from top to bottom and left to right with the following information:

• You are presented, from top to bottom and left to right, with the following information:
• A Performance overview chart showing aggregated results and overall measurements
• Aggregated Statuses chart showing the overall calls grouped by statuses
• Response Time chart showing the average response time by default. The metric can be changed using the button at the top right of the chart
• Throughput chart by measurements. The total throughput is displayed as a bar chart using the right axis
• Summary table of all metrics applicable to the measurements (including percentiles, median, counts, etc.) aggregated over the selected time interval
• Chart showing the number of parallel threads over time

See more details on Analytics Page Structure

Interacting with the dashboard

• You can change the refresh rate for running Execution using the dedicated refresh icon at the top right of the view.
• Filtering can be done directly using the top filter selections. The measurements to be displayed or hidden can be selected from the statistics table or configured in the charts options. See more about filters here
• The time range selection can be done at different levels and will be applied to all dashboard widgets. See more about time range controls here.
• The grouping option allows for custom aggregations of the response times and throughput charts, together with the table view. See more about grouping here.
• The dashboard allows some global settings (like charts resolution and compare mode), but also measurements specific settings, like custom metrics, with the ability to hide or show specific data. See more about visual settings here.

Exporting measurements

In case you’d like to use your own toolset to process the raw data, you can use the export entry from the settings menu (top right of the screen). This will include the active filters and time range selection.

Error

The error view displays an overview of the errors, grouped by message or code type, that occur during the Execution time:

You can jump directly to the nodes producing the error by clicking on the error type:

Execution control actions

While an execution is running or even after it finished actions are provided to quickly manage another execution or to stop the current execution:

1. Here you can start another execution of the same plan and also to simulate or schedule it
2. This button is only shown while the execution is running. Clicking it will stop the current execution and show a red force stop button. Using the red button Step can be instructed to also interrupt the current keyword execution and not wait for it to finish. Note: Currently this feature is only supported for K6 Keywords, the execution of all other Keyword types will continue until completion.