Flaky test assignment

Customers on the Pro and Enterprise plans can assign flaky tests to teams.

Enabling flaky test assignments

To enable assignments, you must have at least one team that has access to your suite. You may need to ask your admin to enable the teams feature, and then create teams via the organization settings page.

Flaky test page showing dropdown menu prompting user to create teams
Team page for assigning test suites

Assigning a test

When viewing your flaky tests, you should now see a list of teams with suite access permissions listed inside the Manage flaky test dropdown. From here you may assign, reassign or remove the assignment.

Assignment permissions

All team members have the ability to create, update or remove an assignment. This feature is not restricted to admins.

Tests that are assigned to a team will be updated to display a badge indicating as such.

Flaky test page showing team assignments

Resolving a flaky test

From the Manage flaky test dropdown, you can resolve your flaky test. Resolving a flaky test will remove the test from My Assignments and display a Flaky behaviour marked as resolved badge within the flaky index. The test will stay in the flaky index until it has not flaked within 7 days. If the test flakes again, it will be considered a Reoccurring Flaky and will receive a corresponding badge in the index.

Viewing assignments

Users can check their test assignments by clicking My Assignments in the side bar.

Flaky test page showing team assignments

When an assigned test has not flaked in more than 7 days, it is moved to the Outdated flaky tests section. An assignment could become out of date due to a flaky test being fixed, or perhaps it belongs to a pipeline which has not had a build in the last 7 days. Should the flake reoccur, the assignment will be moved back to the Recent flaky tests page.

Flaky test page showing team assignments

Weekly flaky test summary

You're able to schedule a weekly summary of the flakiest tests assigned to your teams. Visit the Suite settings page to create new notifications, or manage existing ones. If you would like to set up auto assignment, check out our Test ownership feature.

Flaky test page showing team assignments