Buildkite Test Engine

Scale out your testing across any framework with Buildkite Test Engine. Speed up builds with real-time flaky test management and intelligent test splitting. Drive accountability and get more out of your existing CI compute with performance insights and analytics.

Where Buildkite Pipelines helps you automate your CI/CD pipelines, Test Engine helps you track and analyze the steps in these pipelines, by:

  • Shipping code to production faster through test suite optimization.
  • Working directly with Buildkite Pipelines, as well as other CI/CD applications.
  • Identifying, fixing, and monitoring test suite performance.
  • Tracking, improving, and monitoring test suite reliability.
Screenshot of test suite trend showing five metrics over 28 days

Buildkite Test Engine was previously called Buildkite Test Analytics.

Get started

To get started with Test Engine, and to begin setting up your test suites, configure the relevant supported test collectors for your development project.

:rspec: RSpec :ruby: minitest :jest: Jest :mocha: Mocha :cypress: Cypress :jasmine: Jasmine :playwright: Playwright :swift: Swift :android: Android :pytest: pytest :golang: Go :junit: JUnit :dotnet: .NET :elixir: Elixir :rust: Rust

You can also upload test results by importing JSON or JUnit XML.

Once your test collectors have been set up, you can begin configuring your test suites by running through the relevant 'Getting started' sections, beginning with Configuring test suites for an overview of Test Engine's concepts and functionality.


Data retention

The data uploaded to Test Engine is stored in S3 and deleted after six months.