Test collection overview

Before configuring a test suite, you need to configure a Buildkite test collector for your development project's test runners (for example, RSpec or minitest for Ruby, or Jest or Cypress for JavaScript), or some other mechanism for collecting data from your project's test runners to send to Test Engine.

A test collector is a library or plugin that runs inside your test runner to gather the required test data information to send back to Buildkite for Test Engine to interpret, analyze and report on.

Test collectors are available for the following languages and their test runners:

• Ruby (RSpec, minitest)
• JavaScript (Jest, Cypress, Playwright, Mocha, Jasmine)
• Swift (XCTest)
• Android
• Python (pytest)
• Go (gotestsum)
• .NET (xUnit)
• Elixir (ExUnit)
• Rust (Cargo test)
• Java (via JUnit XML import)
• Other languages or test runners

Note that you can also create your own test collectors.

If your test runner executions are automated through CI/CD, learn more about the CI environment variables that test collectors (and other test collection mechanisms) provide to your Buildkite test suites, for reporting in test runs.

Once you have configured the appropriate test collectors for your projects, you can proceed to run your tests, and analyze and report on their data through their test suites.