Buildkite Agent Job Queues

Each pipeline has the ability to separate jobs using queues. This allows you to isolate a set of jobs and/or agents, making sure they only run jobs that are intended to be assigned to them.

Common use cases for queues include deployment agents, and pools of agents for specific pipelines or teams.

The default queue

All agents include an extra default tag of queue=default.

Setting no queue value will match every available agent in the 'default' queue.

Setting an agent’s queue

An agent’s queue is configured using an agent tag, which can be changed using the command line flag, an environment variable, or the config file.

Agents can listen on a single queue or on multiple queues. You can add as many extra queue tags as are required.

In the below example using the --tags flag of the buildkite-agent start command, two queues are specified which will result in the agent listening on both the building and testing queues:

buildkite-agent start --tags "queue=building,queue=testing"
Screenshot of an agent's tags showing both building and testing queues

Targeting a queue

Target specific queues using the agents attribute on your pipeline steps.

For example, the following build step matches only agents running on the deploy queue (and ignores the agents running the default queue):

steps:
  - command: tests.sh
    agents:
      queue: "deploy"