Shopify’s scaling success: dramatically reducing build times amidst massive engineering growth

Shopify, a leading global ecommerce platform, reduced build times to under 5 minutes, and grew its engineering team by 300% by switching to Buildkite.

8,000
Active pipelines
300,000,000
Jobs run Jan–Oct 2023

Shopify is a global commerce platform powering more than 500,000 entrepreneurs and businesses, and in 2016 they served over 100 million shoppers. They are based in Ottawa, Canada, but have a global presence with over 900 engineers.

Having outgrown their previous hosted CI provider, Shopify needed to reduce their build times from 40 minutes to less than 10 minutes. At the same time, they were scaling their engineering team from 300 to 900 and expanding across multiple time zones.

Buildkite enabled Shopify to auto-scale their build servers to match their engineering teams’ peak demand, and they now run almost 10,000 concurrent build agents. Buildkite’s agent architecture allowed them to take full advantage of cloud cost reduction features, providing a much larger compute capacity for the same cost, and allowed them to smoothly transition from AWS to Google Cloud.

In the face of 300% team growth, Shopify has maintained their targets of keeping build times under 10 minutes, and have been able to apply the same scaling techniques to their key Android and iOS projects.

Start turning complexity into an advantage

Create an account to get started with a 30-day free trial. No credit card required.

Buildkite Pipelines

Platform

  1. Pipelines
  2. Pipeline templates
  3. Public pipelines
  4. Test Engine
  5. Package Registries
  6. Mobile Delivery Cloud
  7. Pricing

Hosting options

  1. Self-hosted agents
  2. Mac hosted agents
  3. Linux hosted agents

Resources

  1. Docs
  2. Blog
  3. Changelog
  4. Webinars
  5. Plugins
  6. Case studies
  7. Events

Company

  1. About
  2. Careers
  3. Press
  4. Brand assets
  5. Contact

Solutions

  1. Replace Jenkins
  2. Workflows for AI/ML
  3. Testing at scale
  4. Monorepo delivery

Support

  1. System status
  2. Forum