Case Studies

Intercom

Software - 120 engineers

Intercom logo

Intercom is a live chat system for support, sales, and marketing teams that allows businesses to track and filter customer data; this data can be used to create personalized, automated marketing emails and in-app messages.

Intercom runs on two large applications: A Ruby on Rails monolith (the backend of Intercom, where the majority of code is written) and a large Ember.js application (the frontend that customers use). Both applications are complex in terms of the amount of test cases, the amount of code, and the amount of effort that the Intercom team invests to give developers the best environment to work in so they can ship code quickly. “Shipping is our heartbeat,” says Intercom’s Principal Systems Engineer, Brian Scanlan. “We like having a single application and invest in it accordingly so that our developers can be very productive in it.”

150
deploys per day
85%
reduction in test times
Having control over our most important build pipelines has enabled us to move really fast and really reliably. That kind of control has been transformative for our developer productivity and the ability to securely run pipelines for infrastructure as code.
Brian Scanlan

Brian Scanlan
Principal Systems Engineer

Challenge

The Intercom team deploys about 150 times per day across multiple applications in the codebase. The continuous shipping of code requires the team to run a large number of tests and they needed a CI solution that could keep up with their demands.

Previously, Intercom was using two other CI tools — almost in redundancy — in order to achieve the stability they needed to build and to enable Intercom developers to do performance work on either of those environments. Unfortunately, even with dual solutions, they were unable to achieve the speed and control levels needed. “We’d still have outages and all sorts of problems which was frustrating,” says Scanlan. In the end, neither platform allowed the team to optimize for the things the team wanted. Plus, it was time-consuming and expensive to keep up both of them.

The team knew what they needed: reliability, control, and speed. “Getting the reliability of tests to run correctly was the first thing we needed to focus on. Just having full insight into what was going on would give us more visibility, and we’d be able to fix things quicker rather than working on a more closed platform,” Scanlan reflects back, “Then, optimizing for speed because the faster we can get feedback to the developers, the better.”

Solution

The final straw came when the Intercom team grew tired of seeing a continued failure rate of their JavaScript application — nearly 50% of the tests were failing.

“There was nothing wrong with the tests; it was the environment that was always failing,” Scanlan reports. This seemed like a good use case to try a new approach so, focusing solely on reliability, the Intercom team used Buildkite to orchestrate the build within their own EC2 infrastructure. “We didn’t even have an efficiency goal at that point. We just wanted a reliability improvement, so that was the small thing we were going to try out first,” reports Scanlan. Once they saw that reliability was no longer an issue, the team began optimizing for speed and moving all of their builds over to Buildkite.

Benefits

For a company whose “heartbeat is shipping”, time is priceless. While it used to take 20 to 25 minutes, the Intercom team can now run tens of thousands of tests in just three minutes. This provides their developers with real-time feedback which translates to a better developer experience and also gives them the ability to be more responsive when doing things like rolling back problems, getting changes out, or dealing with security problems.

“The mix of being able to own the infrastructure, performance-tune everything ourselves, having that full control, and then taking advantage of some Buildkite features (things like retries for failed build jobs and other kinds of automation) allows us to go really, really fast,” says Scanlan.

Photo of some of the Intercom engineering team
Photo of the Intercom office
Two people launching a pod

Sign Up

Sign up for free, and
connect your first agent.

Sign up →

Talk to our team

Send us an email if you’d like to chat about how Buildkite could help you.

Email sales@buildkite.com

More case studies

Pagerduty

Software - 233 Buildkite users

Pagerduty is the leader in digital operations management with more than 13,000 customers worldwide who rely on its platform to keep their own digital services running. Its platform helps clients identify issues and opportunities in real time and bring together the right people to fix problems faster and prevent them in the future.

Read the case study
99%of production builds pass through Buildkite
531average builds per day

REA Group

Ecommerce - 550 engineers

REA Group is a multinational digital advertising business specializing in property. Moving to Buildkite from a mix of different build systems, REA was able to significantly decrease their maintenance costs, more easily adopt best practices across all their teams, and make full use of their AWS and Docker expertise.

Read the case study
550engineers globally
80%reduction in team setup time

Shopify

Ecommerce - 1800 engineers

Shopify is a global ecommerce platform serving hundreds of millions of shoppers. Switching to Buildkite allowed Shopify to reduce their core application’s build times to under 5 minutes, supported an engineering team growth of 300%, and helped to smoothly transition from AWS to Google Cloud.

Read the case study
75%reduction in build wait times
4xincrease in CI speed for the same budget