fbpx
1-888-310-4540 (main) / 1-888-707-6150 (support) info@spkaa.com
Select Page

Why Software Builds Fail and Areas for Improvement

Published by SPK Blog Post
on June 29, 2015

In a recently published paper, researchers at Google examined the issue of failed software builds within their organization. Specifically, they wanted to address the separate questions of “How often do builds fail?”, “Why do builds fail”, and “How long does it take to fix broken builds?” To answer these questions, the researchers looked at 26.6 million Java and C++ builds due to the overwhelming usage of these two languages within Google. For the purposes of this article, we will review the results of the question “why do builds fail?”

To determine why builds were failing, the researchers examined the build logs and categorized compiler error messages into different groups. Of the categories defined, the researchers looked at the top 25 most frequent error messages to identify the most common cause of build failure. The results indicated that only 10 percent of the error categories accounted for 90 percent of the broken builds, regardless of the language. Additionally, those errors where most commonly dependency related.

Insofar as these findings are generalizable to organizations outside of Google, the implications of this research suggest that dependency management is one of the most critical areas of concern for decreasing the amount of broken software builds. Potential actions could include reducing the dependencies for a given project, or developing assistive tools to help developers resolve dependency errors. Ideally, the goal should be to help prevent developers from submitting changes that contain dependency errors. In this study, the average resolution time was one to two additional builds. In this scenario, if we assume introducing a dependency-related bug requires two additional builds, the cost of such a bug is 3 times the elapsed build time in addition to the developer’s time required to resolve it.

Next Steps:

David Hubbell
Software Engineer
SPK and Associates

Latest White Papers

Total Economic Impact for Atlassian Open DevOps

Total Economic Impact for Atlassian Open DevOps

Forrester's Total Economic Impact Study found that Atlassian Open DevOps could net your organization a potential ROI of 358%. Discover an overview of this Forrester research paper below and download your free copy. Forrester Research Into Atlassian Open DevOps Agile...

Related Resources

Why You Should Be Using PTC Windchill As Your PLM Software

Why You Should Be Using PTC Windchill As Your PLM Software

As a manufacturer, you have to be both structured and agile to constantly stay in line or ahead of the industry. You have to deliver quality products that meet the customer’s needs today whilst being future-proofed for tomorrow.  Aside from that, you also need to...

Jira Integration For Greenlight Guru: Top 3 Reasons To Do It

Jira Integration For Greenlight Guru: Top 3 Reasons To Do It

Medical devices manufacturers can now benefit from Jira integration with Greenlight Guru. The only electronic quality management system (eQMS) specifically designed for medical device companies. This Greenlight Guru integration with Jira creates an agile system for...

Jenkins Accelerates Continuous Delivery Pipeline

Jenkins Accelerates Continuous Delivery Pipeline

Looking to accelerate your continuous delivery pipeline? We have the answer. In this white paper, sponsored by CloudBees, you'll get an introduction and step-by-step guide on how to use Jenkins Pipeline.  Jenkins And The Continuous Delivery Pipeline Jenkins Pipeline...