Buildkite Reviews

We use Buildkite for CI/CD during software development stages. Our environment includes separate pipelines for different tasks, such as testing, deployment etc... We have 30-40 pipelines in Buildkite

Initially, we manually configured and ran tests during deployments using Jenkins. After each job, we manually reviewed the reports to identify any test failures and then reported these to the development team. This process created a significant gap between the developers and the testing team.

To address this, we implemented Buildkite. Now, every code change triggers automated tests. We have separate pipelines for each stage of software development, including app testing, system testing, and deployment. This setup functions like a flow diagram: changes in the app automatically progress through the testing and deployment stages. Based on the results, the application is deployed to the server seamlessly.

Using Buildkite, managing pipelines becomes much easier. Each pipeline’s output is straightforward to understand, making it simple to edit configurations, Despite an initial steep learning curve, the overall process remains comprehensible. Buildkite also offers features like hooks and triggers; for instance, an action in the app can automatically trigger a pipeline. These elements can be added to specific pipelines, ensuring the entire process is automated.

When changes are made and files are modified in the repository, Automattically with the helo of hooks the Coresponding test pipeline this triggered.The hooks and the use of YAML files are particularly helpful in this process.

Since we were using Buildkite for the first time, we initially had a lot of difficulty understanding how it worked. The lack of third-party documentation meant we had to rely solely on Buildkite's documentation, contributing to a steep learning curve. Over time, it became much easier to use, though understanding certain features in Buildkite and YAML Configurations was particularly challenging at first.

Buildkite provides a comprehensive pipeline execution environment. However, in certain instances, Where a pipeline get's failed, pinpointing errors can be difficult. Therefore, when issues occur, understanding the root cause can be trickier and requires deeper analysis.

I have been using Buildkite for eight months.

We haven't face issues till now.

We haven't had any issue for the scalability part.

Previously, we utilized DevOps and Jenkins. With Jenkins, deployment was a manual process; we identified the job and validated it through reports. Now, everything is fully automated with the introduction of Buildkite. For each specific change in the application, the corresponding test pipeline is executed, and deployment occurs only if the pipeline get's passed.

The initial setup is complex. Most work for the pipeline has to be done by the development team. I'm only responsible for the test pipelines from our end.

We began with a POC for the build process, which took around one month. We started by using Azure DevOps, then transitioned from Azure DevOps to Buildkite. It took us some time to configure Buildkite and understand how it works. Eventually, we managed to have it up and running within a week. The entire POC phase lasted around eight to nine months, during which we thoroughly reviewed and refined our plans.

At least ten people were involved in the Buildkite deployment.

We are using the free version of the solution.

I was not part of the process

Overall, I rate the solution a seven out of ten.

We used the solution for CI/CD pipeline, continuous integration, and continuous deployment. I used Buildkite for one of the projects in my previous company. I had to use Buildkite for just one project when I worked for a startup.

Buildkite is similar to Jenkins. You don't have to set up an agent in Buildkite like in Jenkins. In the Azure DevOps pipeline, you have to install an agent in a separate VM or maybe a Windows agent. Buildkite is like a managed service where the solution manages everything.

The solution should offer more options for installing an agent and give users the option of having a separate self-hosted or provisioned agent. The solution's user interface and user access were not that friendly.

I did not have any specific issue with the solution’s stability.

The solution's initial setup was challenging compared to other tools, maybe because we were using it for the first time. It was a new tool in the market when we deployed it.

We used the solution’s free version.

Overall, I rate the solution a six out of ten.

There are two major purposes for Buildkite in my job role. Firstly, I use it for the release of transcripts and managing deployments, including unblocking and blocking them. Secondly, I also run automation integration tests on different branches.

I mainly use what has been set up by our team members and haven't explored the details myself. 

Buildkite makes it easier to conduct deployment. When I merge a PR in Buildkite, it automatically starts the deployment process. It used to be challenging to shift code from the development branch to the testing branch because I had to follow up with multiple developers. Previously, I was dependent on the DevOps team and developers to handle deployments, but now it allows me to deploy the solutions myself. This has made it much easier for me to handle both non-production and production environments.

Buildkite has issues while creating or extending branches as only the first five builds in the user-interface can be accessed and post that one has to access the next builds by remembering branch names without pagination which can be inconvenient.

I have been using Buildkite for the past four years. 

Buildkite has been stable.

Buildkite is scalable but it has an issue while creating or extending branches. I can only access the first five builds in the user interface, post creation. After those, I need to search for the next builds by remembering branch names without pagination which can be inconvenient. However, the scalability hasn't negatively affected my work processes. 

I find Buildkite cost-effective as it has definitely increased my productivity, especially on the deployment side. It saved a lot of my time and improved data management because I can handle different environments myself now.

There were no issues faced during the integration. We've integrated unit test coverage results into Buildkite, which provides detailed information about their status. Our automation pipeline is also integrated with Buildkite, allowing us to see clear logs and track the progress of each step.

The tool is simple and has no learning curve. If you know YAML, you can master it. It is simple to learn. 

As a newbie, I think BuildKite has several issues. For example, it can't get the status of a PR once it's closed. The syntax is easy to use, but updating a pipeline requires administrator settings, and viewing pipelines for others isn't straightforward.

Another issue is the lack of additional support, especially with plugins. Most plugins, except for a few like Docker, aren't updated regularly on GitHub. While we haven't faced major issues, having someone actively maintain these plugins would increase confidence.

I have been working with the product for two years. 

The tool's support comes up with a solution, but its limitations affect it. 

Positive

The tool's deployment is straightforward. 

I rate the overall product an eight out of ten.