What is our primary use case?
I have been using Zebrunner Testing Platform for years. My main use case for Zebrunner Testing Platform is that it is a test automation platform designed to run, manage, and analyze automated tests at scale. It acts as a central hub for test execution, providing test orchestration such as reporting and analyzing, and infrastructure management for both cloud and on-premises environments. CI/CD integration allows me to integrate various CI/CD tools. Additionally, it has test artifact storage including logs, screenshots, and videos. In simple terms, Zebrunner executes tests, provides monitoring, and serves as an analytics platform for automated tests.
A specific example of how I use Zebrunner Testing Platform in my daily workflow is that we integrated it with frameworks such as Selenium WebDriver, Appium for mobile testing, and Cypress for the Playwright API testing framework.
Zebrunner Testing Platform runs automated tests in multiple environments and supports parallel execution at scale, which is the most advanced feature. It runs over 1,000 UI tests across 10 browser types simultaneously, which is the best feature.
The unified dashboard helps me and my team, especially the QA team, to report issues more effectively. We have integrated it with CI/CD, so whenever a developer pushes code, it starts to run the test automation from Zebrunner and then sends the analytical report to our QA team. Based on that, they will raise a bug, which makes their job simpler and easier.
Zebrunner Testing Platform is deployed in my organization as Software as a Service, so we are using the public cloud.
What is most valuable?
The best features that Zebrunner Testing Platform offers include its unified dashboard showing pass-fail rates, execution time, and trends over time, as well as storing screenshots, logs, and video recordings. For example, the QA team identifies that failures increased after a release.
Zebrunner Testing Platform has positively impacted my organization by making deployments quicker than before. Every time there is development, there is QA testing. It used to take a considerable amount of time, but now deployment is made easier with Zebrunner Testing Platform.
We generally take three to four days for development, deployment, QA, bug fixes, and everything, but with Zebrunner Testing Platform, we can do it in two days or even in a single day.
Zebrunner Testing Platform is a SaaS, so everything is managed. It is a Software as a Service based on subscription. It charges based on the number of users and test execution, and also based on infrastructure usage. Its estimation ranges from thirty to two hundred dollars per user per month.
What needs improvement?
An improvement for Zebrunner Testing Platform is that it is easier to learn compared with others, but there are UI and UX complexities. Some users report hard navigation and an outdated interface, making it difficult for developers or QA to navigate. Additionally, there is no pricing transparency, as pricing is not always clear upfront, and it customizes based on scalability.
Zebrunner Testing Platform could integrate AI, mainly in failure grouping and analytics, so that it auto-corrects or predicts issues during the push itself rather than running test cases. Every test case takes about ten to twenty minutes to run, but with AI integration using caching memory or something similar, it can provide reports earlier.
Regarding Zebrunner Testing Platform's AI capabilities, I note that it does not have any AI capabilities, which is what I observed.
In terms of accuracy and reliability of output, Zebrunner Testing Platform lacks AI capabilities, so it does not offer any accuracy.
For how long have I used the solution?
I have been working in my current field for more than five years.
What do I think about the stability of the solution?
Zebrunner Testing Platform is stable.
What do I think about the scalability of the solution?
The scalability of Zebrunner Testing Platform is quite good. Compared to Azure DevOps Test Plans, Zebrunner Testing Platform is quite good.
How are customer service and support?
The customer support for Zebrunner Testing Platform is excellent with very prompt and quite good response times.
Which solution did I use previously and why did I switch?
We did not use any solutions earlier; this is the first time we are using Zebrunner Testing Platform.
What was our ROI?
We have seen a return on investment, as fewer employees are needed. This allows us to avoid a massive QA team for testing; instead, CI itself performs half of the QA's functions.
What's my experience with pricing, setup cost, and licensing?
My experience with pricing, setup costs, and licensing is that pricing is not always clear upfront. There is custom pricing for larger teams, which makes it hard for companies to budget. Some users explicitly mention a lack of clarity in pricing and licensing, and it is not ideal for startups or small teams. However, it is a good tool for enterprises with teams beyond sixty to seventy people, charging quite less at twenty-five to thirty dollars per user.
Which other solutions did I evaluate?
Before choosing Zebrunner Testing Platform, we did not evaluate other options. We looked to execute using only Selenium and managing tests only with TestRail. We did not have a proper platform such as Zebrunner Testing Platform.
What other advice do I have?
I would rate Zebrunner Testing Platform an eight out of ten. It is a good tool, but I give it an eight because it may not fully replace tools such as TestRail or Jira Test Management.
I choose an eight out of ten because it is not ideal for small teams, which may find it overkill if they have fewer than fifty people. The higher cost is a significant reason, and it is best suited for enterprise QA teams with larger automation sets, such as one thousand or more tests, particularly for DevOps-driven companies.
My advice to others looking into using Zebrunner Testing Platform is that if you are in a proper enterprise organization with a large amount of QA, you can definitely use Zebrunner Testing Platform without hesitation. I rate Zebrunner Testing Platform an eight out of ten overall.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?