My team does not use it, but we have other teams that use LoadRunner Enterprise.
We are an SI, and we have a team that does automated testing. They use LoadRunner Enterprise and similar products, and I am continually looking for ways to improve the start-to-delivery time of changes, upgrades, and releases. We have a content server, and automated testing is up there. I have got Selenium. I have got LoadRunner Enterprise to do the automated testing of the active CI/CD pipeline. Now that LoadRunner is an OpenText product, it will make it easier for us to say that our product of choice is going to be LoadRunner. We can drop it in, and off we go and configure it, and then, hopefully, with the link that we have got, we will get this understanding of content suite, Documentum, and digital asset management, and we will get personalized and more appropriate usage profiles and starting points that we would not get if we were using JMeter or Selenium. We would not have to teach this tool about the OpenText stack.
We just finished the upgrade from one version of the code source to another. We have a whole pile of custom code from other vendors, other third parties, and OpenText as well. Doing any upgrades requires a huge amount of retesting. We have to do functional testing and regression testing. Some of that is being done manually, and some of it is being done through automated scripts. We are looking to try and pull that together so that we can get a faster turnaround time. We can also get more test coverage and get it right. We have a three-month window to get a release out, and we can only do a certain amount of manual testing with people sitting there. With the automated solutions, we can leverage a lot more power to push through and get things done, and that gives me the confidence that it works.
We implemented LoadRunner Enterprise for test coverage. With manual testing or other tools, there are only so many tests that we can run in a given time window. There are only so many tests we can do by manually sitting there and without throwing thousands of people out to testing and having consistent results coming back. When we do an upgrade, there is not just functional testing but also things like load testing and performance testing. We are rolling out Azure Information Protection in the next couple of months. One of the things we have to answer before it goes live is if we turn it on and run it in the way our business works, what is the impact when it comes to user concurrency and user profiles? Is it going to work or is it going to collapse under its own weight? Are they going to notice? What is the operational impact? What is the impact that they needed? Is it an extra ten milliseconds or an extra two minutes to upload a document? Being able to model all that and have controlled evidence available for all the different tests is helpful.
With LoadRunner now being a part of the OpenText family, there is knowledge sharing between the sibling applications. It means that LoadRunner is better positioned or should be better positioned to pick up their other solutions and support them, and we do not have to start from scratch.
We have various customers who use our solutions. Every time we roll out a new integration, change, or upgrade, there are always SLAs. There are always user expectations for how long things take. There is always bug hunting going on in regression testing and making sure that we have not broken anything. Being able to automate those kinds of tests along with the load and performance testing helps reduce the complexity and risk of those activities to the business. With a complex system, there is a risk that we change something over here, and the butterfly flaps its wings, and we end up with something broken over there. We do not see it because we are looking at that new bit over here, and by having a regression test, we can just get a certain percentage done, but with an automated tool, we come across the entire piece. We can identify a suspect and have a look at it. We can see that if we do this combination of data and this combination of settings or users, it works, and then we change this, and it now does not work. We can then fix it. As we roll out new features and functionalities, we can do performance testing. We can do load testing, and we can make sure that for these new features and functionalities, we are ready with the infrastructure to support them. If we roll it out today, and it struggles, then I know in advance that I can put more infrastructure in so that when we turn it on, things work. I can also take it year by year and slot by slot and compare the data and say that my performance metrics were within this, and they have changed. If it comes up towards the SLA or towards the kind of points where the users begin to spot it, I can take action and ask for some extra storage space. If we have 10 gigs a month and a 100 gigs drive, by month eight, we need to order some more space. We do not want to find out two weeks before we get into the tenth month. By being able to see those trends, graphs, and response times for SLAs, but also for general performance and overviews, we can begin to make sure that everyone is heading in the right direction.
For me, having a wider test coverage—not just functional testing but performance and load testing—means that I have less to worry about because I have more coverage. I can have five guys for a week pressing buttons, or I can have LoadRunner do a regression test suite of x thousand cases in the same amount of time. For coverage, it is a much more useful tool. It has a history. It is great. It is not a new product that OpenText just built themselves. They have got an industry-leading group of people who really understand things, so it is a great addition.
I do not personally use LoadRunner Developer. All the test automation is done by my test automation team. It is very important for me to be able to turn around changes for customer numbers and have things out there. When I started with the OpenText Stack, they were doing one release every two or three years, whereas now, they are doing quarterly releases. When you have got heavily customized systems, or you have got quarterly releases, and you have got all these integrations with SharePoint, SuccessFactors, Salesforce, and other types of applications, the number of things that you have to certify and accredit for testing every time you live is overall a much bigger headache in the connected world. There is just the nuance of all the different variants, data models, and business cases and scenarios that you see, so it is becoming massively unattainable to do that. Having a tool like LoadRunner to do that for you and additionally, having it as a part of the family is valuable. They are on the inside, and they have deep integrations or deep access to all the other OpenText lines of business groups and vice versa. Both sides are going to benefit and grow from that close integration. It just allows me to be able to say that I can shift left because I have the confidence that automated testing has done all my use cases. I have got my performance data. I have got my load data, and I am more within SLA. Trying to do that manually or with some other tools takes a lot longer to get to that, and we do not always get the complete coverage that we want. There is always some risk around how many test cases you can manage running in a week versus just running a tool to plow through them.
Most of my test automation guys use the scripting engine and some of the drag-and-drop features depending on what they are doing, such as building the usage profiles and the automation for the things that they want to do. The tool is shortening the amount of time it takes us to build those automated test use cases. We have use cases for adding a document as a user, as a records management user, as an admin, as someone who has sysadmin rights, or as someone whose first language is French. We get all of these little nuances of access and permissions and everything else, and it becomes interesting. Being able to use tools to deliver all that makes life easier for me.
The more I spend time with these tools, the more I understand not just the technical benefits but also how they benefit the end-user community. I understand how they can be used to deliver business goals rather than just technical metrics and help shape what we do and give a reflective user experience. We get to compare what our users do on that client system, and we can quickly build user profiles for that particular client rather than throwing 200 generic requests. We do not work like that because then you end up with incorrect data, and you make wrong designs.
LoadRunner Enterprise has helped streamline our testing processes. My team is primarily focused on the content management space where we have the cadence of quarterly releases. We have our own custom modules, and there are custom builds that we have done for customers. We are quickly able to do regression testing, performance testing, load testing, and new feature testing. We are able to test all the different permutations of user location and object types. We are able to test different variants such as adding a document and then adding an email here or there. We are able to package that part and run it as a part of our deployment pipeline, which allows us to align more closely with clients. We are not a year or two behind of where they were, which used to be the only way of doing it previously. It also assures us that even though we are going faster, we are actually doing more while going faster. We are not going faster and doing less. We are now getting more value.
LoadRunner Enterprise reduced our workload or made our life easier. They are a pain to set up, but we have to invest the time to set up the profiles for the users in terms of what the users do on the system. Do they add documents? Do they read documents? We have to understand what those profiles look like so that we can replicate what the client would do, but once we get that and we run them, I know that they reflect my client. They are an accurate reflection of what the client does. I know that the regression testing is going through all the historic and new things, and everything works. With the performance or load testing, I know that as I turn on any feature in prod, which is always different from every other environment, it is going to work. It is not going to collapse under its own weight. It is going to be performance within SLA and within expectation for end users without causing too many problems, so it becomes a useful armory to be able to say to the business that this is going to work. We are able to model situations where we turn something on, and it does not work because we do not have enough infrastructure. We turn it off again and put more infrastructure in, and we turn it on again and see if it works. Being able to model all of that and find thresholds or breakpoints or being able to prove that we can get the throughput makes the conversations easier. It makes the journey smoother as we do things.
LoadRunner Enterprise has helped improve our product quality.
For me, the test coverage and the performance and load testing aspects are valuable. I have a test management team that works for me. They are the guys who are writing JMeter and Selenium scripts and custom labs to do all the testing. I do not get overly involved in that. My role is more about whether the overall solution is going to work. Is the overall platform going to work? Are we within SLA? Are we within functionality? Also, when we do any upgrades or releases, I have to certify to the client. I need to know how many scripts we have run. If we have done only fifty because we only got two weeks, I need them to do more. Having automated testing that we can run and have it consistent every time, and that can run quicker and more efficiently is very important. I get that level of performance, load, and regression functional testing that makes it easier for me to sleep at night.
After they get over the acquisition, the first improvement is going to be tailoring it for their existing stack of other products. How would LoadRunner work for Documentum? How would it work for Business Network? How would it work for other apps? They can have a pre-package or a guide because they are all in the same family as opposed to being outside. When I spoke to the LoadRunner guys, I said, "You are not a part of the family. You have a simple content server test pack, and you have some accelerators that will get me going with your LoadRunner on another OpenText product." They said, "We just started building those because we have just formally become part of the family." That is going to come out. That is going to add value as I roll out LoadRunner and put it on the mix for other customers and new prospects. When those accelerators are there, I would trust them more. I trusted it previously when they were outside or not inside the box. Now that they are both inside the box, I am expecting synergy to be there.
It is a stable product, but there are always going to be things when you introduce something, when you find a curveball that causes a problem, or when you bump into something that does not work. We just flag it up to them. Most of my guys have been around a while with various of these products, so we are able to dig in and help or support the investigation process that the support guys are doing from outside and feed that information into the support process, the R&D bug-fixing process, or the new feature request process. The guys are getting as much help as they can from us. At the end of the day, the more my guys can do to help out the OpenText guys, the better product or support we get. We get a quicker response, so we are helping OpenText support to help them help us.
Generally, if I say that something does not work and I have an error, I get an email asking for logs. I send the logs, and then they ask whether I did that as a sysadmin or as a normal user. A couple of days go by in me checking that, and it goes back in. After that, they ask about the version of patches that we are running. These are the common things that we get asked, so now, we just tick those boxes when we hand it over to OpenText support on day one so that we do not have this kind of delay in the process. We also keep looking at it because OpenText might get something working, or they might not be able to see anything with it because we might have a customized solution or we might be a slightly different version or something like that. The more we can help them and feed it back, the more information they have to zero in on where that problem is. They can come back and say that the last little bit we gave them got them on the spot, and they have now found the bug, and they can fix it. We will get that in this release, and they can hotfix it back for us. Their help is great. I am an engineer, so I always want more documentation, more support articles, and more architecture models so that I can understand more about the solution. It is good to see some of that stuff coming out as being able to be leveraged.
The products do scale. We have some very big customers. Where we begin to struggle with scalability is generally not within the OpenText purview. The bottlenecks we see when we do large bits of work are in the database or in the network because we are just trying to throw some new requests. It does scale, but we just have to scale sensibly rather than just throw more infrastructure at it. Sometimes, you are not solving the right problem. For example, if a customer wants to create three million business workspaces in six months, I ask them how many they need on day one, or which ones would they work with on day one. We load that set first. We then ask them which is their last set, and they say that they have records for people who are no longer account holders, so they want them available, but their account execs and phone guys are not going to be looking at those on day one, day ten, or day twenty. We then move them last, so we break the problem down, and then we look at the tooling that is there. The good thing and also the bad thing is that there is always more than one way to solve a problem. There are tools. There are REST APIs, and there are prebuilt solutions. We need to work out exactly which is the right approach and the right tool to do it. This is where people at OpenText and other customers come in because you can just ask the question about what you want to do. If someone has done it before, they can give you some input to try this or that or look out for this because they bumped into this. You get that kind of community help and support. You certainly get help from OpenText support as well.
They are very good when you get the right team and the right person. When I started out, there were one or two products. The first line generally had a good understanding of those one or two products, so you get a lot of things answered straight away, whereas now, sometimes, it takes a while because the first-line guys ask you if you are a Documentum guy, and then they have to get the information to pass on to the right person. Therefore, sometimes it takes a while, but once we find the right person, the support has always been great. They are helpful and supportive.
We use a mixture of products based on industry-leading products and also based on our clients' preferred tool. We are an SI, and we do a lot of work with clients. Client X might say that they are a JMeter shop, and this is what we should use because getting anything else accredited requires a separate process. The next client used LoadRunner or Selenium, so we tend to be testing-technology agnostic. However, now that it is a part of the OpenText family, if I have a say in the matter and if they are on an OpenText program, I can say to clients that it makes more sense to go for LoadRunner. I want to pick the product from the same family rather than picking something that is on the outside looking in and does not have that kind of synergy.
We have seen an ROI. For me and my teams, using automated testing tools from whichever vendor is saving us time and money and improving quality. It allows us to do all the regression testing and get performance data, which makes us able to spot bottlenecks and problems in what we are rolling out. We can see that something works at this scale, but when we try and scale it up, we start seeing issues or bottlenecks that we have to fix before we give it to a customer.
I do not deal with pricing and licensing. My job is to make the engineering work.
I would rate LoadRunner Enterprise a ten out of ten. It is a product that I have known as being a market-leading tool in that space for years. Being more of a software engineer and architect, testing tools are not something that I am intimately familiar with, but everything I am hearing from the guys that do that work is that it is the tool to use. It is great to have it in the OpenText family.
There are some spelling mistakes, kindly correct this please.