Alluvio Aternity Reviews

As a bank we have a lot of retail branches, and we especially rely on Aternity for helping us do fault domain isolation across our infrastructure and in the end-user space. We can understand relative performance between different remote locations, and we can understand, within a user profile, when there are hardware issues and when there may be software issues. We use it in our corporate offices as well, but we really see the focus being around when a branch user is having a problem. 

We're not as mature as some organizations so that we don't have a full, proactive reporting and alerting built through Aternity yet, but that's on our agenda for the near-term, in the next three to six months.

We deployed it in our own AWS space. It's not on-prem, but it's also not SaaS.

When we converted Windows 7 to Windows 10, we were able to isolate some issues. Aternity pointed out that there needed to be changes in the VDI. We needed more memory to be allocated. It wasn't necessarily clear just from the specs from Microsoft, but it became clear as we migrated people over, with a before-and-after view within Aternity.

When employees complain of trouble with applications or devices, Aternity enables us to see exactly what they see as they engage with apps. That allows us to focus our troubleshooting. Fault domain isolation is the difficult problem. Knowing where the problem is 75 percent of fixing the problem, or even more than that. Aternity helps us know where the problem is. We can compare different branches, we can compare different users, and we can compare different applications to help us determine what the common factors are.

The most valuable features are the ability to 

• separate machine issues from software issues 
• build custom monitoring of our own homegrown or non-standard applications.

As a financial institution, we have a lot of applications that are either written internally or bought from a vendor and customized for us. Having a tool that lets us monitor specific transactions in those applications allows us to focus on the transactions that are important to the business. We find it valuable to be able to see what's going on with the hardware and look at standard applications like Outlook or Teams or Office applications. Those provide a comparison point and let us separate out hardware versus software issues. 

The custom monitoring is where we really do see a lot of value.

We don't feel that we get the back-end transaction details from Aternity. We have other tools that do that.

Also, there is room for improvement in the granularity of the alerting and reporting. We would like to be able to alert on a defined set of users for a given application, for example, that all users in this group who are using this application are seeing low performance. And we would like it to provide comparisons of that to other users in a similar group that are not experiencing the issue. We would like the ability to alert and report on those types of specifics. I don't necessarily know what all the parameters are that I might want to use to slice that data, but our experience has been that within Aternity it's not always as granular as it needs to be. 

Version 11, with the Tableau reporting, offers some promise there. We're only a couple of weeks into Version 11, so we haven't fully implemented it. But that's something we're looking to improve with our new version, moving forward. 

The other place for improvement, as an on-prem, non-SaaS customer, is that the system administration and management in Aternity are very difficult. They've even told me that most of their support calls come in due to configuration and system administration on their on-prem. Their on-prem solution is not easy to use. I know it's not their focus, but for now they still have us and a lot of other customers using it, and they could improve that, rather than forcing wholesale, brand-new builds.

We've had Aternity for six years.

The stability has been good. When we were running version 9, we did not have a lot of problems. We've run into a few applications that were affected by the agent so that we had to not use the agent on some of our very specific, custom-built apps. The Aternity agent somehow interacted with them to the point where the application did not work. But stability-wise, in general, nothing has changed.

Their design is pretty scalable from what we've seen. Before I was involved with the product, people did take it from just a couple of thousand agents up to 10,000, and now we're over 20,000 agents, without too much trouble. It does scale. I've talked to other companies that have hundreds of thousands of agents.

We do not have all our business-critical applications in there. It's also not just a few. We were waiting because we just upgraded to Version 11. We are looking to now go more broadly into other applications. Certainly, the most critical applications are in there.

We have plans to increase our usage. We have a mandate to start using it more for proactive monitoring and to increase the footprint, the number of applications, that we're looking at.

Aternity's technical support is average. We had to push to get the right people and resources engaged from the back-end technical. I found that a lot of the support required us to wait for an email response. We've pushed our account team and they did respond and help with that somewhat, but in general I've seen better and I've seen worse than the Aternity support, in the tech world.

Previous to this, there wasn't really a tool that gave visibility into the end-user device experience at this level. We had related solutions from Dynatrace that would look at the back-end system performance and the front-end user experience as users connected to the servers in the data center. But they didn't look at what was happening on the desktop and how the end-user really perceived that webpage loading or that Outlook item coming in.

The initial setup was complex. There are multiple servers involved in the management system and getting those servers to interact properly — getting them configured so that the management system, the aggregation servers, and the database all communicated properly, all shared certificates properly, and had the proper certificates installed for the API — all of those pieces were difficult. There was a lot of stuff that was not straightforward in our implementation.

Our upgrade from version 9 to version 11 took three months to get the new servers built and configured correctly, tested, load balancers built, etc. That was with Aternity support, so it was not a straightforward implementation.

In terms of an implementation plan, going to version 11 we built a development environment in AWS, completely separate from our existing version 9 production environment. We got that working and then replicated it into production and then deployed part of the solution alongside the current version 9 before we finally upgraded the full system to version 11.

Internally, on our admin side, there are three IT folks who work on Aternity.

What I'm spending versus what I'm getting is a little high, especially as I explore the possibility of moving into their SaaS solution. But I think we have had return on our investment. We had some struggles under the older version, struggles that version 11 seems to be fixing. If we get to the place where we are proactively alerting and where we're giving better reporting, both of which are available in the new version, then we'll absolutely be getting return on our investment from our on-prem.

In my opinion they are asking a lot for their SaaS solution, but I also know that that's the direction they're going. They seem like they're on the high side for what they're providing, but we're not fully implemented. We've got some room for growth. As we grow into using Aternity more, I would hope that we'll be able to do that with costs staying flat. Then it would become more of a return on investment.

Their pricing is a little high. Their pricing model has changed from the old style — and all companies are doing this — the older perpetual license plus maintenance, to more of a subscription-based service. They're pricing their subscription a little high right now.

The current, on-prem solution is probably a fair price. I need to get more value out of it, so that's where I hesitate a little bit. But especially in the SaaS world, when I looked at some of the pricing, I was a bit taken aback.

At the time, we did not look at other solutions. I wasn't managing the team that runs Aternity at the time Aternity was chosen. I don't know for sure what else they looked at. We have looked briefly at other solutions in the past, after having already had Aternity in place, and have not chosen to take it out, at least not yet.

My advice would be to push the support people to help you. Engage the vendor early in the process, via Pro Services or via the support, to help with the implementation. Aternity support requires you to press a little bit to get what you want. If you want to get support, you have to engage them strongly and be very assertive.

Have a solid list of objectives for what applications and what activities you want to have monitored. It's easy to get lost in "Let's look at everything" without understanding what your key, business-critical functions are. Have a top-10, top-20, top-50 list of activities and attack them that way. That's been a bit of a weakness in our implementation.

The fact that other products may provide deeper visibility into device performance does not concern us. We've had very few cases, to date, that have required any deeper level of device performance metrics.

Right now I would rate Aternity at about a seven out of 10, and with the potential to go right up to an eight-and-a-half or nine if we get our version 11 implementation completed the way we're planning.

Because we are in retail, we have a lot of store-facing applications and they have some performance issues. We really want to know how an application is behaving at the endpoint, from the end-user perspective. We support Microsoft Teams, SharePoint, and all the Microsoft SaaS products.

If a user was having any issues they used to call us. After we installed Aternity it helped by sending advanced alerts so we can proactively look at the issues, whether it's an issue with the PC, the network, or the back-end. It's a nice tool.

The solution provides metrics about actual employee experience with business-critical apps. We have used this feature to measure employee experience before and after changes to applications, in a few cases. Microsoft products are in the cloud and Microsoft releases a lot of changes. Teams is an example, as is SharePoint. They release a lot of patches and we were able to see them, before and after. We chose a nice graphic to show the before and after for the response time. I like this response-time graph. It's very useful and beneficial for any code changes.

It also helps to reduce hardware refresh costs by considering the actual employee experience, rather than just the age of employees' devices. In our teams, a lot of people are complaining about an issue with device memory. The recommended amount is 8 GB to 16 GB. People who have 8 GB are complaining. But looking at the PC, it's not just a RAM issue. It may be due to other challenges, issues with the back-end or network. It depends, in each case. But we can really see, if we run a report on those running 8-GB-memory PCs, whether there is good performance or not. Maybe one or two of those PCs are not doing well, but the remaining ones are good. I don't have details on how much it has saved us in refresh costs, but we have around 200 PCs and upgrading all 200 PCs' memory with 16 GB or 32 GB could cost a lot. It's not viable for any company to upgrade each and every PC's memory.

When employees complain of trouble with applications or devices, Aternity enables us to see exactly what they see as they engage with apps. In fact, we get advanced notice. So rather than the user complaining, we get to know in advance and will see what the hiccups are. We can correlate the user experience. It makes troubleshooting easy. At a high level, the application support teams who don't know much about coding can tell if it is an issue with the data center or the back-end network. It can tell them the root cause at a high level. And if there is any outage it will also tell them that. If the application is down, they'll know how long it's been down. It mainly plots out a graph and shows what time it started, what time it ended, how many users were impacted, and how many business locations were impacted.

We can look into a lot more details about Microsoft Teams, specifically the audio or the video, and we can look at network stats on it.

The most valuable feature is the alerting. As soon as we click on an incident, it takes us directly to the problematic PC. It's a direct solution. We click on an alert and it takes us to the incident details. The details show in different colors, in a graphical representation, and I like that the most. 

To give an example, we have a SharePoint portal and we configured about 15 banners. If any one of them is breaching the threshold of the number of users, any support person can easily click the incident and nail what the root cause is by looking at the graphical representation. It may be the network or another issue.

There are a lot more features for troubleshooting and monitoring and a few other tabs are available, nicely presented. 

The beauty of this product is that it does support desktop. I've seen a lot of products and they have synthetic monitoring, but they're not real-time. Aternity is real-time and it covers desktop applications. An APM may not help, but a real end-user solution like this is helping us with any issues on the desktop. The thin client is running on the local machine, so we need to know what's happening at the end-user machine. This is another one of the features I like. 

Another nice feature is that we can customize a lot of dashboards using Tableau.

Maybe they could extend coverage. Right now it is only for mobile, desktop, and web. If they could extend it to point-of-sale devices, that would be helpful. For example, your local floral shop has a scanner. I want to know what the performance of that device is like. It may be slow. Or when you go to pump gas and the screens are slow, these are the kinds of point-of-sale that we could start troubleshooting. That would be a nice feature.

Also, when it comes to what is called creating signatures, it's not easy for a non-coding person for desktop applications. You need to run the recording and you need to have some exposure and knowledge. That is an area where they can improve. For web applications, they have the Web Activity Creator and that's an awesome and easy tool. Anybody can use it and capture the signatures. With the desktop applications it's a little more cumbersome and difficult.

Aternity provides visibility into the employee device and into application transactions all the way through the back-end, but it does not support that at a high level. It's not really detailed, but for support people it is helpful so that they can tell if the problem is with the end-user PC, the network, or maybe the back-end. But when you talk about the Waterfall details, it's not providing any. If they could include that, it would be great.

I have been using Aternity for about one-and-a-half years.

It is stable. I haven't seen any issues, other than a few outages. They were able to fix them on-the-fly.

Scaling is very easy because it's a SaaS product. If you want to add more endpoints, it's easily achievable. In terms of increasing deployment it all depends how you're going to handle it: manual or automated. On a scale of one to 10, scaling is a seven to eight. It's easily scalable.

We currently have 200 users, meaning 200 stores. But we have about 3,000 stores. Even if there are only two or three pieces per store, that would be around 10,000 endpoints.

Maintenance is very minimal. One person is more than enough for maintaining 1,000 or even 10,000. The development is a one-time effort, and after that it is all maintenance. It's just administration: installing the endpoints, making sure endpoints are talking to each other, and configuring any new applications.

Their support is good. They respond on time.

The transition from Riverbed was smooth. Aternity was acquired by Riverbed and now it's a different entity. But we didn't see any difficulty or hiccups. The transition was easy and I haven't seen any difference in the support, other than that the support portals were all changed. Riverbed has its own URL.

We used AppDynamics, but it's purely for application performance from the data center, not the end-user. We did not have any tool and we had a lack of end-user visibility.

We tried synthetic monitoring. It's like there is a PC sitting and running a few scripts at several intervals. But if there is an issue and we want to get real-time stats, synthetic monitoring lacks that. For example, if the network seems to be good at 10 o'clock and the back-end and PC seems to be good, but at 11 o'clock the network is slow, you only know the 10 o'clock stats. At 11 o'clock you don't know what happened. Aternity has 

• real-time monitoring
• very good alerting 
• ServiceNow integration. 

Setting up the process is very straightforward. All you need to do to install is double click a link. The user does that. And from an admin perspective, it's very easy for web applications. You directly punch in a URL and it can monitor based on the thresholds.

The complexity is only with the desktop application configuration and we need to do that to capture business activities. It requires some expertise. It's not as easy for someone from the support team. You need some development knowledge.

Because this is SaaS, it's not on-prem, all you need to do is procure the license. For the endpoints you can do it manually or use automation. The time it takes to deploy depends on the number of endpoints. We use Radia to deploy to 200 endpoints and do any upgrades. It's a straightforward process. It also depends on the number of applications. For one application and between 100 and 500 endpoints, it might take four weeks or so.

Some customization may be needed and that has to be done by Aternity's SaaS team. For example, if you want to do location mapping or fast tenant configuration for Microsoft Teams, there is a process for talking to any external SaaS tenant. We had to do some customization on this, importing certificates.

We have not seen ROI on a large scale because we are planning to go with this on a large scale. We are just doing 200 endpoints. But it is definitely helping us.

Pricing depends on the number of endpoints. With only 200 endpoints, which is what we have, it may be a little expensive. But I think pricing is negotiable; that's what I heard from sales.

There are other products for this kind of functionality, but for our use case there is no such tool because we are directly looking at the user PC, rather than comparing how much detail someone else might give us. If you are having an issue, I am looking directly at your PC and seeing what happened during that time frame. I can see resource consumption on the PC for that process; Aternity's resource consumption data is very good. And it also has basic remediation, such as restarting the process, emptying the recycle bin. We haven't done much, but there are so many features available.

We tried Microsoft monitoring itself and AppDynamics synthetic monitoring and there was one more product that we did a PoC with as well. Other solutions we looked into were not real-time monitoring solutions and that's the primary reason that we selected Aternity.

I would definitely recommend this product if you're looking to get on-time, real-time alerts from the end-user point of view. Your application may be good with hosting in Azure or AWS, but when it comes to the end-user, it's important to know how your application is behaving. What is the performance like? What is the user interaction like with your application?

It is not only for monitoring. At an enterprise level, the 10,000-foot overview, we can see a lot more details. We can generate a lot more stats for the enterprise. We can see the software inventory and how long it has been in use. For example, if anybody is using Microsoft Visio or Word, the licensed products, we can decide to move them from inventory and save some money. We can also look at how the Macs are performing compared to Windows. We can run queries and it can generate a lot more data about the end-user.

We are dependent on Aternity. We get daily alerts and they help my administration team and my support team a lot. They get to know things in advance and that way they can isolate the problem and start working on it.

I would rate the solution at eight out of 10. The two points that I'm not giving it are because a little development knowledge is required for configuring desktop applications, and to create some dashboards you need some Tableau knowledge. It doesn't require much scripting; it's easy, drag-and-drop, but people should be aware that some development knowledge is required for creating advanced dashboards.

It has helped to identify several problems and performance bottlenecks in different applications through the code-level instrumentation and its features, and sometimes also through the detailed infrastructure metrics in one-second granularity, including memory, heap, and GC statistics.

This is a review of Aternity APM (formerly "AppInternals") on-premises version 10.21 only.

The infrastructure metrics, especially the CPU and memory data etc., are available in per second granularity, and this for quite a long time, which makes it outstanding as compared to other solutions. Its licensing cost is very low for us. For the use of the agent in infrastructure mode only (without code-level instrumentation), no licence is consumed. A license is only consumed when code-level instrumentation data is harvested, or downloaded from the agent to the Aternity APM server.

The code-level instrumentation has been quite helpfull in many cases, including the ability to record and analyse database SQL requests with bind values, and exceptions.

Its user interface and features should be improved. They don't support new versions of certain Linux editions. That is one of the reasons why we have to move to another solution.

In terms of a new feature, it would be good if we could restrict a user to a specific application or server. We have several customers, and we have to set up one or two servers for each customer. We have to set up one server for production and one for the test environment. Each user at the customer level can see all applications and the data of all applications, which is not really useful and good. We should be able to restrict user access at the application level or server level.

Their technical support should be improved in terms of response time. Its stability should also be better. We are currently using version 10, and its stability is not so high. The server crashes from time to time and needs to be restarted. Sometimes, you also have problems with applications.

Version 11 only allows for one AD/LDAP server to be connected to. Version 10 can connect to several LDAP servers, a feature we need; that's why we did not upgrade to version 11.

The on-premises version lacks some features compared to the SaaS cloud solution of Aternity APM.

I have been working with this solution for two and a half years.

Its stability is not so high currently. We are still using version 10. We have not switched to version 11. The server crashes from time to time and needs to be restarted. Sometimes, you also have problems with applications. Once they are instrumented, they have to be fine-tuned because of the problems. 

We are not satisfied with their technical support. If there is a problem, you have to wait for several days to get a response.

Its initial setup is relatively complex.

Its licensing cost is very low. That's one of the reasons why we have kept it for so long. We get more than a 70% discount on the maintenance licenses. Its cost is very low for us, but if you buy it new, it would be much more expensive at the retail price.

We are currently evaluating Dynatrace, which has a lot more possibilities. It has a better user interface and fewer errors or problems with instrumentation features.

I would rate Aternity APM a five out of ten. We are not very happy with it, and we are considering a new solution.

I work for a managed service provider, and we offer Aternity as one of the main solutions for any customer who needs applications and full end-to-end user experience monitoring.

The main use case is around application performance. Another main use case is related to Teams. Our customers like to know what's happening with Teams when they call in. Is it a performance issue at the backend or within their desktop environment? 

We have its SaaS-based service version. It is deployed on the cloud, but the agents are deployed on-premise. So, I needed to buy stuff.

It is useful for working out whether there are any issues in the network or between the endpoints. It is also useful for working out any performance issues. It has been useful for a lot of stuff around Teams. Our customers like to know what's happening with Teams when they call in.

It is helpful for easily profiling users. It records all the applications that are being used for each user, and you can see what users are doing.

It is very good in terms of performance. You don't have to wait forever to try and get reports or results. It is quite quick to get everything that you need out of the software.

For me, the biggest problem is the price. It is not so much about how much it costs. It is about Aternity only giving you 12 months upfront. So, you got to purchase it for 12 months. A lot of our customers are on a per-user-per-month type billing. They are all OPEX rather than CAPEX. It would be a lot better for our customers if there was an option available for OPEX so that it is billed on a monthly basis than a yearly basis.

They've got only Windows agents. They don't actually have mobile agents. It would be a lot better if they could also integrate Android and iOS because then we can start pulling steps and performance management out of users' mobile devices. That's the biggest addition I would suggest at the moment. A lot of our customers have desktops as well as tablets or mobile devices. We should be able to monitor that stuff as well.

I have been using Aternity for less than three months.

It is very stable.

It is very scalable. We've got several enterprise customers using it, and we provide it as a managed service with the SLAs and stuff wrapped around it. 

We plan to increase its usage. I don't think we would switch at this point. It already ticks most of the boxes. We've only been using it for three months, and we're signing a lot more customers down that path. It is hard for us to change the application or software internally because it requires a lot of internal training and other things. You can't just cross-pollinate. You will have to change every one of them.

We haven't contacted them so far.

It is pretty straightforward. Anyone should be able to do that. 

It is all SaaS-based. You order it, and they set up the backend on their service. You just download the agent and install it on the desktops. It doesn't take a long time at all.

You have to purchase it for 12 months, which is an issue because a lot of our customers are on a per-user-per-month type billing.

There are a few additional costs. A lot of customers only get the essential licenses, and then they get what they call the application add-ons on top. They have to pay depending on how many customers and applications they want to monitor.

We evaluated Dynatrace. The cost of Dynatrace was about two or three times more, and it wasn't giving what we needed it for. Dynatrace has got some aspects, but it was not what we were looking for. We were looking for end-user experience monitoring, not just application monitoring or application performance.

I would rate Aternity a seven out of ten.

We have three general buckets that we put things in:

1. For ad hoc troubleshooting of individual problems that people are having with their laptops in the field. 
2. Finding, identifying, and resolving wide-scale issues that exist in the field. 
3. Understanding the impact of changes that we're making in the field as well as reducing the negative impact of changes made in the field.

We need to understand how many machines are experiencing certain crashes, for example: 

• Blue screens
• Specific applications that are crashing.
• Specific versions of applications that are crashing.
• How various laptop models are performing differently, either having better or worse stability than other models. 

By tracking the high level number of blue screens in our environment and being able to categorize them according to the specific blue screen code that is returned, we were able to focus on prioritizing the issues that are most prevalent in our environment and taking actions to reduce the number of blue screens based on those priorities. This increases user satisfaction by reducing problems, like blue screens and application crashes. 

We were able to identify certain users who were opening a certain application, but it took a really long time. We were able to see through Aternity that this affected a decent number of users. By identifying those users, we were able to use other tools on specific devices to identify the root cause, which happened to be an IPv6 configuration, then eliminate that problem. Therefore, it increases the performance for approximately 10 percent of users' devices in the field.

Aternity has given us a view into what the user is doing. For example, the applications that we have defined as managed applications will show us what they are running. It will show us any of the activities that we've predefined to get measurements of. It will give us attribute information that the user doesn't necessarily know. For example, if they have their battery on high performance or battery saver, the user doesn't necessarily know that information at the time, but we can actually see it in Aternity. So, in a way, we can see even more than a user would be able to tell us. However, in order to do that, we need to make sure that we have defined the set of applications and activities that we want to ensure that we're tracking on a user's device.

Aternity's Digital Experience Management Quadrant (DEM-Q) has been a game changer for us. While knowing your own metrics is nice, if you don't know how you compare to others or what the numbers should be, then it doesn't tell you much. This solution puts that into context (if we are doing better than others or worse), which helps us prioritize where we want to focus and do improvements versus that's just how slow it's supposed to be. It's also great in communicating what we are doing and why we're doing it to our IT leadership teams, by saying, while we're pretty far behind others in certain categories, the time and changes for our prioritizations are justified.

The ability to filter the comparison by geography, industry, or company size is super important to our analysis. We need to be able to make sure that we're comparing ourselves with other companies that are similar. Also, we get to compare other devices that are similar. Some companies, who are using Aternity, use it more on server operating systems or on desktops. We are a very mobile company, using Aternity on our laptops. It makes more sense to compare us with companies who are also similar because that can make a big difference when you're thinking about how a laptop should be performing versus a server, and also Windows 7 versus Windows 10. You need to put that in context, or you're not going to have a realistic view of where you stand.

For the applications installed on the laptop, it's very customizable. So, we can get certain features out-of-the-box and add to them. Even with custom applications, we can create our own monitors and application signatures to track user activities which are specific to our company. We are measuring:

• How long certain actions take for a user to typically complete. 
• Before and after any particular change and do the comparison. 
• In smaller chunks, we can compare a change group to a control group and be more confident about the impact of the change based on the user experience for the change group versus the users who didn't get the change.

Before we make a change that would impact the entire company, we do it on a pilot group and measure it then. So, we avoid rolling something out that fixes one thing and breaks something else, which can happen. Therefore, we have more confidence in our changes.

It gives us visibility into what the user is doing, i.e., the user activities on their endpoint, and the response time for any of those activities. It gives us a breakdown of client activity. e.g., what an end user's computer takes time to complete versus what's happening on the network, and if there are any network delays. 

I would like to get more granular detail. In regards to defining the applications and activities upfront, that can be challenging. Simplifying that would be a big win. One of the things that I know they are already working on is a verbose mode. 

Aternity does a great job of not impacting the device. It only sends up small bits of information at the time so it doesn't have a negative impact on the device itself. That also means that sometimes you want to get more data, but it's not giving it to you. However, being able to turn on a verbose mode so it could give us even more granular detail, at certain times, would be helpful. 

I think helping get to root cause would be really huge. One thing that Aternity is working on is its Insights and being able to inform us whether this type of model in this location, for example, performs worse. Getting those Insights automatically to the surface, which they are working on now, is a big improvement.

One misconception that some people at our company have when they first hear about Aternity, or start using Aternity, they expect it to find a root cause. If an application crashes, they want to jump right into why that application crashed. Aternity doesn't come right out and tell you. It gives you the diagnostic that gives you the information about what happened. You still have to sometimes have to put together those pieces, going farther to get to the why. I don't know that there is a tool out there that does give you the root cause of any of these issues. 

I have been using Aternity for almost two years.

There are client entities installed on every device that are not very impactful to the endpoint, which is very important. The discovery side is stable. We only had one somewhat big outage in the last couple of years, so I would say it is very stable.

Officially, on our team, there are three of us who maintain it. I'm managing the team. We have our Aternity engineer who is responsible for ensuring upgrades are going smoothly during the customization, the activities, and any script changes that we can do on our side. We have someone else as an analyst who is looking at the data and surfacing issues in the field. We also have a lot of other people who are using the tool internally, but they're not on our core team supporting it.

There are roughly 20,000 end users of the solution. It scales well.

There is definitely room to grow in terms of the customizations that we can make to managed applications and the activities of our own managed applications. Now that we have more PowerShell and remediation capabilities, we are starting to grow those as well.

There is someone who supports the SaaS environment. Anything not on-prem and in the back-end that needs changing that we don't have access to, we can easily ask that of the SaaS administrators. Their responses are very good. 

The support is good. We have had to open up a few different cases here and there, but they are very responsive. 

We switched because we needed more near real-time data. The customized, homegrown solution that we were using was not able to pick up information in a very timely fashion. It was only once per week, then we would be a week behind with our reporting. Also, it didn't give us insight into the application activities that Aternity does.

The initial setup was straightforward. Aternity sets up the instance on the back-end on their side, then they give us access. We had to set up on our side: The integration with our single sign-on (SSO) provider, then downloading the endpoint agent and sending that out to the machines. 

To set it up, it took maybe a few people hours. For deploying it, that took a couple of weeks based on our standards. However, just getting it up and running, then installing it on a couple of machines was done within a day.

For the deployment, we had our Aternity engineer. We needed someone from our identity team to set up the SSO side of things. We have our software packagers who put the software through our software deployment tool and send it out to the appropriate machines. There is also probably someone else who is reporting back on that. Overall, it's about four to five people.

I would take advantage of the Aternity Professional Services. We had someone from Aternity operating basically in-house with us for nearly a year. We found him to be very knowledgeable. He helped us get the most out of the tool over that first year before we were really ready to take it over alone.

Over the last couple of years, we have shown that we have improved user experience with surveys. We surveyed the environment and are seeing that Aternity improved things over the last couple of years. We are now also able to better prioritize our projects and the things that IT is working on.

It is definitely a premium solution; it is not an inexpensive product. We have to ensure that we are getting the most out of it in order to justify the cost. However, it is not cheap, especially when you want to install it on all your endpoints.

We looked at a lot of different solutions. We did a proof of concept with Aternity and Nexthink. 

Aternity had a SaaS model, where the solution was on-prem, which was easier to set up on our side. Also, Aternity gave us the insight into application activities and the end user's actual experience that the other tool couldn't give us. Those were the main reasons we went with Aternity. 

Aternity does give us (and other applications don't) application visibility into the activities that the user is actually performing on any particular application.

Eventually, it will reduce hardware refresh costs by considering the actual employee experience rather than just the age of the employees’ devices. Right now, we're still on the basis of how long the machine has been in the environment. Really, it's tied to our own warranty information. When a machine's warranty is expired, then that's about the time that we get a new machine. For a particular model of device, we decided to accelerate that based on the data in Aternity, because we could see that the worst performing machines were with one particular model, which was getting older, but wasn't quite at the state that we would normally replace it. However, because they were performing so poorly, we did accelerate the removal of those devices from our environment, replacing them with a newer model that performs better.

The SaaS model has worked really well, because we don't have to manage the infrastructure. Because of COVID-19, everybody started working from home. That gave us a lot of insights around that time as to different performance and stability changes when someone is in the office versus at home.

Aternity gives us more device information now than it used to. Also, we can customize the solution now in a few different ways: PowerShell scripts being the newest method. While there may be other tools that get deeper into the device, Aternity gives us an advantage from the user experience side of things. 

I would rate this solution as an eight out of 10.

We have many use cases for Aternity, but the key ones are that we use it to validate and deploy. One of our big initiatives was converting all of our users within the bank to Office 365. Aternity was heavily used for validation and performance monitoring of the Office 365 project.

We're now able to get a real measurement of user productivity. We're able to use this tool to reduce the mean time to resolution, whenever there is a problem with our end-users. It helps us speed up the time needed to address their issues. When there are any issues with their devices, we're able to use Aternity to very quickly figure out what the issues are, whether it's an issue with a workstation or an issue with a particular application.

Using this tool, we now have visibility, so detection, and the remediation that comes after it, are much faster now. That's instead of being blind, per se, without this tool.

The tool has a very good feature called Validate Application Change, which allows us to validate any changes to an application or infrastructure changes, or even a simple configuration change. It allows us to quickly measure the baseline and gives us a very nice before-and-after view. For example, suppose that prior to the change, the user-experience was two seconds. After the change, using the Validate feature, we can see that it got better and the user response-time is one second instead of two.

This feature helps us make decisions about the effects of changes in two ways. One is that we use it to validate whether a change should go ahead. For example, for our Office 365 migration, we used it to test and validate whether, if we were to convert users into the Microsoft 365 suite of tools, the application performance would be good or not. It helped us make a decision on whether to actually push it out and put it in production for everybody. That was heavily used during performance testing phase.

The second is that it gives us a way to validate whether a change was successful and meets our bank's current SLAs.

Using the solution we know what the full transaction experience or performance is like, how much time it's taking, and where any bottleneck is. If there is an issue with the backend, or there's an issue with the network, or the issue is with the client side or workstation, if the root cause resides in the client or workstation, it has the troubleshooting capability to specifically figure out what the root cause is.

The main feature, what we really like about Aternity, is that it can monitor the actual user experience, meaning their actual response times, volume, and when they did what.

Another key feature is with regard to the current situation with COVID. A lot of people are now working from home and Aternity has been a very good tool to monitor and measure the performance of the VPN.

Other features we use heavily are the WiFi analyzer, the Skype for Business analyzer, and the troubleshooting functionalities. We also use the Device Health quite religiously here for troubleshooting devices that are unhealthy, when we're talking about things like high CPU or memory consumption, or file system problems within the users' workstations.

When it comes to a lot of the features that I would want, they will tell you they are in their SaaS version, which we don't use. We are planning to move to the SaaS solution to get those features. 

But the issue is how Aternity, as a company, works their roadmap. They put all the new features on the SaaS solution and that's where you get the latest and greatest stuff. But some of those features are not available for the on-premise users, which is what we are. Why not have those features available for on-prem users?

We've been using Aternity for about six years. Our first engagement was about six years ago but in the last two years we have had more dedicated focus in using it on a larger scale, using one of their latest versions.

It's very stable. We haven't had any downtime because of the tool.

Scaling it is very easy and intuitive. It's just a matter of acquiring a server. It's very well documented on their portal; how to scale and what all the numbers will be.

Their technical support is very good. They're extremely knowledgeable about their product and the support has been great. Their responses are very timely and they'll fix the issues.

From my end, the initial setup was very easy because we engaged their Professional Services to help us.

Our deployment took three days.

At a high level overview, our deployment strategy included acquiring the necessary servers based on Aternity's documentation. Aternity provided sizing consulting to review and make sure that we got the right hardware and sizing and capacity. Once that was acquired, it was just a matter of installing it in a test environment and then moving on to the production environment.

Our experience with their Professional Services was very good.

We have definitely seen ROI in terms of cost savings. Implementation times and remediation times are all cost savings, when it comes to operational readiness and day-to-day operations.

The pricing is fair. Their salespeople are very good and they will work with you in terms of getting the best price for you.

We looked at several other solutions. We picked Aternity because of ease of use, ease of setup, ease of configuration. Also a lot of this stuff is automated in the sense that once you install the agent, it's smart enough to measure and collect and monitor all sorts of stuff with the user's devices. With other products there is a lot manual set up and a lot of manual overhead to configure them, to get them to work right. 

Not only was it the ease of use, but it collects and monitors a lot more metrics. It also provides a very flexible interface to do custom reports and monitor and customize internal applications, relatively easily.

Have valid use cases defined, know what you want, and make sure that you talk with the Professional Services team and the product team. Get the demos, ask all your questions, and make sure that their solution will actually meet your needs and your use cases. The Aternity guys do a very good job and they're very upfront and honest with their feedback, regarding what their tool can or cannot do.

Within our company, we have approximately 2,700 users and around 3,000 devices. We primarily use Aternity on our mobile laptop fleet, which includes about 1,200 devices. We use it to get insights into usability and user-experience on those devices.

We use it to monitor applications, application performance, for alerting of system errors, troubleshooting, tracking changes and how they've affected the performance. We use it for all the functions of the platform to give us that visibility.

We're using the SaaS version.

Without a tool like this, that can give you insights into how things are behaving, you can't really see that from an IT administrator's perspective. Oftentimes, an IT user will call and say, "I'm having this problem," or, "I had this problem yesterday." Without having the device there in front of you, it's sometimes very difficult to get the details. This platform has given us a lot of those details. It's always on and listening as long as the device is in use. We can jump back in time and say, "What happened around this time? Oh, we can see this application crashed." It helps a lot with the troubleshooting of problems, and trending and determining how widespread a particular problem is. It helps us prioritize problems appropriately. If we see that one person is having a problem, it's obviously isolated, it's not a wider spread application problem. It gives us that visibility.

As we have problems being reported through our service desk, this gives us a way to go back and determine how many users could be affected. We can shift from reactive to more proactive and watch for certain things like blue screens or application crashes. It's helped us better prioritize our problems as a result of having that visibility.

It's making us aware of where we should be spending our time. There are certainly time-savings in the sense that we're not spending time on things that aren't unnecessary.

Also, the ability to compare benchmarks has affected our decisions about IT investments. It's something that we have used and will use as we adopt new technologies, to understand the performance hits of the application. While we haven't realized the full return in that regard, it's something that we will.

In addition, it has reduced the mean time to mediation. I can't give you a metric because it's not something we're actively tracking right now.

We've looked at the Digital Experience Management Quadrant (DEM-Q) to see how our digital experience compares to others who use the solution. We have used that to see how we are trending and it gives us some insight into areas that we might need to focus more on. That's helpful. It's a new feature. 

It gives you the ability to filter the comparison by geography, industry, or company size. Obviously, I'm not going to compare myself to another area that may not be relevant and that doesn't run similar applications to those we do as a financial sector company. I wouldn't say it's not valuable, but I wouldn't say it's super-valuable to us as a company. Others might feel differently.

The reporting is okay, but the alerting and reporting could use some more polish. We can't alert on certain things that we'd like to. For example, if an application is using a certain percentage of processor resources for a specific period of time, then alert. It's not as extensible or flexible, on the alerting side of things, as we would like. 

You have to build out dashboards for everything and the Tableau back-end, while it's okay, is unique. They could probably improve that a little bit.

If it did some additional correlation of problems, that would be helpful. For instance, capturing certain events and event IDs: If I have an application crash, it might report that the application crashed but that's about as far as it goes. It doesn't always give you event IDs or faulting module names. It doesn't go as deep as I would like it to go in correlating problems. It's not necessarily pointing you in the direction of what's causing the problem, for example, if it's a driver or, "Hey, I noticed this particular firmware was updated and followed by an increase in crashes. That could be your problem." It's left for you to be "Sherlock," but it's giving you the clues.

I have been using Aternity for about a year.

The stability has been fine. The platform is always available. Occasionally, we get weirdness with certain dashboards not loading, and we have to refresh the screen, but nothing too major there. 

We haven't had any major issues with it not being available or being usable.

There are no concerns with scalability, given that it's a SaaS platform. (I know they do offer an on-prem). 

To my knowledge, we're well below any threshold or level that we need to be concerned with. For our environment size, it's just fine.

It is only on a fraction of our devices. It's all of our laptop fleet, which is somewhere on 1,200 or 1,300 devices, currently. Beyond that, we could be deploying this within our virtual desktop environment. We could be deploying it to our physical desktops, to get that same visibility. This is just where we started, where we had the biggest need.

Our timeframe for scaling it to other devices is unknown, at this point. There isn't an urgent need, like there was for laptops, because of the nature of the device being very mobile and off-network. It could be 12-plus months before we expand our usage.

Our experience with their tech support has been good. There have not been any concerns or problems that we haven't been able to get solved through their support.

We haven't had to open a ton of tickets. We're self-sufficient in many ways. A lot of times, what we did for the concerns or the questions we had was to engage with our Professional Services administrator or a contact at Aternity who was dedicated to us, through that time period. Since then, we haven't really had any problems or anything we've had to open up tickets for.

Dealing with the salespeople, my impression is that they were very professional. They weren't overly pushy and we appreciated that. They were very flexible and ultimately wanted the solution to work for us before they were trying to just push it on us. We work with plenty of other vendors that are in there for the quick sale and then back out. I haven't experienced that with Aternity. Our sales rep was fantastic and had a good mindset. Dealing with them has been an enjoyable experience.

We didn't have any solution. It didn't displace anything. It was brand-new.

We went with it because, in our environment, we became a lot more mobile. We replaced desktops with laptops, and for a device that's not always on our network, or a device that's not even within our reach physically, it became clear that we needed something that would help us monitor for certain problems. We also needed something to help us understand the consistency of our environment and the usability, as well as the experience of the end-users from their perspective. Especially with COVID this year and having a very remote workforce because of COVID, that additional visibility was necessary.

The initial setup, as far as deploying the agents and collecting the data goes, is very straightforward. It's pretty simple. You basically download an agent and, using your other modern management tools to deploy a software package out to your fleet, it's going to start checking in. It's just what you do with the data after you've got the agents deployed and collected, that requires a little bit more heavy lifting.

Altogether, our deployment took about three months. Part of that was due to COVID, which caused us to take a break. We did a long PoC of it, and I include that in our year-long time of use. But as actual paying customers, it's only been since the end of last year or beginning of this year. Of that three months it was probably really about a month-and-a-half of actual deployment.

I had two sysadmins involved in the setup and they're taking care of the maintenance of the solution.

We used Aternity's services and engaged with them to go through the setup and configuration of the environment.

We have absolutely seen ROI. We did not have any visibility. We were completely disconnected from what was really going on in our fleet. This has really given us that visibility. We can understand problems and impact in scoping them in our environment, and we can understand how the configuration changes we're making are affecting that performance. It's really given us a very high level of visibility that we've just not ever had.

We haven't really yet realized a cost savings from the solution, but where it has probably helped us improve is in reducing the mean time to resolution, by giving us that visibility. It is also helping us to focus on the things that matter the most, that are moving the needle, and not the things that are just an island and not widespread.

Regarding cost, compared to other solutions, Aternity is pretty low. It's definitely lower-cost than others that we looked at, like Nexthink. Nexthink was a very expensive solution. The cost is reasonable. It's what I would expect a solution like this to be. It's definitely not on the higher end, that's for sure.

If you do the hosted solution, there is a hosted SaaS-type fee, per license, but it is pretty minimal.

We looked at a bunch of other products and we didn't see any other product that gave us any greater detail. The challenge with Aternity is that you have to build a dashboard for everything you do. The back-end they use is a Tableau back-end and for someone who has never worked in that type of an environment, like some of my team members, my sysadmins, it can be a little bit of a learning curve.

We've looked at AppDynamics and Nexthink. ControlApp is another platform we use internally that we looked at using here. However, these devices are Azure-AD joined and it couldn't work there.

As far as AppDynamics goes, it's really focused on a company that does a lot of internal development, developing its own applications and platforms. You have to wrap your code with their APIs so that it can collect that data for those types of activities, like load times and activity times: "I clicked on this button, how long did it take to actually get a response?" That was the negative for us. My team doesn't develop and, as a company, we don't do a lot of development work that my team supports. So that eliminated it. 

It was really about the end-user experience angle and getting visibility into how our environment is performing. How are the changes we're making affecting the end-user? We needed more of an end-user perspective than AppDynamics gives you. 

Nexthink is a similar product, but a lot of what they do is web-based activities. It's not necessarily as in-depth as Aternity. It can give you an experience score, but it's more of a web-based, HTTP call format, that it gives you the data on. It didn't have the depth that we needed to give us the visibility to really help us understand our environment and the impact of the changes we're making. That's part of the reason why we eliminated it as a contender.

Be prepared that you're going to have to build it out to fit your environment and make sure that the expertise is there to understand how to do that. My advice would be to engage their Professional Services. They were really good. The gentleman who helped us was top-notch, and if he didn't have the answers he received the answers for us. That would be my recommendation to help realize the return on investment and get the visibility and the data in the format that you want to see it. That's pretty essential.

The biggest lesson we've learned from using Aternity is that a tool like this is absolutely necessary for you to understand your environment. If you ever want to be a proactive company that is trying to get ahead of problems, then you have to have something like this. It gives you that visibility. Without it, you're going to be in the dark and left to people reporting problems through your service desk. That's the biggest learning experience from having this platform.

Aternity doesn't currently provide metrics about actual employee experience of all business-critical apps. It's something you have to build out. It's not "canned" that way and there is a lot of configuration that you have to do to the environment to collect the data you want to collect and that is important to you.

We plan on growing that side of it. We've only had it for about a year, and since a lot of those things are very unique and specific to an environment, it's not an easy thing where you just click a couple buttons and say, "Now, start looking at this." You have to build it out, and that's one of the pluses and minuses about the platform. There is a basic set of applications that it's monitoring. It's looking at specific activities, such as time to open an application or a certain activity to create a new message or an email within an application. That basic, canned stuff is there, but it requires you to build those out and it's something that's unique to their product, the way that they work it. It's a positive and negative.

Aternity doesn't enable us to see exactly what employees see as they engage with apps. There's a little bit of heavy lifting to build out those activities. It's not like, out-of-the-box, it's going to show you everything. It collects a lot of data but presenting the data is up to the administrator and how you use the data. It's not going to necessarily point you to problems, but may help you correlate problems. It does gather the data, but it's not always in a format that's going to make sense to you. The key there is that it's extensible and it's flexible enough to give you the data that's important to you. But it requires the administrator to have a fairly in-depth level of knowledge, using their tools, to build these activities.

In terms of visibility into the employee device and into application transactions, all the way through to the back-end, it's really more end-user facing. It's from the perspective of the end-user. Think about it in terms of on a laptop or desktop and the things that users might do within there. You have to build that out.

Overall, I would rate Aternity an eight out of 10. It's looking at things from the end-user's perspective, not from a specific application's perspective, although you can do that too. But you try to understand how the applications and things being used are affecting the user's experience. It's all about the end-user experience, where other platforms are not necessarily there. They might just be helping you troubleshoot problems as they come up. It's not higher than an eight because there's still room for improvement. There could be some additional things built for you, out-of-the-box. Certainly building those dashboards is not the most intuitive thing. There's a little bit of a learning curve there.

We have a big number of devices and we use it to get a pulse check of how our desktops or workstations are behaving across the enterprise. We don't have it on every device. We have it scattered across all locations where we have a presence. We get metrics such as CPU information, memory utilization and, most importantly, the application performance that comes out-of-the-box with Aternity.

Let's say we release new hardware. We have a testing team and they want to see how applications will behave on that new hardware. They install Aternity and they look at the metrics — the CPU, memory utilization, and application response times. That's how a lot of our businesses use it. There's another area where we just focus on how our application is behaving. So the two core uses are hardware performance, based on a new release of hardware, and application performance, regardless of the hardware.

We used to have the on-prem Aternity solution, but now we are using their SaaS solution.

One of the features that Aternity has is the boot time. It measures how long a workstation takes from when you first power it on until the device is usable. We were able to provide our engineers and our developers that information. We've seen situations where these services are taking a longer time. These applications take up some of the CPU. We've shown them the data and they have come and said, "Okay, we can probably improve in this area."

The business or department that is responsible for that software or device can look at the actual metrics that we are able to provide and say, "Okay, this is actual data, not just anecdotal data from users who say, "My email is slow." They can act on it. That's the beauty of it, the metrics.

DEM-Q (Digital Experience Management Quadrant) is very useful. This is where they stand out with their dashboard, because it gives us a picture of how our company is doing compared to the other businesses out there. We're one of the big five or six banks in Canada. We are able to see how we are doing compared to the other financial industry companies out there. We don't want to compare ourselves to, let's say, technology companies or retail companies. We can compare ourselves with the financial industry. At the same time, we can also compare ourselves with the rest of the globe, but in our case, having that ability to compare ourselves with other financial industry companies is important.

The application monitoring is the most important feature. For example, how long does it take to open Outlook, or how long does it take to send an email or preview mail? How long does it take to open Word? When it comes to launch time, how quick is the application?  We use that for a lot of our Microsoft applications. The ability to measure response time is the best feature.

There are also built-in activities that let you measure things like preview mail, open address book, and send mail. Those are the activities that we are able to get measurements on, and those are things we have not seen in other software monitoring tools.

Aternity enables us to see exactly what employees see as they engage with apps. That means we use Aternity in a reactive mode. When we get a call to our help desk saying a machine is slow or acting up or not behaving as expected, we monitor the device for a couple of days, and then we make our diagnosis based on the reports. We use Aternity to troubleshoot user complaints.

We are waiting for the GA release of their agent. I hope they can do better when they release their endpoint agents. Right now, we are not able to measure some applications, core applications, because it's relying on a specific version of the agent and that agent has not come out yet and there's no ETA. I would like to see them speed up time to market when they release agents.

We've gone through many iterations of their software. We have been using it for at least five years.

We haven't had any outages of the SaaS environment, but what we're struggling with now is the stability of the agent. We've been using a GA version. They came out with a beta version and another beta version only to scale back and remove the beta version. Now we're back to the GA version. The back-end of the SaaS is solid. It's the connector, the agent piece, where we are struggling. I have been opening tickets with Aternity because we are not getting, rather we're losing data. Our endpoints are not reporting data the way they did before when we had a more stable version.

Because it's a SaaS version, it can easily adapt and scale. If we have 2,000 agents, we can easily scale to 10,000 and to 50,000 without having to consider the back-end. Scaling is very easy. I trust that their back-end will support when we scale up.

We are licensed for 2,000 end-points and we are currently using 1,000. We are waiting for the GA version of the agent before we can utilize the other 1,000. I don't want to use the remaining 1,000 on an unstable agent.

Aternity's technical support is excellent. When you open a case, you get a response right away. I find their technical support very responsive.

We did not have a previous solution.

The initial setup was very straightforward. We signed on with our Microsoft Azure environment and had access to the SaaS version. We got the metadata. We integrated this metadata with our Azure, set it up on our Azure side, and off we went. It's very simple.

Deployment took about two weeks, including deployment of agents. It's not just a one-day task to deploy the agents. There were multiple deployments. That included setting up the single sign-ons and the dashboard.

To manage the environment we have two people involved right now, managing the console. But when it comes to the tool for getting reports and metrics, there are about 15 to 20 people doing so in different lines of business. 

We did it ourselves, in-house.

We have seen return on our investment with Aternity. We've seen how our applications behave, especially the core applications, so we are getting a very good return on our investment.

We looked at a competitor, Lakeside SysTrack, but I found that Aternity gave more bang for our buck and it was going to give us the information that we need.

Evaluate it, look at the pros and cons, define what you're looking for and, if it fits your needs, go for it. It's a very helpful tool to have in the bag. I would highly recommend it.

The biggest lesson I have learned from using Aternity is how our core applications behave. Before, we did not have any sort of metrics. Now, we have visibility into how our applications behave so we can actually tell the owners of the applications how to improve their applications.

Aternity has its own calculation for measuring user experience. Out-of-the-box, it does measure the user experience for Microsoft Office suite and the browsers that are out there:  Microsoft Edge, IE, and Chrome. It gives you a number, and it's just a good number to see, but it doesn't really tell you the whole picture. If it gives us a rating of nine, what does that really mean?

User experience is very hard to quantify because it's an aggregate score of different measurements, but it does give you an indicator of how your applications are performing. But for me, the true metric is the response time, the actual numbers that show when the user opens Outlook that it takes three seconds. For me, that's a better definition, than a rating of one to 10, for user experience. I'm not discounting Aternity's user experience metric because that is the way their competitors do it as well.

In terms of the solution providing visibility into the employee device and into application transactions all the way through the back-end, it's "yes" and "no." The solution does provide workstation performance matrix — CPU, memory, I/O read, I/O write, and network information. For all the way to the back-end, they have another solution, an APM that we are not currently utilizing. If we integrate our Aternity with APM, that's when we'll see from endpoint all the way to the back-end. But because we don't have the integration with the APM, we only see the front-end. We don't see all the way to the server side.

Aternity hasn't helped us to reduce hardware refresh costs by considering actual employee experience rather than just the age of the employees' devices because we've always had some sort of logic for when we refresh our device. It's a three-year cycle for our desktops and a four-year cycle for our laptops. Aternity has not changed that model.

The fact that other solutions may provide deeper visibility into device performance comes down to a few factors. Price — how much that other solution costs; ease of use — how easy it is to deploy to our fleet; and the quality of data. I'm sure that there are other tools out there that can do what Aternity's doing, but in our case, we are happy. We are satisfied with the data we're getting from Aternity, with its ease of use and how agents are deployed.