No more typing reviews! Try our Samantha, our new voice AI agent.

AWS Data Pipeline [EOL] vs AWS Glue comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

AWS Data Pipeline [EOL]
Average Rating
8.0
Number of Reviews
2
Ranking in other categories
No ranking in other categories
AWS Glue
Average Rating
7.8
Reviews Sentiment
6.9
Number of Reviews
50
Ranking in other categories
Cloud Data Integration (1st)
 

Featured Reviews

BR
Senior Director Data Architecture at Managed Markets Insight & Technology, LLC
A tool with great orchestration and development capabilities but needs to improve its user-defined functions
In the tool, parallel processing is an area that is contingent, in the sense that you have to be watchful for the cap that you have in terms of computing behind AWS Data Pipeline. You need to always watch for some reason. I am capped with 200 nodes, and if I get to use more than 200 nodes, the AWS Data Pipeline will fail. AWS doesn't state that I have almost gone beyond my limits, and it is allowing me now to go beyond the set limits if I talk to a representative and figure it out. Such aforementioned warnings are not let out by AWS, and they end up failing the nodes if I go beyond the set cap limits.
NS
Principal Consultant at a retailer with 1,001-5,000 employees
The solution improves ETL performance but faces challenges with version upgrades
For ETL, I feel the performance is excellent. If I create jobs in a standard way, the performance is great, and maintenance is also seamless. It is serverless, so I do not need to worry about other integrations. It runs on a serverless VM. Glue services from AWS are regularly upgraded with new properties and functions. We use PySpark and other frameworks, which help customize our ETL process in a standard way. During our process, we utilized the typical SQL ITIL process standard in Glue-oriented ETL services, which helped us improve performance and time. AWS running time, mostly during the morning, saved us time compared to the old ETL method. There are many email notifications once a job is successful or fails, and we get notifications using SES or AWS's Simple Notification Service. Glue is integrated with both email alerts, and we are responsible for managing the full data journey from end to end.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature of the solution is that orchestration and development capabilities are easier with the tool."
"It is a stable solution...It is a scalable solution."
"If I'm working with big data, common languages like Python work quite nicely, which is advantageous."
"The solution is highly user-friendly, and its features are easy to use. The new addition of AWS Glue Data Catalog is also very beneficial, making the tool even more helpful for its users."
"You do not need many frameworks to run Glue."
"It's very good to manage."
"The solution helps organizations gain flexibility in defining the structure of the data."
"I also like that you can add custom libraries like JAR files and use them. So, the ability to use a fast processing engine and embed basic jobs easily are significant advantages."
"The most valuable feature of AWS Glue is its ease of use and good documentation. Additionally, we can do all the transformations that we need."
"The most valuable feature for me is the visual interface of AWS Glue."
 

Cons

"It's almost semi-automatic because you must review and approve code push, which works well. Still, we had many problems getting there during the deployment process, but we got there."
"The user-defined functions have shortcomings in AWS Data Pipeline."
"The solution’s stability could be improved."
"AWS Glue would be improved by making it easier to switch from single to multi-cloud."
"The crucial problem with AWS Glue is that it only works with AWS."
"It would be better if it were more user-friendly. The interesting thing we found is that it was a little strange at the beginning. The way Glue works is not very straightforward. After trying different things, for example, we used just the console to create jobs. Then we realized that things were not working as expected. After researching and learning more, we realized that even though the console creates the script for the ETL processes, you need to modify or write your own script in Spark to do everything you want it to do. For example, we are pulling data from our source database and our application database, which is in Aurora. From there, we are doing the ETL to transform the data and write the results into Redshift. But what was surprising is that it's almost like whatever you want to do, you can do it with Glue because you have the option to put together your own script. Even though there are many functionalities and many connections, you have the opportunity to write your own queries to do whatever transformations you need to do. It's a little deceiving that some options are supposed to work in a certain way when you set them up in the console, but then they are not exactly working the right way or not as expected. It would be better if they provided more examples and more documentation on options."
"It would be better if it were more user-friendly."
"I would like to see stable libraries at the moment they are not there."
"The price of the solution could improve."
"In the building and deployment aspects, there is room for improvement. The current process is a bit complicated and could benefit from being more user-friendly and simpler, which would help speed up the deployment process."
 

Pricing and Cost Advice

"The way we use it, I think it is fair as we're getting a good value for money compared to having a server or some other data pipeline."
"I rate the pricing between six to eight on a scale from one to ten, where one is low price, and ten is high price."
"AWS Glue follows a pay-as-you-go model, wherein the cost of the data you use will be counted as a monthly bill."
"It is not expensive. AWS Glue works on the serverless architecture. We get charged for the time the server is up. For our use case, we have to use it once in a day, and it is not expensive for us."
"This solution is affordable and there is an option to pay for the solution based on your usage."
"I would rate the solution a six or seven on a scale of one to ten, with ten being very expensive. Specifically, I rate its pricing a six out of ten."
"If you are using the solution for an enterprise business, it will be expensive."
"I rate the product's pricing a five on a scale of one to ten, where one is a high price, and ten is a low price."
"AWS Glue is quite costly, especially for small organizations."
"The pricing is a bit higher than other solutions like Athena and EC2. If the pricing becomes more scaled or flexible, it will be good because you have to pay 44 cents just for one DPU for an hour. If you increase DPUs to 5 or 10, the pricing gets multiplied. There are also some time limits like 0 to 10 minutes or 10 to 20 minutes. If the pricing is according to the minutes, it would be better because you have to limit your job to 10 minutes or 20 minutes."
report
Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.
908,834 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
No data available
Financial Services Firm
20%
Manufacturing Company
8%
Computer Software Company
6%
Comms Service Provider
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
By reviewers
Company SizeCount
Small Business11
Midsize Enterprise6
Large Enterprise34
 

Questions from the Community

Ask a question
Earn 20 points
How do you select the right cloud ETL tool?
AWS Glue and Azure Data factory for ELT best performance cloud services.
How does Talend Open Studio compare with AWS Glue?
We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...
What are the most common use cases for AWS Glue?
AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...
 

Overview

 

Sample Customers

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday
bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday
Find out what your peers are saying about Amazon Web Services (AWS), Informatica, Palantir and others in Cloud Data Integration. Updated: July 2026.
908,834 professionals have used our research since 2012.