AWS Glue vs Confluent comparison

Read 23 Confluent reviews

4,827 Views
3,652 Comparison Views

95% willing to recommend

AWS Glue

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Jan 12, 2025

Confluent and AWS Glue are competing products in data integration and streaming. Confluent stands out for scalability and real-time data processing, while AWS Glue excels in cost-effective ETL services.

Features: Confluent uses an Apache Kafka-based architecture for real-time data streaming with features like Kafka Connectors, Schema Registry, and ksqlDB. AWS Glue offers a managed ETL service within the AWS ecosystem, featuring a data catalog, job authoring, and job scheduling.

Room for Improvement: Confluent could improve by lowering its setup costs, simplifying its configuration for less technical users, and enhancing integration with non-Kafka ecosystems. AWS Glue could offer better flexibility outside AWS, improve documentation for complex tasks, and enhance support for real-time streaming.

Ease of Deployment and Customer Service: Confluent offers flexible deployment across cloud, on-premises, and hybrid environments with strong enterprise-level support. AWS Glue integrates seamlessly with AWS infrastructure, providing automatic task scaling and managed deployment, but could be more flexible for non-AWS users.

Pricing and ROI: Confluent involves higher initial costs but offers strong ROI through scalability and advanced features. AWS Glue's pay-as-you-go pricing model allows cost savings when used across AWS services, offering a lower entry cost for standard ETL tasks.

To learn more, read our detailed AWS Glue vs. Confluent Report (Updated: March 2025).

AWS Glue vs. Confluent

Download the complete report

Helped 845,406 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

AWS Glue

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

Cloud Data Integration (1st)

Confluent

Average Rating

8.2

Reviews Sentiment

6.7

Number of Reviews

Ranking in other categories

Streaming Analytics (4th)

Featured Reviews

Muthuvel Sivaraman

AVP at a manufacturing company with 10,001+ employees

Handles a huge volume of data and is serverless, but it can be considered costly by some users

We use Amazon's services to provide technical support for the product. If you want to have support, Oracle and others offer a single support, and other tools have a direct support window. For Amazon, we need to pay 10 percent of my billing amount for the tool to get support services. Whether to raise a support ticket or not is an issue since ten percent is a huge amount. My company ends up using all the options without help from support. It is very difficult for any common man to understand why there is a need to pay ten percent for support. If I find an issue in the product, and I need to get support from AWS to fix it, then I need to pay ten percent of the tool's bill amount to Amazon. AWS is a very tricky tool because everything is evolving nowadays. AWS engineers are getting hired from other places, and even after that, if I am not getting any technical support, then things will be very nasty. There are some good engineers who help users outside the normal support cycle, but it doesn't meet their needs. I rate the technical support a four out of ten.

Read full review

Yantao Zhao

Software Integration Engineer at Thales

Great tool for sharing knowledge, internal communication and allows for real-time collaboration on pages

Confluence is easy to use and modify. However, sometimes there are too many pages. We have to reorganize the folder or parent account. Since everyone can create a page, the same knowledge might be created in multiple places by different people. This leads to redundancy and makes it difficult to find information. It's not centralized. So it could be more user-friendly and centralized. A way to reduce redundancy would be helpful. It's very easy to use, so everyone can create knowledge. But it would be good to synchronize and organize that information a bit better. Another improvement would be in Confluence search. You can search for keywords, but it's not like AI, not even ChatGPT or OpenAI. It would be nice to get more relevant or organized answers. If you're outside the company, you just get some titles containing the keyword you input. But if Confluence were like a database, you could input something and get a well-organized search offering from multiple pages.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"I also like that you can add custom libraries like JAR files and use them. So, the ability to use a fast processing engine and embed basic jobs easily are significant advantages."

"Its user interface is quite good. You just need to choose some options to create a job in AWS Glue. The code-generation feature is also useful. If you don't want to customize it and simply want to read a file and store the data in the database, it can generate the code for you."

"The most valuable feature of AWS Glue is that it provides a GUI format with a drag-and-drop feature."

"The most valuable feature of AWS Glue is its ease of use and good documentation. Additionally, we can do all the transformations that we need."

"AWS Glue is quite better than other tools, but you have to learn it properly before you start using it."

"The solution’s most valuable feature is the ETL job."

"The most valuable feature of AWS Glue is scalability."

"The solution is highly user-friendly, and its features are easy to use. The new addition of AWS Glue Data Catalog is also very beneficial, making the tool even more helpful for its users."

More AWS Glue pros

"Their tech support is amazing; they are very good, both on and off-site."

"The solution can handle a high volume of data because it works and scales well."

"The design of the product is extremely well built and it is highly configurable."

"With Confluent Cloud we no longer need to handle the infrastructure and the plumbing, which is a concern for Confluent. The other advantage is that all portfolios have access to the data that is being shared."

"We ensure seamless management of Kafka through Confluent, allowing all of our Kafka activities to be handled by a third party."

"I would rate the scalability of the solution at eight out of ten. We have 20 people who use Confluent in our organization now, and we hope to increase usage in the future."

"Implementing Confluent's schema registry has significantly enhanced our organization's data quality assurance."

"The monitoring module is impressive."

More Confluent pros

Cons

"There could be an enhanced way of managing pure metadata management or data cataloging."

"The drawbacks associated with the product stem from the fact that, based on the data volume, it can become very costly."

"The monitoring is not that good."

"It fails to handle massive databases acquired from various sources."

"It is very difficult to learn the tool and remember the syntaxes comparatively."

"If there's a cluster-related configuration, we have to make worker notes, which is quite a headache when processing a large amount of data."

"Overall, I consider the technical support to be fine, although the response time could be faster in certain cases."

"We face performance issues when using AWS Glue for data transformation and integration."

More AWS Glue cons

"Confluent's price needs improvement."

"It could be improved by including a feature that automatically creates a new topic and puts failed messages."

"We continuously face issues, such as Kafka being down and slow responses from the support team."

"Confluent has a good monitoring tool, but it's not customizable."

"It would help if the knowledge based documents in the support portal could be available for public use as well."

"Areas for improvement include implementing multi-storage support to differentiate between database stores based on data age and optimizing storage costs."

"It could be more user-friendly and centralized. A way to reduce redundancy would be helpful."

"There is a limitation when it comes to seamlessly importing Microsoft documents into Confluent pages, which can be inconvenient for users who frequently work with Microsoft Office tools and need to transition their content to Confluent."

More Confluent cons

Pricing and Cost Advice

"I would rate the solution a six or seven on a scale of one to ten, with ten being very expensive. Specifically, I rate its pricing a six out of ten."

"AWS Glue is quite costly, especially for small organizations."

"I rate the tool an eight on a scale of one to ten, where one is expensive, and ten is expensive."

"Its price is good. We pay as we go or based on the usage, which is a good thing for us because it is simple to forecast for the tool. It is good in terms of the financial planning of the company, and it is a good way to estimate the cost. It is also simple for our clients. In my opinion, it is one of the best tools in the market for ETL processes because of the fact that you pay as you use, which separates it from other big tools such as PowerCenter, Pentaho Data Integration, and Talend."

"Technical support is a paid service, and which subscription you have is dependent on that. You must pay one of them, and it ranges from $15,000 to $25,000 per year."

"It is not expensive. AWS Glue works on the serverless architecture. We get charged for the time the server is up. For our use case, we have to use it once in a day, and it is not expensive for us."

"The pricing is a bit higher than other solutions like Athena and EC2. If the pricing becomes more scaled or flexible, it will be good because you have to pay 44 cents just for one DPU for an hour. If you increase DPUs to 5 or 10, the pricing gets multiplied. There are also some time limits like 0 to 10 minutes or 10 to 20 minutes. If the pricing is according to the minutes, it would be better because you have to limit your job to 10 minutes or 20 minutes."

"AWS Glue uses a pay-as-you-go approach which is helpful. The price of the overall solution is low and is a great advantage."

More AWS Glue pricing and cost advice

"Confluent is an expensive solution as we went for a three contract and it was very costly for us."

"On a scale from one to ten, where one is low pricing and ten is high pricing, I would rate Confluent's pricing at five. I have not encountered any additional costs."

"It comes with a high cost."

"Confluence's pricing is quite reasonable, with a cost of around $10 per user that decreases as the number of users increases. Additionally, it's worth noting that for teams of up to 10 users, the solution is completely free."

"Confluent has a yearly license, which is a bit high because it's on a per-user basis."

"Confluent is an expensive solution."

"Confluent is highly priced."

"The pricing model of Confluent could improve because if you have a classic use case where you're going to use all the features there is no plan to reduce the features. You should be able to pick and choose basic services at a reduced price. The pricing was high for our needs. We should not have to pay for features we do not use."

More Confluent pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.

See recommendations

845,406 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

22%

Computer Software Company

13%

Manufacturing Company

Government

Financial Services Firm

19%

Computer Software Company

16%

Manufacturing Company

Insurance Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How do you select the right cloud ETL tool?

AWS Glue and Azure Data factory for ELT best performance cloud services.

How does Talend Open Studio compare with AWS Glue?

We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...

What are the most common use cases for AWS Glue?

AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...

What do you like most about Confluent?

I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and to...

What is your experience regarding pricing and costs for Confluent?

They charge a lot for scaling, which makes it expensive.

What needs improvement with Confluent?

I am not very impressed by Confluent. We continuously face issues, such as Kafka being down and slow responses from the support team. The lack of easy access to the Confluent support team is also a...

AWS Database Migration Service vs AWS Glue

Comparisons

Compared 37% of the time

SSIS vs AWS Glue

Compared 5% of the time

Informatica Intelligent Data Management Cloud (IDMC) vs AWS Glue

Compared 5% of the time

Oracle Integration Cloud Service vs AWS Glue

Compared 5% of the time

IBM InfoSphere DataStage vs AWS Glue

Compared 2% of the time

More AWS Glue Competitors

Amazon Kinesis vs Confluent

Compared 17% of the time

Amazon MSK vs Confluent

Compared 11% of the time

Databricks vs Confluent

Compared 9% of the time

Cribl vs Confluent

Compared 4% of the time

Fivetran vs Confluent

Compared 4% of the time

More Confluent Competitors

Product Reports

AWS Glue

Download AWS Glue product report

Download Confluent product report

Overview

AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.

AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.

The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.

AWS Glue Features

AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:

Automatic schema discovery: AWS Glue crawlers connect to the organization's source or target data source through a prioritized list of classifiers to determine the schema for users' data. This feature creates metadata in companies' AWS Glue Data Catalog.
Schemas for data stream management: The AWS Glue Schema Registry enables users to validate and control the evolution of streaming data through registered Apache Avro schemas for no additional charge.
Automatic scaling based on workload: This feature dynamically scales resources up and down based on workload. The feature controls job resources, removing them depending on how much the workload can be split up.
FindMatches: This feature is for machine learning-based data deduplication and cleansing, and works by finding records that are imperfect matches of each other to remove useless data copies.
Edit, debug, and test ETL code: This feature helps users who have chosen to interactively develop their ETL code by providing development endpoints for editing, debugging, and testing the code it generates for them.
AWS Glue DataBrew: An interactive, point-and-click visual interface for specialists to clean and normalize data without the need to write any code.
AWS Glue Interactive Sessions: This feature simplifies the development of data integration jobs by enabling data engineers to interactively prepare and explore data.
AWS Glue Studio Job Notebooks: This AWS Glue feature provides serverless notebooks with minimal setup, allowing developers to start working in a timely manner.
Complex ETL pipeline building: This feature allows the product to be invoked on a schedule, on demand, or based on an event, allowing users to start multiple jobs in parallel or specify dependencies to build complex ETL pipelines.
AWS Glue Studio: This AWS Glue feature allows users to visually transform data through a drag-and-drop interface. The product automatically generates the code for ETL processes for users' data.

AWS Glue Benefits

AWS Glue offers a wide range of benefits for its users. These benefits include:

Users of other AWS products can easily onboard with AWS Glue, as it is integrated across a wide range of the company's services.
The solution is serverless, which allows for a lower total cost of ownership.
AWS Glue offers more power for users, as it automates much of the effort in building, maintaining, and running ETL jobs.
The product allows customers to easily discover and search across all their AWS datasets through AWS Glue Data Catalog.
AWS Glue does not require additional payment for managing and enforcing schemas for data streams.
The solution facilitates the authority of scalable ETL jobs for beginners and non-coding experts through a drag-and-drop interface.

Reviews from Real Users

Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.

Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.

Amazon Web Services (AWS)

Confluent is an enterprise-ready, full-scale streaming platform that enhances Apache Kafka.

Confluent has integrated cutting-edge features that are designed to enhance these tasks:

Speed up application development and connectivity
Enable transformations through stream processing
Streamline business operations at scale
Adhere to strict architectural standards

Confluent is a more complete distribution of Kafka in that it enhances the integration possibilities of Kafka by introducing tools for managing and optimizing Kafka clusters while providing methods for making sure the streams are secure. Confluent supports publish-and-subscribe as well as the storing and processing of data within the streams. Kafka is easier to operate and build thanks to Confluent.

Confluent's software is available in three different varieties:

A free, open-source streaming platform that makes it simple to start using real-time data streams
An enterprise-grade version of the product with more administrative, ops, and monitoring tools
A premium cloud-based version.

Confluent Advantage Features

Confluent has many valuable key features. Some of the most useful ones include:

Multi-language
- Clients: C++, Python, Go, and .NET
- REST proxy: Can connect to Kafka from any connected network device
- Admin REST APIs: RESTful interface for performing administrator operations

Pre-built ecosystem
- Connectors: More than 100 supported connectors, including S3, Elastic, HDFS, JDBC
- MQTT proxy: Gain access to Kafka from MQTT gateways and devices
- Schema registry: Centralized database to guarantee data compatibility

Streaming database
- ksqlDB: Materialized views and real-time stream processing

GUI management
- Control panel: GUI for scalable Kafka management and monitoring
- Health+: Smart alerts and cloud-based control centers

DevOps automation that is flexible
- Confluent for Kubernetes: Complete API to deploy on Kubernetes
- Automated Ansible deployment on non-containerized environments

Dynamic performance
- Self-balancing clusters: Automated partition re-balancing across brokers in the cluster
- Tiered storage: Older Kafka data offloading to object storage with transparent access

Security that is enterprise-grade
- Role-based access control: Granular user/group access authorization
- Audit logs that are structured: Logs of user actions kept in dedicated Kafka topics
- Secret protection: Sensitive information is encrypted

Global resilience
- Linking clusters: A real-time, highly reliable, and consistent bridge across on-premises and cloud environments
- Multiple-region clusters: Single Kafka cluster with automated client failover distributed across multiple data centers
- Replicator: Asynchronous replication that is based on the Kafka Connect framework

Support
- Round the clock enterprise support from Kafka experts

Reviews from Real Users

Confluent stands out among its competitors for a number of reasons. Two major ones are its robust enterprise support and its open source option. PeerSpot users take note of the advantages of these features in their reviews:

Ravi B., a solutions architect at a tech services company, writes of the solution, “KSQL is a valuable feature, as is the Kafka Connect framework for connecting to the various source systems where you need not write the code. We get great support from Confluent because we're using the enterprise version and whenever there's a problem, they support us with fine-tuning and finding the root cause.”

Amit S., an IT consultant, notes, “The biggest benefit is that it is open source. You have the flexibility of opting or not opting for enterprise support, even though the tool itself is open source.” He adds, “The second benefit is it's very modern and built on Java and Scala. You can extend the features very well, and it doesn't take a lot of effort to do so.”

Sample Customers

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday

ING, Priceline.com, Nordea, Target, RBC, Tivo, Capital One, Chartboost

AWS Glue vs. Confluent