AWS Glue and Fivetran compete in data integration and management. AWS Glue appears to have an advantage due to its strong integration within the AWS ecosystem and automation features, whereas Fivetran is notable for its seamless connectors and ease of automation.
Features: AWS Glue offers a data catalog, efficient triggers for scheduling ETL processes, and strong AWS integration. It is notable for its code-generation capabilities and scalable cloud features. Fivetran is appreciated for automation in data replication and seamless connectors with diverse applications. Its integration with DBT for data transformation and replication is also notable.
Room for Improvement: AWS Glue could improve startup time, expand language support, and enhance cross-cloud compatibility. Fivetran should focus on enhancing data pipeline observability, increasing connector options, and improving pricing transparency and logging features.
Ease of Deployment and Customer Service: AWS Glue supports private, hybrid, and public cloud deployments but has a learning curve, with costly yet reliable customer service. Fivetran is primarily public cloud-based, offering efficient hybrid integration with positively regarded but costly customer service.
Pricing and ROI: AWS Glue's pay-as-you-go model supports scalability, but it can be expensive for extensive data use, requiring careful cost planning. Fivetran's pricing based on data usage might be costly, but costs decrease with high data usage. Both products promise ROI through efficiency, but Fivetran's pricing model could lead to unexpected costs.
I advocate using Glue in such cases.
It saves us the effort of having one to two data engineers managing the tasks that Fivetran handles.
AWS's documentation is reliable, and careful reference often resolves missed upgrade details.
The technical support provided by Fivetran has generally been good, with a response time and competence that I would rate as good.
For jobs requiring multiple RAM usage, we increase the number of workers accordingly.
It can easily handle data from one terabyte to 100 terabytes or more, scaling nicely with larger datasets.
AWS Glue is highly stable, and I would rate its stability as nine.
During the duration of the time that we used Fivetran, it was highly stable.
Learning the latest functionalities is crucial, and while challenging, it is a vital part of staying current and ensuring an efficient ETL process.
With AWS, I gather data from multiple sources, clean it up, normalize it, de-duplicate it, and make it presentable.
A more user-friendly and simpler process would help speed up the deployment process.
From a cost perspective, if the number of connectors is lesser, then Fivetran is not the most cost-efficient option.
Fivetran could improve by adapting more for technical users and by providing more options for such users.
AWS charges based on runtime, which can be quite pricey.
The smallest cost for a project is around €700, while the largest can reach up to €7,000 based on the scale of the usage.
Costing depends on resource usage, and cost optimization may involve redesigning jobs for flexibility.
Our current yearly contract for Fivetran is approximately $70,000.
For ETL, I feel the performance is excellent. If I create jobs in a standard way, the performance is great, and maintenance is also seamless.
AWS Glue's most valuable features include its transformation capabilities, which provide data quality and shape for processing in ML or AI models.
I think if I'm working with big data, common languages like Python work quite nicely, which is advantageous.
The most valuable feature of Fivetran is its built-in connectors for a wide range of data sources.
The ability to seamlessly integrate with a large variety of data sources is valuable.
AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.
AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.
The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.
AWS Glue Features
AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:
AWS Glue Benefits
AWS Glue offers a wide range of benefits for its users. These benefits include:
Reviews from Real Users
Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.
Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.
Fivetran, the global leader in data movement, is trusted by companies like OpenAI, LVMH, Pfizer, Verizon and Spotify to centralize data from SaaS applications, databases, files, and other sources into cloud destinations, including data lakes. With high-performance pipelines, seamless interoperability, and enterprise-grade security, Fivetran empowers organizations to modernize their data infrastructure, power analytics and AI, ensure compliance, and achieve transformative business outcomes. Learn more at Fivetran.com
We monitor all Cloud Data Integration reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
