Find out what your peers are saying about Snowflake Computing, Google, Databricks and others in Cloud Data Warehouse.
This reduction in both time and money resulted in real-time impact and significant cost savings.
For a lot of different tasks, including machine learning, it is a nice solution.
When it comes to big data processing, I prefer Databricks over other solutions.
It's not structured support, which is why we don't use purely open-source projects without additional structured support.
Whenever we reach out, they respond promptly.
As of now, we are raising issues and they are providing solutions without any problems.
I would give Databricks customer support a rating of ten.
It is a distributed file system and scales reasonably well as long as it is given sufficient resources.
The sky's the limit with Databricks.
Databricks offers very good scalability, allowing you to increase or reduce processing resources according to the volume of data and demand.
The patches have sometimes caused issues leading to our jobs being paused for about six hours.
Continuous management in the way of upgrades and technical management is necessary to ensure that it remains effective.
They release patches that sometimes break our code.
Although it is too early to definitively state the platform's stability, we have not encountered any issues so far.
Databricks is definitely a very stable product and reliable.
The problem with Apache Hadoop arose when the guys that originally set it up left the firm, and the group that later owned it didn't have enough technical resources to properly maintain it.
Adjusting features like worker nodes and node utilization during cluster creation could mitigate these failures.
We prefer using a small to mid-sized cluster for many jobs to keep costs low, but this sometimes doesn't support our operations properly.
We use MLflow for managing MLOps, however, further improvement would be beneficial, especially for large language models and related tools.
It is not a cheap solution.
I believe that in terms of credits for Databricks, we're spending between £15,000 and £20,000 a month.
I have had a very good experience with pricing, as there was a drop in costs compared to the previous tool.
If you don't do the upgrades, the platform ages out, and that's what happened to the Hadoop content.
Databricks' capability to process data in parallel enhances data processing speed.
The platform allows us to leverage cloud advantages effectively, enhancing our AI and ML projects.
The Unity Catalog is for data governance, and the Delta Lake is to build the lakehouse.
| Company Size | Count |
|---|---|
| Small Business | 14 |
| Midsize Enterprise | 8 |
| Large Enterprise | 22 |
| Company Size | Count |
|---|---|
| Small Business | 26 |
| Midsize Enterprise | 14 |
| Large Enterprise | 60 |
Apache Hadoop provides a scalable, cost-effective open-source platform capable of handling vast data volumes with features like HDFS, distributed processing, and high integration capabilities.
Apache Hadoop is known for its distributed file system HDFS, which supports large data volumes efficiently. Its open-source nature allows cost-effective scalability and compatibility with tools like Spark for enhanced analytics. While it offers significant processing power, areas for improvement include user-friendliness, interface design, security measures, and real-time data handling. Users benefit from data storage for structured and unstructured data, facilitated by its distributed processing architecture. Data replication ensures fault tolerance, while its capability to integrate with tools like Apache Atlas and Talend highlights its versatility.
What are the key features of Apache Hadoop?Industries leverage Apache Hadoop for Big Data analytics, data lakes, ETL tasks, and enterprise data hubs, handling unstructured and structured data from IoT, RDBMS, and real-time streams. Its applications extend to data warehousing, AI/ML projects, and data migration, employing tools like Apache Ranger, Hive, and Talend for effective data management and analysis.
Databricks offers a scalable, versatile platform that integrates seamlessly with Spark and multiple languages, supporting data engineering, machine learning, and analytics in a unified environment.
Databricks stands out for its scalability, ease of use, and powerful integration with Spark, multiple languages, and leading cloud services like Azure and AWS. It provides tools such as the Notebook for collaboration, Delta Lake for efficient data management, and Unity Catalog for data governance. While enhancing data engineering and machine learning workflows, it faces challenges in visualization and third-party integration, with pricing and user interface navigation being common concerns. Despite needing improvements in connectivity and documentation, it remains popular for tasks like real-time processing and data pipeline management.
What features make Databricks unique?
What benefits can users expect from Databricks?
In the tech industry, Databricks empowers teams to perform comprehensive data analytics, enabling them to conduct extensive ETL operations, run predictive modeling, and prepare data for SparkML. In retail, it supports real-time data processing and batch streaming, aiding in better decision-making. Enterprises across sectors leverage its capabilities for creating secure APIs and managing data lakes effectively.
We monitor all Cloud Data Warehouse reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
