

Apache Spark and Cloudera Data Platform compete in the data processing and management category. Cloudera Data Platform appears to have an upper hand due to its robust support for a hybrid environment and comprehensive integration across tools, which offers significant benefits for enterprises needing extensive support and streamlined operations.
Features: Apache Spark offers fast in-memory data processing with extensive support for Spark Streaming, Spark SQL, and MLlib. It is highly effective for large-scale data processing and low-latency access. Cloudera Data Platform provides strong data management with distributed storage via HDFS and security through Apache Ranger, enabling hybrid environments and real-time analytics with tools like NiFi and Spark. Its integration capabilities across processing tools enhance its value.
Room for Improvement: Apache Spark could improve real-time querying, memory management, and integration with BI tools. User interface enhancements and expansion of machine learning libraries are also needed. Cloudera Data Platform could enhance support for cutting-edge AI and simplify its interface and configuration, in addition to addressing scalability and cloud integration challenges.
Ease of Deployment and Customer Service: Apache Spark is commonly deployed across on-premises, hybrid, and cloud environments but faces complexity issues due to its open-source nature, with users heavily relying on community support. Cloudera Data Platform offers more structured deployment and excellent customer service, supported by its commercial backing, which is highly appreciated by its users.
Pricing and ROI: Apache Spark, being open source, generally incurs no direct licensing costs but may require investment in infrastructure. It is regarded as a cost-effective solution for reducing operational expenses. Cloudera Data Platform involves higher costs due to licensing but offers extensive features and support, which can justify investment for large-scale implementations. Although viewed as complex, its pricing is considered reasonable for the operational gains it provides.
There are licensing costs that have been saved when we moved some of the data platforms, decommissioned them, and moved on to this platform.
In terms of return on investment, I see great changes in operational effectiveness measured by RTO when comparing on-premises solutions with cloud solutions.
A specific example of the positive impact of Cloudera Data Platform is the clearly saved time and improved performance, which is the main result of it.
I have received support via newsgroups or guidance on specific discussions, which is what I would expect in an open-source situation.
I would rate the customer support of Cloudera Data Platform ten out of ten.
I have communicated with technical support, and they are responsive and helpful.
Cloudera support is timely and responsive, adhering to the SLAs they provide.
CDP allows for easy, mostly automated scalability where I can schedule job workflows, fine-tune system resource metrics, and add nodes with just a click.
They have the cloud burst feature available where if the on-premises capacity is not sufficient at a point in time, you can run that Spark job on the cloud itself.
The ability to scale processing capacity on demand for batch jobs without impacting other workloads, and support for a growing number of concurrent users and teams accessing the platform simultaneously are significant advantages.
Apache Spark resolves many problems in the MapReduce solution and Hadoop, such as the inability to run effective Python or machine learning algorithms.
Without a doubt, we have had some crashes because each situation is different, and while the prototype in my environment is stable, we do not know everything at other customer sites.
Sometimes the end user is not experienced or does not have all the expertise related to Cloudera specifically, making it very difficult to manage properly
Sometimes a node goes down, but it automatically returns to a healthy state.
Cloudera Data Platform is pretty stable in my experience; there are not any downtime or reliability issues.
Various tools like Informatica, TIBCO, or Talend offer specific aspects, licensing can be costly;
We aim to address these issues with a Kubernetes-based platform that will simplify the task of upgrading services.
Cloudera Data Platform should include additional capabilities and features similar to those offered by other data management solutions like Azure and Databricks.
Cloudera Data Platform can be improved by addressing the feasibility of using it in the cloud; there are some complexities around the components used in cloud by Cloudera Data Platform that are not really convenient.
Initially, CDH had a straightforward pricing model based on nodes, but CDP includes factors like processors, cores, terabytes, and drives, making it difficult to calculate costs.
We find Cloudera Data Platform to be cost-effective.
So far, I would say that it is competitive pricing that we have received.
Not all solutions can make this data fast enough to be used, except for solutions such as Apache Spark Structured Streaming.
The solution is beneficial in that it provides a base-level long-held understanding of the framework that is not variant day by day, which is very helpful in my prototyping activity as an architect trying to assess Apache Spark, Great Expectations, and Vault-based solutions versus those proposed by clients like TIBCO or Informatica.
By using the Hadoop File System for distributed storage, we have 1.5 petabytes of physical storage with 500 terabytes of effective storage due to a replication factor of three.
The Ranger integration makes it more flexible and reliable for me by allowing control over data access, specifying who can access at what level, such as table level, masking, or data layer level.
What stands out the most in Cloudera Manager are SDX, which provide centralized control for governance, security, and data lineage across multiple sources.
| Product | Market Share (%) |
|---|---|
| Apache Spark | 13.9% |
| Cloudera Distribution for Hadoop | 15.1% |
| HPE Data Fabric | 14.9% |
| Other | 56.1% |
| Product | Market Share (%) |
|---|---|
| Cloudera Data Platform | 7.6% |
| Palantir Foundry | 15.6% |
| Informatica Intelligent Data Management Cloud (IDMC) | 10.8% |
| Other | 66.0% |


| Company Size | Count |
|---|---|
| Small Business | 28 |
| Midsize Enterprise | 15 |
| Large Enterprise | 32 |
| Company Size | Count |
|---|---|
| Small Business | 8 |
| Midsize Enterprise | 7 |
| Large Enterprise | 26 |
Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory
Cloudera Data Platform offers a powerful fusion of Hadoop technology and user-centric tools, enabling seamless scalability and open-source flexibility. It supports large-scale data operations with tools like Ranger and Cloudera Data Science Workbench, offering efficient cluster management and containerization capabilities.
Designed to support extensive data needs, Cloudera Data Platform encompasses a comprehensive Hadoop stack, which includes HDFS, Hive, and Spark. Its integration with Ambari provides user-friendliness in management and configuration. Despite its strengths in scalability and security, Cloudera Data Platform requires enhancements in multi-tenant implementation, governance, and UI, while attribute-level encryption and better HDFS namenode support are also needed. Stability, especially regarding the Hue UI, financial costs, and disaster recovery are notable challenges. Additionally, integration with cloud storage and deployment methods could be more intuitive to enhance user experience, along with more effective support and community engagement.
What are the key features?Cloudera Data Platform is implemented extensively across industries like hospitality for data science activities, including managing historical data. Its adaptability extends to operational analytics for sectors like oil & gas, finance, and healthcare, often enhanced by Hortonworks Data Platform for data ingestion and analytics tasks.
We monitor all Hadoop reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.