Apache Spark Streaming Reviews

We use Spark Streaming in a micro-batch region. It's not a full real-time system, but it offers high performance and low latency.

Spark Streaming is critical, quite stable, full-featured, and scalable. It has a low latency and high performance, comparable to functions that can be called by triggers. It is well-designed with good documentation, making it easy to find solutions.

We don't have enough experience to be judgmental about its flaws, as we've only used stable features like batch micro-batch. Integration poses no problem; however, I don't use some features and can't judge those.

I have used it intensively for maybe one year.

It's quite stable and reliable for our use cases.

Regardless of my case, Spark is scalable enough.

We use our pipelines to deliver, which is a mix of involvement from a few team members.

The solution rates a nine out of ten.

The primary use case of this solution is for streaming data. It can stream large amounts of data in small data chunks which are used for Databricks data. I've been using the solution for personal research purposes only and not for business applications. I'm a customer of Apache. 

Data streaming would be the best feature of Spark and that includes when it's compared to Hadoop or Hive or Cassandra. It's the fastest solution on the market with low latency data on data transformations. I like that it's open source and easy to integrate with other data sources. 

The initial setup is quite complex. 

I've been using this solution for six months. 

The solution is stable. 

The solution is easily scalable in the cloud as per the limitations of the subscription. 

I have previously used a variety of different streaming platforms. I have written a paper analyzing various solutions for efficient streaming for cluster analysis and have published it. I found that Spark has the most features and is the quickest solution compared to the others when it comes to the transformation of data without any latencies or issues.

With a few commands it's possible to install. I installed it in a Linux environment. That said, the initial setup is complex because we have to learn either Java or Scala language. Spark Streaming has a few features in GitHub and its libraries, so we need to get some code to maintain some methods or functions to integrate with any data sources, and then we'll try to run those integrations. It may be that only a high level programmer familiar with Scala and Java can implement. There are quite extensive pre-requirements for using it properly.  

I'm using the open-source version of Spark, so there are no licensing costs. 

It's important to be familiar with Spark Streaming and Spark libraries, because familiarity with those scripts and coding languages makes it easier to work with the Spark code ecosystem to get the integrations of Spark Streaming or any Spark cluster creations.

I rate this solution eight out of 10. 

We're primarily using the solution for anomaly detection.

I like that it's Python. We have a Python ecosystem. Therefore, it fits perfectly.

The initial setup is simple. 

The solution can scale.

It's a stable product.

As an open-source solution, using it is basically free.

We would like to have the ability to do arbitrary stateful functions in Python.

We started using the solution half a year ago.

The solution is stable. There are no bugs or glitches. It doesn't crash or freeze.

It's enterprise-ready. It's very scalable.

As we're using it mostly for data science types of activities, there are maybe eight active users.

While we're purchasing external consulting to support us, the documentation is pretty good.

We tried Flink, however, it was not satisfactory.

It's not a complex implementation. In our case, it was easy as we have a hosted environment. The deployment only takes a couple of minutes.

The solution is open-source. That's pretty reasonable. It's basically free.

We are a customer and end-user.

We're using it in Azure, in Databricks. I don't know the exact version of Spark I'm using; it's one of the recent ones.

I would rate the product an eight out of ten.

The solution is very stable and reliable. It's quite mature. 

The solution scales very well.

The installation is difficult. You definitely need more than one person. That said, if you are implementing the cloud, it's easier.

The solution itself could be easier to use.

The solution is free to use as it is open-source.

I've used the solution for a while. I use it every day. However, it depends on the project.

The solution is stable. It's not a new tool. It's quite mature. It's been on the market for many years. We found that especially version 3.0.1 is a good, stable version.

The solution is quite scalable. It is the most scalable tool that I have seen before.

We have five people using the solution.

I did not previously use a different solution. I've been working in data warehousing for around 20 years ago and I used a batch system that used Oracle Database and is not a scalable system like Spark.

The initial setup is quite involved. Streaming is a huge system. It's different. You need to use another part of the code, however, it's not extremely much. People who work in data need to micro-batch. You need other tools, such as Hadoop or Data Lake, or Kafka to control the data. 

It's not easy to install. Not all products are open-source. It is not easy to implement on-premise as you need maybe two technical persons to maintain the system. If you put it in the cloud, it's easier.

It's less expensive to use the cloud. Using on-premises is more costly. Spark is open-source and doesn't actually cost us anything.

It's cheaper for companies to use cloud systems, however, you can implement it on-premise.

We use the cloud. As it is the cloud, it's always on the latest version and updates itself regularly.

I would rate the product at a nine out of ten. It's very good in terms of its capabilities and I have been very happy with it.

I would recommend the solution to other users.

I've used it more for ETL. It's useful for creating data pipelines, streaming datasets, generating synthetic data, synchronizing data, creating data lakes, and loading and unloading data is fast and easy. 

In my ETL work, I often move data from multiple sources into a data lake. Apache Spark is very helpful for tracking the latest data delivery and automatically streaming it to the target database.

Apache Spark is a versatile technology useful not only for data solutions but also for data creation. This is especially valuable given GDPR regulations and limited access to production, which make tasks like testing quite difficult. It helps with data creation and alignment for both consumers and developers.

Apache Spark Streaming is particularly good at handling real-time data. It has built-in data streaming integration, which allows it to stream data from any source as soon as it becomes available.

The scalability features are already good, but they could be further enhanced. Additionally, the debugging aspect could use some improvement.

The stability is very good.  Since everything runs as code, it's easy to understand what's happening under the hood. It's not a closed-box system, which makes it quite transparent.

On my team, there are about six or seven people using it. However, on the analytics side, where users view the reports, there are many more, perhaps over a hundred.

The deployment process is quite easy and not very complicated.

Since it's an open-source technology, it can be deployed in various environments, including local machines and all kinds of clouds. If you're using the cloud, scaling is quite easy.

If there are knowledgeable, experienced team members, it doesn't require a large team. One or two developers are enough.

It can handle large datasets and is relatively easy to manage, especially with cloud technologies. This means you can process a lot of data even with a low-configuration environment, which helps with cost savings.

I would rate it a seven out of ten. Apache Spark's capabilities for machine learning are quite extensive and can be used in a low-code way. This can be much more efficient than using various technologies. You can also combine its batch processing capabilities with new technologies and machine learning.

It's quite useful for AI because of its machine-learning capabilities, which allow for model training and output generation.

The primary use of the solution is to implement predictive maintenance qualities. 

The solution is better than average and some of the valuable features include efficiency and stability.

There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused. For example, it is still not plug and play and use as some of the cloud offerings that come ready to use. It is not up there in the reading leading edge.

I have been using this solution for approximately one and a half year. 

The solution is very stable.

The initial setup is developer-focused but it is not very complex. I can set up a stream in less than an hour. It will stream but It will not be a production-ready stream.

I rate Apache Spark Streaming a six out of ten. 

The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams.

The product's event handling capabilities, particularly compared to Kaspersky, need improvement. Integrating event-level streaming capabilities could be beneficial. This aligns with the idea of expanding Spark's functionality to cover unaddressed areas, potentially enhancing its competitiveness.

We have been using Apache Spark Streaming for five years.

Spark is an affordable solution, especially considering its open-source nature. However, it could use support from experienced companies to resolve any issues effectively.

Spark does not encounter integration issues, particularly due to its utilization of JDBC connectors. These connectors facilitate seamless integration with third-party solutions. Furthermore, successful integration with tools like SAP HANA indicates its versatility in handling various data sources. Additionally, its performance surpasses Informatica in certain scenarios, especially when real-time streaming capabilities are crucial. It remains a preferred choice for businesses requiring efficient real-time data processing.

I rate it an eight.