Where should we email your report?
Spark SQL review
Kemal Duman
Team Lead, Data Engineering at a recreational facilities/services company with 201-500 employees
Data pipelines have run faster and support flexible batch and streaming...
We do not have any performance problems, but we do have some resource problems. Spark SQL consumes so many resources that we migrated our streaming job from Spark to Apache Flink. Resource management in Spark SQL should be better. It consumes more resources, which is normal. The main reason we switched from Spark is memory and CPU...
Spark SQL review
Sahil Taneja
Principal Consultant/Manager at a consultancy with 51-200 employees
Easy to use and do not require a learning curve
Spark SQL can improve the documentation they have provided. It can be a bit unclear at times. They could improve the documentation a bit more so that we can understand it more easily. Moreover, they could improve SparkUI to have more advanced versions of the performance and the queries and all.
Since 2012, we've had 881,082 professionals use our research.
As seen in