Databricks Reviews

We use this solution for the Customer Data Platform(CDP). My company works in the MarTech space and usually we implement custom CDP.

The Delta Lake data type has been the most useful part of this solution. Delta Lake is an opensource data type and it was implemented and invented by Databricks. It is the most important element of the solution. Databricks also offers exceptional performance and scalability. 

The data visualization for this solution could be improved. They have started to roll out a data visualization tool inside Databricks but it is in the early stages. It's not comparable to a solution like Power BI, Luca, or Tableau.

In a future release, we would like to have a better ETL designer tool to assist in the way we move data from one place to another.

We have been using this solution for four years. 

This is a stable solution. 

This is a scalable solution. 

The initial setup is very easy. It is a managed solution inside Azure so you just need to search for Databricks. There are a couple of pages to follow in the setup wizard and Databricks is up and running.

We implement this solution on behalf of our customers who have their own Azure subscription and they pay for Databricks themselves. The pricing is more expensive if you have large volumes of data. 

When we first started using Databricks in 2018, there were not many comarable solutions to consider. Right now there are many solutions to consider including Snowflake, Azure Synapse, Redshift and BigQuery.

Databricks continues to be our solution of choice but Snowflake does have a better user interface and is easier to work with the data pipelines and with the overall UI.

I would advise others to first define a strong data strategy and then choose which data platform suits your needs. 

I would rate this solution a nine out of ten. 

We use the solution for data engineering. 

The tool helps us manage large amounts of data. 

The simplicity of development is the most valuable feature. 

Databricks has a lack of debuggers, and it would be good to see more components. 

Another issue is that the D4 data format keeps changing on our cluster. This doesn't affect me much because I use functions to define it, but it is very frustrating for some more casual users. One day the output will be in a particular format, and then it becomes an object without us changing the cluster configuration. As a small team, we don't have the capacity to dig deeply into the issue, which has been frustrating.

We have been using the solution for three years. 

The solution's stability is good. 

The product is scalable. We're a small organization with 12 users, and we don't currently have any plans to increase our usage.

We see an ROI from Databricks. 

I would rate the solution seven out of ten. 

It's a good solution and more for handling large amounts of data. Databricks is better as a batch processing system than as an interactive system. The performance is a little disappointing because the memory processing is supposed to be excellent, but it's not as competitive as some other solutions out there in this regard. Even classical databases can respond and process faster.

Our primary use case for this solution is research for data scientists. The solution is deployed on cloud.

It has allowed our data engineers, data scientists, and analysts to collaborate and work on the same platform. 

We have the ability to scale, collaborate and do machine learning.

The product cannot be integrated with a popular coding IDE.

We have been using this solution for approximately three years.

The solution is stable.

The solution is scalable. There are five people using it in our organization.

I rate my experience with customer service and support an eight out of ten.

We previously used H2O.

The initial setup was straightforward.

Implementation was done in-house.

We have seen a return on investments.

Licensing costs are charged on a yearly basis and costs between 25,000 and 30,000.

We evaluated other options but this solution was the best fit for what we required.

I rate this solution nine out of ten. The solution is good but can be improved by integrating with a popular coding IDE.

Our primary use case of this product is for our customers who are running large systems and looking for an API -- a quick, easy integration with their own system. We use Databricks to create a secure API interface. I'm vice president of data science and we are customers of Databricks. 

Databricks is quite easy to use and requires less coding and customizations than a solution like AWS SageMaker which I'd previously used on a lot of projects. Databricks enables more people to efficiently build and host their ML code. Another great aspect is that MLflow is already integrated with Databricks which makes a big difference. It enables us to track and monitor all our different experiments. We have mostly used the MLflow part and generic notebooks with the ML building machine learning model, as well as using Pytorch for some of our medical imaging. We were able to quickly deploy both these features without requiring anything extra. 

I'm struggling a little because I wanted to do some POC solutions. I present a lot of projects in various forums and seminars and there aren't a lot of credits and trial options with Databricks. Even if we want to explore, we're not able to and that's a challenge. The solution is quite expensive.

I've been using this solution for a year. 

It's currently stable although we have not yet tested it with a huge volume of data. We'll focus on the performance and model serving capability in the near future. We're still carrying out performance testing, developing the models and figuring out the infrastructure.

Scalability is quite good because we just used 128 GB of resources. It's quite easy to scale.

It was relatively simple, we didn't face any challenges. Deployment takes around two days. 

We did a PSU in Azure ML Studio which is quite a good solution, easy to deploy and use. It's almost a no-code platform. We've also found Azure ML Studio to be quite cost-effective.

I would recommend trying Databricks because it's cloud agnostic. A lot of customers currently use Azure but want to build something on their own down the track. Databricks makes that easy with its integration with other cloud customers. If somebody wants to build something on their infrastructure or their own virtual cloud, this is a good platform.

I rate the solution eight out of 10 because of the issue I'm having with a lack of trial options.

Our primary use case is ETL.

Using Databricks enables us to use the Data Mesh methodology, where every team performs their own ETL.

The most valuable feature is the versatility of the ecosystem. You can write code in SQL, Python, or Java.

The load distribution capabilities are good, and you can perform data processing tasks very quickly.

You can save and share notebooks between different teams.

The interface is easy to use.

The cost of this solution is high, on the expensive side.

In the future, I would like to see Data Lake support. That is something that I'm looking forward to.

I worked with Databricks for approximately two years in my previous company.

This is a very scalable solution. We have twenty-five data engineers that use it, and we may grow our usage.

The technical support is okay. I would rate them a seven out of ten.

Neutral

We did not use another similar solution prior to Databricks.

The cloud-based deployment is simple.

If you use an on-premises deployment then there is more to do.

We deployed it with our in-house team.

There is no maintenance required.

We have seen a return on our investment with Databricks.

Price-wise, I would rate Databricks a three out of five.

When we looked into Databricks, we evaluated Azure Data Factory and some of the others on the market. We found that Databricks was one of the easiest ones to use.

My advice for anybody that is looking into Databricks is not to use the on-premises deployment. Instead, use the cloud-based setup.

In summary, this is a good product.

I would rate this solution an eight out of ten.

We build data solutions for the banking industry. Previously, we worked with AWS, but now we are on Azure. My role is to assess the current legacy applications and provide cloud alternatives based on the customers' requirements and expectations.

Databricks is a unified platform that provides features like streaming and batch processing. All the data scientists, analysts, and engineers can collaborate on a single platform. It has all the features, you need, so you don't need to go for any other tool. 

I like that Databricks is a unified platform that lets you do streaming and batch processing in the same place. You can do analytics, too. They have added something called Databricks SQL Analytics, allowing users to connect to the data lake to perform analytics. Databricks also will enable you to share your data securely. It integrates with your reporting system as well.

The Unity Catalog provides you with the data links and material capabilities. These are some of the unique features that fulfill all the requirements of the banking domain.

Every tool has room for improvement. Normally what happens, a solution will claim it can do ETL and everything else, but you encounter some limitations when you actually start. Then you keep on interacting with the vendor, and they continue to upgrade it. For example, we haven't fully implemented Databricks Unity Catalog, a newly introduced feature. We need to check how it works and then accordingly, there can be improvements in that also.

Databricks may not be as easy to use as other tools, but if you simplify a tool too much, it won't have the flexibility to go in-depth. Databricks is completely in the programmer's hands. I prefer flexibility rather than simplicity.

I have been using Databricks for a year.

Databricks relies on scalability and performance. Every cloud vendor prioritizes scalability, high availability, performance, and security. These are the most important reasons to move to the cloud.

Deploying Databricks on the cloud is straightforward. It's not like an on-premise solution, where you must create a cluster and all those other prerequisites for big data. 

I don't think it's challenging to maintain, but you need an expert programmer because Databricks isn't GUI-based. With GUI-based tools, building ETLs is drag-and-drop. Databricks entirely relies on coding, so you need skilled programmers to building your code, ETLs, etc. 

The price of Databricks is based on the computing volume. You also need to pay storage costs for the cloud where you're hosting Databricks, whether it is AWS, Azure, or Google. 

I rate Databricks nine out of 10. Databricks is one of the best tools on the market.

I like the simplicity and ease of use. 

You can deploy the solution to many clouds easily. 

The initial setup is straightforward.

The solution offers a free community version.

The auto models can be improved. 

We can create auto models like Microsoft Azure Machine Learning. In Azure Machine Learning, they have these features, for example, for auto models or code, or by code. They need this in Databricks. 

We need more connectors between on-premises and the cloud. 

We'd like a more visual dashboard for analysis It needs better UI. 

I've used the solution for one and a half months. 

The solution is very stable. There are no bugs or glitches. It doesn't crash or freeze. 

Scalability is no problem. At the beginning, we created a cluster, for example, and if we need more performance in the future, for example, or to accelerate the training, we can change the cluster. It's quite straightforward. 

We have five people using the solution. 

In one or two years, we'd like to promote the solution to clients and increase usage. Right now, the way it is used is limited. I know that some banks and aeronautics companies use it.

In terms of technical support, for now, we use the community. 

We are also aware of KNIME, Azure Machine Learning, and Anaconda. In Anaconda, we use many frameworks, for example.

We started with other platforms, like Azure Machine Learning due to the fact that, with AutoML, it's easy to use. However, now that we have more skills, we need other tools or platforms like Databricks. It's a good platform to deploy and develop machine learning in employees.

The implementation is quite easy. It's not complex or difficult. The first time, I did it using a tutorial which was quite helpful. Later, I took a course. I know it quite well. 

The deployment only takes a few days. 

You only need to deploy or maintain the solution. 

We did not need any outside assistance in terms of setting up the solution. 

For us, this product is free. We use the community version.

I am interested in using the enterprise version, however. Whether we use it or not depends on the projects and customers we get.

I work with a solution provider. We are a Databrick customer.

We are not partners of Databricks. Only we are partnered with Microsoft Azure and Amazon AWS.

We are using the latest version of the solution. However, I do not know the exact version number. 

I still need time with the solution before providing advice to others. I need to prepare the capacity internally. So far, it's been great.

I'd rate the solution eight out of ten. 

I am using Databricks for creating business intelligence solutions.

The most valuable feature of Databricks is the integration with Microsoft Azure.

Databricks can improve by making the documentation better.

I have been using Databricks for approximately one year.

Databricks is stable.

The scalability of Databricks is good.

We have approximately 500 users using this solution in my organization.

I have not used the support from Databricks.

We previously used Microsoft stacks. We chose Databricks because the processing power was better and it was a better fit for our use case.

The initial setup of Databricks was not straightforward. We had to do trial and error and we learned as we went along.

I rate the initial setup of Databricks a four out of five.

We did the implementation of Databricks in-house. The solution requires ongoing maintenance.

I would recommend this solution to others.

My advice to others is for them to first do a small proof of concept and then see how it works out and then take it from there.

I rate Databricks an eight out of ten.

This solution offers a lake house data concept that we have found exciting. We are able to have a large amount of data in a data lake and can manage all relational activities. All asset complaints properties are available and this is very useful to ensure the quality of all data.

The connectivity with various BI tools could be improved, specifically the performance and real time integration. There is also some improvement required in the semantic layers to manage the data match as well as the data warehouse features.

In a future release, we would like to have features to better manage all ML development activities.

I have been using this solution for three years. 

This is a stable solution, especially compared to other technology on the market.

It is a scalable solution but this depends on the platform that is being used. If you use a cloud platform such as Azure, it offers scalability. However, some platforms will not support scalability using Databricks.

We have around 20 users in our development team using Databricks. 

The customer service and support for this solution is good. 

Positive

The initial setup is pretty simple and requires minimal configuration compared to other technology.

I would rate the pricing for this solution a four out of five. This does depend on the environment or the infrastructure that one is using. There is a difference in pricing between using Azure or being on-premises. 

Azure Synapse is a competitor that we evaluated but it is not mature enough to provide better performance than Databricks. We choose Databricks due to the ability to have a lot of data in Data Lakes and the Data Warehouse. We are also able to run data science activities using ML flow.

If you are looking for custom model development and a lot of data management in a cloud agnostic manner, then Databricks is a good solution.

I would rate this solution an eight out of ten. 

Our use case is confidential, but I can say we use it for a deep learning model for machine learning. 

The solution is built from Spark and has integration with MLflow, which is important for our use case. 

Databricks is also user-friendly, providing customizable codes and models that allow people to experiment quickly. 

Integration of Delta Lake is another useful feature.

Writing pandas-profiling reports could be easier. 

The ability to customize our own pipelines would enhance the product, similar to what's possible using ML files in Microsoft Azure DevOps. 

I have been using this product for one and a half years. 

For now the solution seems stable. 

The solution is easy to scale horizontally and it has a useful auto-scaling feature. For vertical scaling, you need to bring the system down and make some adjustments.

On my current project I have a team of 30 members under me, including data engineers and data science people. Our data science, engineering, and MLOps projects are expanding, so we are planning to do some vertical scaling to increase the team size to over 100 members. In our company, we are trying to certify more and more people in Databricks because it's cloud-agnostic. 

We have never needed to contact customer support, online resources have been sufficient to solve our problems. 

The initial setup of the solution is straightforward, once you understand the UI it is easy to implement. I would rate Databricks a four out of five for ease of setup.

One migration project took two to three months, including writing all the code and implementing end-to-end pipelines. 

We are planning to deploy the solution in stages over the next 15 months to completely implement MLOps for our organization.

I'm not involved in the financing, but I can say that the solution seemed reasonably priced compared to the competitors. Similar products are usually in the same price range. With five being affordable and one being expensive, I would rate Databricks a four out of five. 

I find that deployed systems work out cheaper than having to operate manually, which appeals to our customers. 

I would rate this solution an eight out of ten. 

There is an issue where clusters are automatically deleted after termination or after 100 days of non-usage. This could be more user-friendly, and they could include an enabler to pin the clusters you want to keep, instead of having to go and research why clusters got deleted after implementing the product. That documentation needs to be right in front of the user to avoid issues.

I definitely recommend this product to other users.