Azure Data Factory Reviews

Azure Data Factory is an integration tool, an orchestration service tool. It’s for data integration for the cloud.

The solution is okay.

Some stuff can be better, however, overall it's fine.

The performance and stability are touch and go.

The deployment should be easier.

We’d like the management of the solution to run a little more smoothly.

I’ve used the solution for three to five years.

The solution could be more stable. It’s touch and go. It’s not 100%.

For Azure Data Factory, scalability doesn't mean really too much. However, in some scenarios, you can play with it a little bit.

Azure Data Factory is not for users. Is for engineers, for developers. The end user does not interact with Azure Data Factory. There might be 20 developers on the solution currently.

I don't remember a particular scenario right now where I reached out to support. However, when you work with Azure Services, here and there, you might get into some challenges, and maybe sometimes you reach out to Microsoft. That said, I don't remember a particular scenario right now.

It’s hard to describe the installation. It’s not overly complex or extremely easy.

The point is almost true for all services. If you want to do something simple and quick, then it's just a couple of clicks, and it's there. However, in real production environments, it's not like that. You have to arrange a lot of things. You have to set up a lot of things. You have to configure a lot of things correctly in an automated way. That is totally different than just a couple of clicks. You have to put in the work. If you ask me how easy it is, yeah, it is easy. However, it can also be really, really complicated depending on the scenario.

As far as I know, there isn’t any licensing per se for this solution.

I’d rate the solution eight out of ten overall.

It's a PaaS service. It's a hybrid solution. The cloud provider is Microsoft.

We are not using Azure Data Factory as for users. Rather, we're using it as a process base. We're just using it for orchestration, not for any kind of ETL stuff.

We have plans to increase usage. It's going to take a major role in any kind of traditional data warehousing. It has big potential, especially as a PaaS offering.

There has been improvement in data resilience, in the way that we're moving the data from on-prem to cloud and vice versa.

The most important feature is that it can help you do the multi-threading concepts. It's in Informatica, but the resourcing is quite robust. You can scale up and scale down as per your needs.

There should be a way that it can do switches, so if at any point in time I want to do some hybrid mode of making any data collections or ingestions, I can just click on a button. I can change a switch and make sure a batch can be a streaming process.

I've been using Azure Data Factory for more than two years.

The stability of Azure as a PaaS could be improved.

It's scalable.

I would rate their technical support 3 out of 5. It's not great, but it isn't bad.

The setup is complex. It has nothing to do with the technology but with the design. We were wondering how to leverage the orchestration layer where we are having the Azure Data Factory and how to integrate with the Databricks. That's where we had some challenges in terms of choosing the right product.

You can do deployment in-house. 

I would rate this solution 8 out of 10.

For someone who is looking to use this solution, my advice is to do proper due diligence of your current application, know where your application is fitting, and look for the requirements. It all depends upon the current use case that you have currently in your system.

I am a manager of a team that uses this solution.

Azure Data Factory is primarily used for data integration, which involves moving data from sources into a data lake house called Delta Lake.

It's fairly simple to use. The most valuable feature of this solution would be ease of use.

It does not appear to be as rich as other ETL tools. It has very limited capabilities. It simply moves data around. It's not very good after that because it's taking the data to the next level and modeling it.

I have been working with Azure Data Factory for less than a year.

I would say that we are working with the latest version.

The stability of Azure Data Factory is good. The performance is good.

I haven't had to scale this solution as of yet.

We have six people in our company who use this solution.

Increasing the usage is not on our strategy pathway.

I have not contacted technical support. I have not required any yet.

I have had very little contact with Microsoft support, but it's been good.

I have also worked with Talend. I didn't switch products, but rather companies.

Talend is a more robust enterprise-wide solution that can handle everything from start to finish, whereas Azure Data Factory is more of an ingestion tool.

I was not involved with the initial setup.

We are an enterprise that uses an integrator.

It does not require any maintenance, it's simple.

I don't see a cost; it appears to be included in general support. I have been told that you have to be very careful because it can blow out. I have not experienced it yet, but I've been warned that as Azure ingestion increases, the costs can rise.

In my opinion, the price is competitive.

It's a good tool, a good product that does what it's supposed to do well, which is ingesting data from a source to your target, to another cloud, to another source. Just be conscious to monitor your costs.

I would rate Azure Data Factory an eight out of ten.

We are currently using it as an ETL (Extract, Transform, and Load) tool. We are using it to connect to various information providers or, in general, to various sources, to extract data, and then to insert it to our storage devices, databases, or data warehouses.

The two most valuable features of Azure Data Factory are that it's very scalable and that it's also highly reliable.

One area for improvement is documentation. At present, there isn't enough documentation on how to use Azure Data Factory in certain conditions. It would be good to have documentation on the various use cases.

Sometimes, it's really difficult to find the answers to very technical questions regarding certain conditions.

I've been using Azure Data Factory since 2019.

It has been stable so far.  

Azure Data Factory is a very scalable solution. Including internal developers and external consultants working for us, we have about 10-15 people using this solution.

We had been using various ETL tools during the years before moving to the cloud. We picked Azure Data Factory because we were moving towards the Azure cloud.

The initial setup is very easy.

We used a consultant as it was a big project. We had five to six specialists, including both internal and external employees, working on it. It took about about three to six months to complete.

Azure Data Factory is a very easy to use tool. If you want to extract, manipulate, and load data to any type of Azure repository, I recommend this solution. However, I would not recommend it if the manipulation of data is very deep and complicated.

I would rate this solution at eight on a scale from one to ten.

We use Azure Data Factory to connect to clients' on-premise networks and data sources to bring the data into Azure. Additionally, Azure Data Factory orchestrates data movement and transformations. It can connect to a number of different cloud data sources to bring the information into something, such as a data lake or a formal SQL database. Azure Data Factory has the ability to handle large data workloads and can orchestrate them well.

The most valuable features of Azure Data Factory are the flexibility, ability to move data at scale, and the integrations with different Azure components.

Azure Data Factory can improve by having support in the drivers for change data capture.

I have been using Azure Data Factory for approximately three years.

Azure Data Factory is a very reliable and stable solution.

The solution is highly scalable.

The technical support is very good, they are responsive.

We previously use Attunity and we switch to Azure Data Factory mainly because of cost reasons and integration.

The biggest difference between Azure Data Factory and Attunity is Attunitys has the ability to perform change data capture. Whereas Azure Data Factory is more centered around batch or bulk loads.

The initial setup is of a moderate level of difficulty. However, it can be complex. The solution is able to fit both of our use cases.

We normally use one or two people to update and maintain Azure Data Factory.

There's no licensing for Azure Data Factory, they have a consumption payment model. How often you are running the service and how long that service takes to run. The price can be approximately $500 to $1,000 per month but depends on the scaling.

My advice to others that want to implement Azure Data Factory is to use a metadata approach.

I rate Azure Data Factory an eight out of ten.

We use this solution to perform ELTs so that we do not need to keep code within a database.

The overall performance is quite good.

Occasionally, there are problems within Microsoft itself that impact the Data Factory and cause it to fail.

I've worked with this solution for two and a half years.

I wouldn't consider it to be stable since it fails at times.

The solution is scalable.

Support is quite slow and they have bugs that they are unaware of and claim that that is how the system is supposed to work.

My company used Informatica PowerCenter in the past but I was not involved in that.

The initial setup was quick and easy. The whole process took about fifteen minutes. We have about a hundred users at the moment and have plans to increase.

Two of our in-house developers were able to complete the setup.

This solution has good performance but could use better stability. I would rate this a nine out of ten.

My primary use cases for this solution are integration and connecting to the different data stores where we get data and migration activity, deployment, and integrations into using linked services and deployment models.

This solution has allowed me to quickly get analysis, sales data, supply chain data, and eCommerce data.

The most valuable feature of this solution is that it allows more data between on-premises and cloud solutions. It's also useful for orchestration for complex data flows and allows us to do ETL-based transitions heavily. In addition, it allows us to integrate with other third-party systems and compare features and pricing. Other valuable features include database replication, SQL service products, SLA support, data sharing, vendor lock-in, and support for developer tools.

Areas for improvement would be the product's performance and its mapping of data flow. In addition, some of the optimization techniques are not scalable, some naming connections are not supported, and automated testing is not supported in all cases. In the next release, I would like to see support so we can enhance based on the next-level pipelines, writing from scratch, flexible scheduling, and pipeline activity.

I've been using this solution for about a year.

This solution is very reliable.

This solution is scalable.

I am satisfied with the technical support.

I previously worked with Azure SQL database.

The initial setup was complex, but the deployment only took 30 to 40 minutes.

This product is priced at the market standard, which is good given that the product contains all the available assets.

When selecting services, make sure to choose only those you need in order to reduce your costs. I would rate this solution as seven out of ten.

We generally implement this product for data transformation for our clients. We create the pipelines and provide training before handing it over to them. We generally deal with large-scale organizations. I'm a senior solutions architect. 

I think the main benefit of this solution is the ease of use, especially for companies that have come from an SSIS type of background where they are used to Microsoft tools. 

If you have a very simple pipeline you can use Data Factory for transformations, but it's really for serious analytics. This is an excellent tool for pipeline orchestration; connecting the different components and activities as well as gathering data. It's an orchestration tool, not a transformation tool. The monitoring feature has drastically improved.

Data Factory is embedded in the new Synapse Analytics. The problem is if you're using the core Data Factory, you can't call a notebook within Synapse. It's possible to call Databricks from Data Factory, but not the Spark notebook and I don't understand the reason for that restriction. To my mind, the solution needs to be more connectable to its own services.

There is a list of features I'd like to see in the next release, most of them related to oversight and security. AWS has a lake builder, which basically enforces the whole oversight concept from the start of your pipeline but unfortunately Microsoft hasn't yet implemented a similar feature.

I've been using this solution for five years. 

From what I've seen this is a stable solution. 

The solution is easy to scale keeping in mind that Data Factory doesn't do any computations. We use it mainly to push the computations to Databricks or Synapse. Projects with our clients generally last a few months and only until they go into production. I believe the ability to increase is always there.

We typically do not use customer support, but there were a few cases several years ago as the product was moving to the cloud that things were not so stable and we contacted support services - they were very good. 

When I first started in this field, everything was basically Hadoop on-premise and Hadoop infrastructure. With the increase in cloud integrations, things have changed. Once the big data services got introduced, we were probably one of the few companies in North America that were actually into analytics and big data and we were the first to implement related Microsoft products in Canada.

The initial setup is straightforward. I'm a huge fan and user of CI/CD pipelines and never do deployments manually. It's all automated and deployment takes a few minutes.

Licensing costs of Data Factory are reasonable. The cost is mainly on the Synapse and Databricks side of things because they are the tools where the computations are done and where you need more nodes and servers.

It's important to study the solution before purchasing it. The problem in this market is that because most users are generally not very knowledgeable, they typically fall for services that are not compatible with their use case. Data Factory comes with all the transformations but that doesn't work for serious analytics customers who generally need to resort to Databricks or Synapse which involves training and education. Since it's a new field and everything has just blasted off, it's very hard for people to catch on.

In my opinion, Airflow still ranks as number one but I would rate Data Factory an eight out of 10.