AWS Lake Formation Reviews

We are the review platform and informational platform that works with different vendors to collect thoughts and opinions on products. We have partnered with AWS and are helping them collect feedback regarding AWS Lake Formation solutions.

In my recent projects, I have over seven years of experience working as an AWS data engineer. I have used all AWS services throughout my projects according to requirements. I have used AWS Glue to build robust pipelines and Lambda to trigger the pipelines when an event occurs. I have also used Apache Airflow to automate all pipelines. Additionally, I have utilized SNS (Simple Notification Services), Amazon QuickSight, and Oozie. All these services have been implemented in my project according to their specific uses.

AWS Lake Formation has the ability to automatically classify and enforce security policies on the data.

There are areas that could be improved in AWS Lake Formation, and functionality that could be included in future releases.

I have been using the solution for two years.

The initial setup of AWS Lake Formation had some challenges.

There have been improvements with the speed of deploying BI tools and ML applications with AWS Lake Formation.

The technical support from Amazon has been discussed.

Positive

The initial setup of AWS Lake Formation presented some challenges.

We have observed measurable benefits in terms of cost savings, time savings, resource savings, and efficiency improvements in our workflows.

The pricing structure of AWS Lake Formation has been considered.

I have experience working with cloud databases and data lake storages from other vendors. When comparing AWS with Azure and Snowflake, there are distinct advantages and disadvantages to consider with each platform.

I have recent experience with AWS Lake Formation and have worked with its centralized repository. The integration experience with S3, Glue services, and IAM has been noteworthy.

The overall rating for AWS Lake Formation is 4 out of 10.

I am an end user of AWS Lake Formation. We use AWS Lake Formation to control all our data lake at the UOL company. We use AWS Lake Formation to control privacy and build privacy controls. We split information based on user roles, and AWS Lake Formation ensures that users can access only specific data. Beyond that, we use AWS Lake Formation to control our schemas. By controlling schemas, we define the types of data we input. For instance, we have schema control that determines which field is char and which field is int. We use AWS Lake Formation to control that and input descriptions in these fields. For instance, if we have a table called sales with a field ID, our team inputs what this field means in the application. ID means the number of identification of our student or client. We use AWS Lake Formation to manage permissions and governance.

In our company, we use AWS Lake Formation just to manage data. We use other solutions to transform data.

Without doubt, the privacy control of AWS Lake Formation is most valuable. In Brazil, as in other countries with LGPD or GPDR and other types of laws that we need to follow, I can make sure we are compliant using AWS Lake Formation. This is a very important and useful feature.

These features of AWS Lake Formation currently solve all our issues and challenges to be compliant with laws. The capabilities we already have are enough for us.

In our case, all the features of AWS Lake Formation that we use in other services, for instance, Athena, are based in AWS Lake Formation. It is very useful as AWS Lake Formation controls all our information in the data lake.

To provide more context, all of our company's decisions are made based on our data, which is managed by AWS Lake Formation. We make many decisions and generate numerous insights for the company based on this data managed by AWS Lake Formation.

There is a specific issue when we list the tables and database in AWS Lake Formation regarding the UI. When we list tables, and to provide context, here and in many companies, we have numerous tables and schemas. This large amount of tables generates a long list. The UI of AWS Lake Formation is not very responsive. The UI has a lag when showing information, when clicking from one page to another, or when trying to find information. There is a search box at the top of the page, and when we type, searching for a sales table for instance, the response takes a long time. This complaint is not exclusive to AWS Lake Formation, but we observe this behavior in AWS Lake Formation as

For more than three years.

I do not use AWS Lake Formation's ability to automatically classify data and enforce security policies.

From zero to ten, I would rate the stability and reliability of AWS Lake Formation as nine.

The scalability depends on how the solution is deployed. AWS Lake Formation has been updated more than three times. We are currently on the third version. In this third version, they released many improvements that afford larger scalability. While previous versions were not as capable of scaling, based on this last version, it is very scalable.

I have interacted with their support team. Our support for AWS Lake Formation is either business or premium level, based on our contract. When we ask for help, they respond almost immediately with a first response. Based on my previous experience, I would rate the support nine out of ten.

Positive

I used a Hive solution for these use cases a long time ago, but it is outdated now. I have worked with AWS Lake Formation for more than three years.

I moved from another company that used Cloudera, which is a different type of infrastructure where we used Hive for managing the data catalog. At my current company, I use AWS Lake Formation. Comparing both solutions, AWS Lake Formation is more robust and easier to manage than the previous solutions I used.

Based on the values that AWS Lake Formation has for us, I think it is fair enough.

I would rate AWS Lake Formation nine out of ten based on everything we have discussed.

I am the Data Engineering Manager at UOL Edtech.

I will be able to manage my review, and it is acceptable for me to make my review public.

When it comes to AWS Lake Formation, it is about different ways AWS can help create, manage, and help with the data transformation that clients are looking for.

There are many use cases around Lake Formation. Typically, clients are reimagining their entire process from the standpoint of user experience, infrastructure duplication, and data duplication. Often, data isn’t organized properly, which affects both the user experience and infrastructure. So, when they’re reimagining their data strategy, one of the conversations revolves around Lake Formation.

Lake Formation is essentially about creating a centralized repository. It allows you to structure your back-end repository, whether the data is structured or unstructured. You can scale it and manage it effectively. It also covers securing your data and implementing various cataloging mechanisms for quick data retrieval. So, Lake Formation is crucial when clients are reimagining their data landscape.  

Another product is Amplify. Amplify is more focused on the developer experience, especially when transitioning from a traditional waterfall model to more agile methodologies like DevOps or DevSecOps. It supports full-stack development for both web and mobile applications.

AWS Amplify offers a lot of automation capabilities. It keeps the developer experience at the forefront, providing automation for CI/CD pipelines, many out-of-the-box features, and seamless API integrations. Amplify handles these with native capabilities, making it a powerful tool for developers.

There are a couple of areas for improvement with Lake Formation. One of the main challenges, especially when dealing with rich media content, like in MarTech (Marketing Technology) or ad agencies, is its versatility. Some clients feel that Lake Formation doesn’t meet their needs and they tend to prefer competitor products for those specific use cases.

The second area for improvement is in data governance. Specifically, Lake Formation could enhance its capabilities in audit logs, real-time monitoring, and advanced data governance. This includes managing the entire data lineage—where the data originated, how it moves, and where it’s currently stored. The visibility of the data as it evolves is crucial, and that’s where more advanced governance capabilities would be beneficial.

I have a pretty good understanding of the entire AWS suite. I’ve been working with AWS for many, many years, if not almost a decade.

When cloud providers like AWS started, there were a lot of skeptics, including myself. For instance, the data center AWS was never going to move. 

And then, fully and surely, we changed our own perspective and the client’s perspective. So it’s been quite a long journey, and I’ve been through the journey for over ten plus years.

As AWS customers, we typically handle the initial sale. From what I understand, Lake Formation is highly scalable.  

It's fairly easy to use for people who have been trained on it. But again, we're moving closer to the technical user and the non-technical user divide.

What my teams tell me is that when we go to sell and the client has AWS-certified staff, they say, "Hey, this is easy to use." Lake Formation is fairly intuitive. However, as AWS expands and more users start using Lake Formation, there is a need for some democratization. This would allow business users, like product managers, to access the system without needing developers or technical staff.

I think there's a need for more pre-configured templates to really democratize the usage—not for the formation of the lake itself, but for retrieving complex queries. More templates and pre-configured queries could allow more users to interact with the system.

The pricing really depends on the kind of contract you have with AWS and who is selling you the AWS services. There are many ways to consume AWS services. It depends on whether you have an enterprise license, if you're buying direct, if you're using Lake Formation or other products. It's not an easy answer to give because there are so many variables.

In general, though, AWS Lake Formation works hand in hand with other products. You're not just paying for Lake Formation; you also need S3, Glue, Athena, and other services to get the full value out of the data lake. No one buys a data lake just to store data—it’s actively used to retrieve, query, and gain insights that provide a competitive edge. So, the pricing becomes a bit complex because it involves more than just Lake Formation.

Overall, I would rate the solution a seven out of ten, with ten being the best and one being the worst, because there are a few shortcomings. Many clients are moving away from using just one hyperscaler to multiple hyperscaler, so hybrid cloud scenarios are becoming more common. Lake Formation would need to integrate with not just AWS, but also with other hyperscalers, whether it's on-premise, off-premise, or in the cloud. Scalability and integration with competitors are important factors.

Then, there is data governance and the need to support more data formats. As the use cases expand from core IT data to other business functions, like CAD/CAM drawings or marketing with rich content and videos, Lake Formation needs to support these versatile data formats. It seems limited in terms of the data formats it can support.

I use AWS Lake Formation primarily for data lakes.

Since using data lakes on AWS, I have not experienced a single breach. Additionally, I have had zero downtime for the last year and a half.

The most valuable features of AWS Lake Formation are its reliability and the ability to make a backup of the data lake. I can easily move data from cold storage to regular storage. I also like its stability, as I have not had a single downtime in a year and a half.

If I could improve AWS Lake Formation, I would add more integrations with SageMaker. I would have built-in functions that provide statistics for the data when using the GUI, such as SageMaker Insights.

I have been using AWS Lake Formation for about a year and a half.

The stability is unbeaten, as I have had zero downtime for a year and a half.

I use the CLI and find it easy to scale up or down.

I have not talked to their support team at all.

I used OpenStack for data storage previously, where I experienced expected downtimes of around one to two times per month.

From my experience, deploying and setting up AWS Lake Formation is about a medium difficulty. I program the actual interfaces using the CLI.

The pricing is expensive compared to OpenStack, but cheaper than other cloud environments. It's middle-of-the-road for regular storage yet very cost-effective when using Amazon Glacier for data.

I would not recommend AWS Lake Formation to others as it gives me an advantage.

I'd rate the solution seven out of ten.

I would be happy to share the main use cases for AWS Lake Formation and what it is used for.

AWS Lake Formation has several valuable features that enhance data management. One particularly beneficial aspect is how it facilitates better collaboration within data teams. The solution provides specific features that support team coordination and data sharing capabilities.

There are areas of AWS Lake Formation that could be improved or enhanced in the future. Information about the pricing, cost, and setup cost of the AWS solutions would be beneficial.

[Full sentence answer to 'For how long have I used the solution?' from the text.]

The integration with IAM for authentication and authorization is worth mentioning. When concerns or technical questions arise, these can be escalated to the AWS team and technical support or customer service team.

Based on experience with AWS services, I can share advice and recommendations with other users who are looking to implement AWS Lake Formation for their environment.

PeerSpot is a review platform and informational platform that hosts reviews from real users on different types of solutions. There is a partnership with AWS to open new categories regarding different AWS services. The feedback is published on peerspot.com, and users have access to edit their contributions. The feedback is also provided to AWS about customer experience, what customers appreciate about the solution, and what improvements they would to see implemented.

It primarily focuses on managing data permissions and entitlements and plays a crucial role in data control and governance within AWS. Once our data is stored in the cloud, we grant access to various users and applications for various purposes, such as analytics, reporting, or other data-driven activities. To manage these access patterns, we define permissions either by giving direct access to users or by creating roles via AWS IAM which can be configured within AWS Lake Formation.

It is seamlessly integrated within the AWS ecosystem, making it straightforward to manage access patterns for AWS-native services.

There are significant challenges when dealing with external applications, and vendors, or pursuing a hybrid cloud strategy because AWS Lake Formation is specific to AWS and does not integrate seamlessly with third-party services or other cloud providers. Another limitation is that Lake Formation might not offer out-of-the-box automated reporting, so you may need to create your solutions for tracking and reporting on permissions granted to users. It falls short when it comes to more granular access control, such as cell-level or row-level entitlements which is a significant drawback for organizations that require precise control over who can access specific rows of data.

I have been working with it for three and a half years.

You can reach out to AWS support through support tickets, and their response time is generally quite efficient. Typically, you can expect a response within a few hours, sometimes even on the same day, and at the most, by the next day. Also, if your organization is a significant AWS customer, you may have recurring calls with AWS account managers. These calls provide an opportunity to discuss service roadmaps and request specific features or enhancements for a service. AWS takes these requests seriously and may prioritize them on its roadmap, often opening a feature request and providing a timeline for its implementations. I would rate it seven out of ten.

Neutral

Our company has adopted both AWS and Azure, and we are looking for a solution that aligns strategically with our multi-cloud environment. While there are certain drawbacks with AWS Lake Formation, especially in terms of integration and fine-grained access control, it's essential to choose a solution that works cohesively in this hybrid cloud setup.

While AWS Lake Formation may have certain drawbacks, especially when it comes to integration with external systems and cell-level entitlements, it can still be a valuable choice if your use case is entirely AWS-native. In such cases, it's recommended to leverage the native AWS services available for managing data access and governance. However, if you're operating in a multi-cloud environment with Azure in the mix, it might be more beneficial to explore alternative solutions that offer better integration and more extensive access control capabilities. Overall, I would rate it six out of ten.

AWS Lake Formation is used to manage access to data lakes on the AWS platform, on AWS Cloud. AWS Lake Formation uses the Glue service underneath to manage data access and metadata about the data. It grants permissions for data stored in the data lake, making data sharing with different entities, users, or groups convenient. We use AWS Redshift to access data in S3 with Lake Formation permissions.

AWS Lake Formation is a security mechanism for accessing databases and tables on S3. It is similar to relational database technologies, offering familiarity and ease of use in the data world. It centralizes access management, simplifying complex governance.

The tag-based access control option is an improvement over previous solutions such as raw Glue and S3 permissions. AWS Lake Formation also supports secure data access, which works effectively with our automated infrastructure as code processes.

AWS Lake Formation might not be easy to learn initially, especially for technical staff, due to various underlying options. There were errors and bugs, sometimes making data access challenging. AWS support often helped resolve these issues.

Extending AWS Lake Formation's scope to non-AWS services could enhance its flexibility, but this hasn't been considered yet.

The solution has been in use for three years, two years, and two years respectively.

Initial issues were reworked or redesigned. For the past two years, AWS Lake Formation runs smoothly without significant problems.

The support team is highly skilled and proactive, willing to help. While colleagues reported mixed experiences, my interactions have been consistently positive.

Positive

Initially, the data platform ran without AWS Lake Formation. However, exact details from previous projects are not recalled.

The learning curve was challenging. Migrating to tag-based access control required learning new methods. Initially, we utilized named resources before switching to tag-based access control for its advantages.

AWS Lake Formation has been on the market for about three to four years. It's mature, continuously evolving, and recommended by AWS for building data platforms. It offers centralized access management reducing complexity, allowing access sharing across AWS accounts, aiding growth.

AWS Lake Formation offers flexible access, including column and row-level restrictions. Compatibility is limited to specific AWS services.

The cost impact of Lake Formation is negligible compared to other services. It's primarily a security-focused service, with cost-effectiveness being more relevant elsewhere on AWS.

Planning a big data platform should consider AWS Lake Formation from the start as it assists in setting up efficient data management solutions.

I rated the solution a nine out of ten. However, I may need more time to finalize my decision, pending a more comprehensive review.

Our data team uses the solution for ETL jobs.

AWS Lake Formation lets you see all your data and tables on one screen. It's a good product to have everything under one service. In order to be able to do ETL jobs and create some tables from the S3 buckets, you have to use a few different services. With AWS Lake Formation, you can merge everything into one single service and have all your data under that service.

Not everybody can use AWS Lake Formation. You need to have data experience to use the product.

I have been using AWS Lake Formation for five years.

We haven’t faced any issues with the solution’s stability.

The solution’s technical support is very good.

The solution's initial setup is not that hard. Depending on your setup, you need some experience to deploy the solution.

I would recommend the solution to other users.

Overall, I rate the solution a nine out of ten.