• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2023-2024
  • Sponsored Post
    • Make a Contribution
  • Technology Jobs
  • Technology Markets
    • Venture Capital
  • About
  • Contact

AWS Lake Formation makes it easy for customers to build secure data lakes in days instead of months

August 9, 2019 By admin Leave a Comment

Today, Amazon Web Services, Inc. (AWS), an Amazon.comcompany (NASDAQ: AMZN), announced the general availability of AWS Lake Formation, a fully managed service that makes it much easier for customers to build, secure, and manage data lakes. AWS Lake Formation simplifies and automates many of the complex manual steps usually required to create a data lake, including collecting, cleaning, and cataloging data, and securely making that data available for analytics. Customers can easily bring their data into a data lake from a variety of sources using pre-defined templates, automatically classify and prepare the data, and centrally define granular data access policies to govern access by the different groups within an organization. Customers can then analyze this data using their choice of AWS analytics and machine learning services, including Amazon Redshift, Amazon Athena, and AWS Glue, with Amazon EMR, Amazon QuickSight, and Amazon SageMaker following in the next few months. There are no additional charges required to use AWS Lake Formation, and customers pay only for the underlying AWS services used. To get started with AWS Lake Formation, visit: https://aws.amazon.com/lake-formation.

Panasonic, Amgen, and Alcon among customers using AWS Lake Formation
Customers want to be able to perform analytics and machine learning across all of their data, regardless of the format or where the data lives. A data lake removes data silos and allows data to reside in a central place so customers can more easily apply different types of analytics and machine learning across all of their data. Amazon Simple Storage Service (Amazon S3) has become a very popular place for customers to build data lakes because of its scale, cost-effectiveness, durability, and easy integration with AWS’s analytics and machine learning services. However, even with those significant benefits, building and managing a data lake can still be a complex and time-consuming process. Customers need to provision and configure storage, move data from disparate sources into the data lake, and extract the schema and add metadata tags to make it accessible from a searchable data catalog. In order to do so, customers must clean and prepare the data – including partitioning, indexing, and transforming the data – to optimize the performance and cost that comes with running analytics on the data. Then, they have to set up data access roles and enforce security policies across their storage and each of their different analytics engines, and update the security policies when permissions change or new end users are added. And, finally, customers are required to make the data available in a secure way to their data analysts so that they can analyze and process the data using any of the available analytics engines. These steps require customers to perform a lot of manual work, and as a result, most customers can take up to several months to set up a data lake.

AWS Lake Formation significantly simplifies the process and removes the heavy lifting from setting up a data lake. AWS Lake Formation automates manual, time-consuming steps, like provisioning and configuring storage, crawling the data to extract schema and metadata tags, automatically optimizing the partitioning of the data, and transforming the data into formats like Apache Parquet and ORC that are ideal for analytics. AWS Lake Formation cleans and deduplicates data using machine learning to improve data consistency and quality. To simplify data access and security, AWS Lake Formation provides a single, centralized place to set up and manage data access policies, governance, and auditing across Amazon S3 and multiple analytics engines. To reduce the time analysts and data scientists spend hunting down the right data set for their needs, AWS Lake Formation provides a central, searchable catalog which describes the available data sets and their appropriate business use. Customers can now easily access data from a single place and integrate with their choice of AWS analytics and machine learning services, including Amazon Redshift, Amazon Athena, and AWS Glue, with Amazon EMR, Amazon QuickSight, and Amazon SageMaker following in the next few months. With AWS Lake Formation customers can set up and begin using a data lake in days instead of months.

“Our customers tell us that Amazon S3 is the ideal place to house their data lakes, which is why AWS hosts more data lakes than anyone else – with tens of thousands and growing every day. They’ve also told us that they want it to be easier and faster to set up and manage their data lakes,” said Raju Gulabani, Vice President, Databases, Analytics, and Machine Learning, AWS. “That’s why we built AWS Lake Formation, so customers can spend more time learning from their data and innovating, rather than wrestling that data into functioning data lakes. AWS Lake Formation is available today and we’re excited to see how customers use it as one of the building blocks for growing and transforming their businesses and customer experiences.”

AWS Lake Formation is available today in US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Tokyo), and Europe (Ireland) with additional regions coming soon.

Panasonic Avionics Corporation is the world’s leading supplier of in-flight entertainment and communication systems. “We wanted to create a data platform with the ability to manage the security settings for all the different applications in our environment. With AWS Lake Formation, we can now define policies once and enforce them in the same way, everywhere, for multiple services we use, including AWS Glue and Amazon Athena,” said Anand Desikan, Director of Cloud and Data Services, Panasonic Avionics. “The enhanced level of control gives us secure access to data and meta-data for columns and tables, not just for bulk objects, which is an important part of our data security and governance standard.”

Amgen is the world’s largest independent biotechnology company. “At Amgen we’ve been heavy users of Amazon Redshift, Amazon EMR, and Databricks clusters for over three years. Setting up security and access controls for each AWS account, service, user, and data set at the level of detail that was required could be cumbersome,” said Kerby Johnson, Enterprise Data Lake Product Owner, Amgen. “AWS Lake Formation streamlines the process with a central point of control while also enabling us to manage who is using our data, and how, with more detail. AWS Lake Formation allows us to manage permissions on Amazon S3 objects like we would manage permissions on data in a database. Our users will be able to find, access, and analyze the data they need with the tools they prefer. This new workflow can make everyone more productive when using Amgen’s data.”

Alcon is a leader in innovation and development of life-changing vision and eye care products. “Like a lot of companies, we started our data lake initiative to get away from having inaccessible silos of data,” said Srinivas Ravilisetty, IT Analytics Lead, Alcon. ”With AWS Lake Formation we can quickly add access to existing Amazon S3 buckets and define what’s in them and how it can be used. The data remains in place in S3, but we have full control over it for other uses.”

Life360 is the world’s leading peace of mind service for families. The Life360 app brings families closer with smart features designed to protect and connect the people who matter most. “We wanted to use AWS Lake Formation to build our data lake for supporting location-based time-series data, and make it much easier to load data. The pre-fabricated blueprints helped get data into the data lake without our data engineering team having to write code from scratch, so they could focus on operationalizing ingest, not reinventing the wheel,” said Richard Chennault, Head of Cloud and Data Services, Life360, Inc. “With AWS Lake Formation we were able to quickly unlock data available in Amazon S3 and make it available to analyze across a broad spectrum of AWS data services. The data remains in place in Amazon S3, we can analyze it in many different ways, and we maintain full control over it.”

Zalando is Europe’s leading online platform for fashion and lifestyle. “As Europe’s most fashionable tech company, we work hard to find digital solutions for every aspect of the fashion journey,” said Alberto Miorin, Engineering Lead, Zalando SE. “AWS Lake Formation gave us a scalable central point of control for data access through Amazon Redshift that not only simplified the process, but improved it through granular control over how our data is being used. Now we can discover, access, and analyze data in our data lake with our preferred tools, and leverage it for business intelligence and data science. This streamlined workflow helps our executives make the right decisions on time, and fosters innovation through machine learning.”

Accenture is a leading global professional services company, providing a broad range of services and solutions in strategy, consulting, digital, technology, and operations. “I focus on helping clients in their ‘Data on Cloud’ journey. Specific to that, we have seen that organizations are dealing with a lack of trusted data when they need to perform analytics on data coming from multiple sources,” said Namrata Maheshwary, Senior Architect for the Data Business Group, Accenture. “Data cleansing is a critical step in data analytics and can greatly impact the business outcome and decision making. The new features in AWS Lake Formation have been hugely beneficial to address the challenge of data veracity and securing access to the data lake. We found it tremendously useful to make use of the advanced machine learning techniques for data preparation to find matching records, clean, and deduplicate data from different data sources. This will help reduce the time, effort, and cost, while improving the quality and accuracy of the data in a customer’s data lakes.”

Quantiphi is an Artificial Intelligence and Big Data software and services company driven by the desire to solve complex business problems. Quantiphi specializes in building data lakes and AI solutions for customers to deliver quantifiable value. “AWS Lake Formation allows us to deliver a secure data lake with access to relevant data in days,” said Arnav Gupta, AWS Practice Lead, Quantiphi. “We now have the ability to deliver the best of both worlds for our customers – full security, plus simplified access to relevant data for their users to make decisions easily. Our customers can focus on making smarter, analysis-driven business decisions by tapping into a powerful, centralized data source.”

Source: Amazon

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Market Analysis

DevOps and Agile: Integrating Development and Operations
China’s Use of Golden Shares: From Reducing State Role to Quietly Controlling Tech Giants
Why Amazon Acquired One Medical: Disrupting the Healthcare Industry with Technology-Enabled Care
The End of an Era: Why China is No Longer Viable as the World’s Factory
Cloudflare’s FedRAMP authorization opens up a huge market opportunity in the US government sector
Datadog’s strong financial results for the fourth quarter and fiscal year 2022 provide a solid case for a Buy recommendation
Cisco: Struggling to find new avenues of growth

Market Research Media

Agile Leadership: Leading Agile Teams for Success
Chinese Brands Reach New Heights of Popularity in the West Amid Growing Political Tensions
Unrestricted Streaming: How VPNs Can Enhance Media Consumption Experience
How the world’s biggest companies have built and defended their moats
Virtual Learning Environments: A Game-Changer in Education?
Streaming video, training, and gaming coming together to form a cohesive and diverse media and entertainment ecosystem
Turn Your Story into a Game: The Art of Gamifying Your Plot

Secondary Sidebar

Tech Events

Splash User Conference and Partner Summit will take place from April 17 to 20, 2023 in Washington, D.C.
Fiber Connect 2023, August 20-23 2023, Orlando, Florida
International Battery Seminar & Exhibit (IBSE) on March 20-23, 2023 in Orlando, FL
MIT Technology Review’s Future Compute event, April 30 – May 1, 2023, MIT Campus, Cambridge, Massachusetts
13th Annual 2023 State IT Connect Summit in Baltimore, Maryland, from March 6-8, 2023

Venture Capital

African Venture Investment Soars to Record High, Fueled by Tech Startups
Pitchly Secures $7 Million Series A Funding for SaaS-Based Data Enablement Solution
Agile Project Management: Roles and Responsibilities
Candidly, a student debt and savings optimization platform, has raised $20.5 million in a Series B round of financing
GameTech Startups Attracting Venture Capital Funding: The Importance of VPN Security

Footer

Recent Posts

  • Cloudflare Enters Fraud Detection Market with Cloudflare Fraud Detection
  • Devices utilizing Wi-Fi HaLow technology are gaining momentum
  • Agile Software Development Tools and Technologies
  • Continuous Integration and Continuous Delivery in Agile
  • NuScale Power places first long lead material production order for the manufacture of SMR
  • Potential Applications That Could Accelerate the Adoption of 6G Technology
  • The Need for 6G Technology: Challenges and Opportunities
  • Game Programmer
  • Marketing Automation Specialist
  • Unlock the Power of VPNs: Join our Workshop and Master the Latest VPN Technologies!

App Coding

The Benefits of Cross-Platform Mobile App Development
Cybertech 2023 in Tel Aviv: Navigating the Challenges of App Security
Starting Your Coding Career: The Best Programming Languages to Learn
The Importance of Mobile App Security
App Development Workshop: A Comprehensive Program

API Coding

The Importance of API Programming in Today's Digital World
Streamlining Your Workflow with API Integrations: Benefits and Best Practices
Freedom, Flexibility, and the Thriving World of API Development
Up the Ante by Creating Your Own API for a Wide Audience
Cybertech 2023 in Tel Aviv: Securing the Future with API Security

Blockchaining

Unlocking the Power of Engagement: Exploring the Connection between Gamification and Blockchaining
What are DLT ledgers?
Cryptocurrency has become a global phenomenon with a market capitalization of almost $3 trillion at its peak in November 2021
How safe are NFTs as digital assets
Building a Secure and Decentralized Blockchain API: A Step-by-Step Guide

Event Calendar

ProMat 2023, the leading trade show for the manufacturing and supply chain industry, March 20-23 2023, Chicago’s McCormick Place
Prints 2023, Printing Conference, March 3, 2023
Milan Design Week 2023, April 17-23 2023, Milan, Italy
The New York International Auto Show, April 7-16 2023, Jacob K. Javits Convention Center
Chicago Auto Show 2024, February 10-19, 2024, McCormick Place, Chicago

Copyright © 2022 Technologies.org

Media Partners: Market Analysis & Market Research and Exclusive Domains

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT