• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2023-2024
  • Sponsored Post
    • Make a Contribution
  • Technology Markets
    • Venture Capital
  • About
  • Contact

AWS Announces General Availability of Amazon Managed Streaming for Apache Kafka (Amazon MSK)

May 31, 2019 By admin Leave a Comment

Today, Amazon Web Services Inc., an Amazon.com company (NASDAQ: AMZN), announced the general availability of Amazon MSK, a fully managed service for Apache Kafka that makes it easy for developers to build and run highly available, secure, and scalable applications based on Apache Kafka without having to worry about managing the underlying infrastructure. Amazon MSK is fully compatible with Apache Kafka, enabling customers to easily migrate their on-premises or Amazon Elastic Cloud Compute (Amazon EC2) clusters to Amazon MSK with no code changes. There are no commitments or upfront investment required to run Amazon MSK, and customers only pay for the capacity they use. To get started with Amazon MSK visit https://aws.amazon.com/msk.

Customers use Apache Kafka to capture and analyze real-time data streams from a range of sources, including IoT devices, website clickstreams, financial systems, and database logs. While many customers chose to self-manage their Apache Kafka clusters, they often spend a lot of time and expense securing, scaling, patching, and ensuring high availability for Apache Kafka and Apache ZooKeeper clusters, which Apache Kafka depends on for resource management. Amazon MSK gives customers all of the attributes of Apache Kafka combined with the availability, security, and scalability of AWS. With just a few clicks, customers can create Apache Kafka clusters designed for high availability that span multiple Availability Zones (AZs). Amazon MSK continuously monitors underlying server health, automatically replacing servers when they fail and patching servers in need of updates. Amazon MSK also runs highly available Apache ZooKeeper nodes at no additional cost. Amazon MSK provides multiple levels of security for Apache Kafka clusters, including VPC network isolation, AWS Identity and Access Management (IAM) for AWS Application Programming Interface (API) authorization, encryption at rest, encryption in-transit, TLS based certificate authentication, and authorization using Apache Kafka access control lists (ACLs). Customers can easily scale out cluster storage with a few clicks in the AWS management console to meet changes in demand. Amazon MSK is fully compatible with Apache Kafka, allowing customers to continue to run applications built on Apache Kafka, use Apache Kafka compatible tools and frameworks, and take advantage of new Apache Kafka innovations, without having to change their code.

“Customers who are running Apache Kafka have told us they want to spend less time managing infrastructure and more time building applications based on real-time streaming data,” said Rajesh Sheth, General Manager of Amazon MSK, AWS. “Amazon MSK gives these customers the ability to run Apache Kafka without having to worry about managing the underlying hardware, and it gives them an easy way to integrate their Apache Kafka applications with other AWS services. With Amazon MSK, customers can stand up Apache Kafka clusters in minutes instead of weeks, so they can spend more time focusing on the applications that impact their businesses.”

Customers start by creating a cluster in Amazon MSK today using the AWS Console or the AWS CLI, and Apache Kafka clients can connect to a cluster using Apache Kafka’s open-source APIs. Amazon MSK is available in the US East (N. Virginia), US East (Ohio), US West (Oregon), EU (Ireland), EU (London), EU (Frankfurt), EU (Paris), Asia Pacific (Tokyo), Asia Pacific (Singapore), and Asia Pacific (Sydney), and will expand to additional AWS Regions in the coming year.

Vonage is a global business cloud communications leader providing integrated communications solutions that improve how business gets done by enhancing a company’s customer and employee experience. Vonage uses Apache Kafka for real-time communication between various micro-services. “By using Amazon MSK, we reduced our maintenance overhead and built a micro-services-based platform that enables businesses to collaborate more productively and engage their customers more effectively,” said Venkatesh Ennala, a software engineer with Vonage. “We can now set up new Kafka clusters more quickly and scale these clusters as our demands increase. Amazon MSK has removed the complexity of set up and maintenance, allowing us to focus on what’s most important – building innovative new capabilities for our customers.”

Secureworks (NASDAQ: SCWX) is a technology-driven cybersecurity leader that protects organizations in the digitally connected world. “When developing and launching our security analytics application, Secureworks chose Amazon MSK service to accelerate time to market and reduce infrastructure and management overhead,” said Wendy Thomas, Senior Vice President of Business and Product Strategy at Secureworks. “This allowed us to focus on innovation and our unique differentiators, helping protect our customers from cyber threats.”

Poshmark is a leading social commerce platform for the next generation of retailers and shoppers. “Through technology, our mission is to build the world’s most connected shopping experience, while empowering people to build thriving retail businesses. Amazon MSK has made it easy to setup, maintain and scale Kafka clusters, enabling an end-to-end data ingestion pipeline supported by a fully-managed service,” said Mahesh Pasupuleti, Senior Director of Data Engineering at Poshmark. “As our demands increase, we feel confident that we will be able to scale at ease and expand our streaming ingestion pipelines for data enrichment and real-time machine learning, providing an enhanced experience for our customers.”

Nutmeg is Europe’s largest digital wealth manager, helping consumers to grow their wealth and reach their financial goals by using cost effective technology to boost returns. Nutmeg uses Apache Kafka to underpin their journey towards an event driven architecture. “Since adopting Amazon MSK, we’ve been able to significantly increase the efficiency of our teams and reduce time spent maintaining our cluster,” said Matt Gatrell, CTO of Nutmeg. “As our data requirements and use cases grew, we started to experience considerable overhead and complexity in managing our Kafka clusters. Amazon MSK has allowed us to manage our clusters with confidence, spend less time verifying the performance of the clusters, scale with ease, and focus more time on innovating and building exciting real-time applications.”

Compass is a real estate technology company with a powerful end-to-end platform that supports the entire buying and selling workflow. Compass uses Apache Kafka to provide its agents with quick access to fresh and accurate data from hundreds of real estate data sources nationwide. “Streaming technology is an important part of what we do as a business, but managing streaming technology involves a lot of heavy lifting by our software developers,” said Joseph Sirosh, CTO of Compass. “Amazon MSK has allowed us to eliminate a lot of this heavy lifting. By using Amazon MSK we no longer need to spend effort on ensuring data durability, cluster availability, and scalability, and can now focus on building applications. Amazon MSK relieves our team from the burden of operating and maintaining Kafka and at the same time, we experience less downtime as our clusters are fully-managed.”

Source: Amazon Web Services
aws.amazon.com

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Market Analysis

The Future of Food: Top Trends to Watch in 2023 and Beyond
How to discover the treasure trove of hidden marketing insights by watching customer behavior
Navigating Uncertainty: Prioritizing Hydrogen R&D Efforts for a Sustainable Future
Unleashing the Hidden Talent Pool: The Rise of STARs – Skilled Through Alternative Routes
United Against China: Japan and the Netherlands to Join US in Restricting Semiconductor Exports
Revolutionizing Agriculture: How CRISPR is Changing the Game
The ticking time bomb: Understanding the demographic challenges facing our planet

Market Research Media

Turn Your Story into a Game: The Art of Gamifying Your Plot
The end of cheap money is redrawing the map of corporate earnings
The Future of Virtual Reality: How VR is Changing Industries
Market Research Media Survey: The State of Streaming Services
Media measurement services provide a holistic view of cross-media consumption
Gen Z ranks top in luxury sales
How to market recycled products

Secondary Sidebar

Tech Events

Chiplet Summit, January 24-26 2023, the Doubletree by Hilton San Jose Hotel
Flagship Community Conference for the Leading Open Source Browser Automation Standard Returns to In-person Event in Chicago, March 28-30, 2023
The 2nd annual Connecting Green Hydrogen Europe 2023 will Take Place 5th – 6th July 2023 at Riu Plaza España Madrid, Spain
DesignCon, the nation’s must-attend event for chip, board and systems design engineers, Jan. 31- Feb. 2 2023, Santa Clara Convention Center
Chiplet Summit, January 24-26, 2023, Doubletree by Hilton, San Jose

Venture Capital

The Importance of Diversity and Inclusion in the Workplace
Sequoia Capital announces its $195 Mln dedicated seed fund
Sublime Systems Secures $40 Million Series A to Electrify and Scale Decarbonized Cement Production
actyv.ai Raises Pre-Series A Funding to Fuel Global Expansion, Product Enhancement
Ottopia announces $14.5M Series A Funding Round

Footer

Recent Posts

  • China’s Quest for Indigenized Semiconductor Production: Hurdles and Challenges Ahead
  • Big Tech Layoffs Lead to a Booming Demand for Skilled Workers
  • Meet the BLOOM: The Next Generation of Large Language Models
  • The Rise of Automated Tutoring in Higher Education
  • The Progress and Promise of AI Music Generation
  • 5G is the New Cyber Attack Surface: Understanding the Risks and Opportunities
  • The Evolution of the Skateboard
  • How can we clean space junk?
  • How Electric Vehicles (EV) Are Changing the Automotive Industry
  • Scientists are looking for intelligent alien life

App Coding

Fungible Storage Cluster Certified for VMware vSphere to Support High Performance VM Systems
ScaleOut Software Announces Production Release of Redis®* Integration
Datadog Named a Leader in the 2022 Gartner® Magic Quadrant™ for Application Performance Monitoring and Observability
What are implications of rewarding developers basing on number of lines of code?
Scrub your code in real-time

API Coding

How to recognize malware API
Fintech AI Leader Photon Commerce Partners With Identifee to Enable Banks to Instantly Digitize and Analyze Statements
DataGrail Launches API & Agent to Automate DSR Fulfillment Across All Internal Data Systems, Saving Companies Weeks of Engineering Time
What is a REST API?
Most commonly used HTTP Headers

Blockchaining

One of the world’s biggest blockchains is testing a new way to approve transactions
What are DLT ledgers?
Fintech Revolution Just Started
Are blockchain transactions traceable?
How safe are NFTs as digital assets

Event Calendar

NAHB International Builders’ Show (IBS 2023) in Las Vegas from January 31 to February 2, 2023
India’s largest biennial automobile exhibition Auto Expo 2023 held on January 12-15, 2023 at Pragati Maidan, New Delhi
NRF 2023, Retail’s Big Show and Expo, January 15 to 17, 2023, Jacob K. Javits Center, New York
DOMOTEX Hannover 2023′ in Germany from 12-15 January
Electrify Expo Austin Set to Be Largest EV Demo Event of the 2022 Season, November 12-13, 2022, Austin, Texas

Copyright © 2022 Technologies.org

Media Partners: Market Analysis & Market Research and Exclusive Domains

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT