• Skip to main content
  • Skip to secondary menu
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2025-2026
  • Sponsored Post
    • Make a Contribution
  • Technology Jobs
  • Technology Markets
  • About
    • GDPR
  • Contact

AWS Announces General Availability of Amazon Managed Streaming for Apache Kafka (Amazon MSK)

May 31, 2019 By admin Leave a Comment

Today, Amazon Web Services Inc., an Amazon.com company (NASDAQ: AMZN), announced the general availability of Amazon MSK, a fully managed service for Apache Kafka that makes it easy for developers to build and run highly available, secure, and scalable applications based on Apache Kafka without having to worry about managing the underlying infrastructure. Amazon MSK is fully compatible with Apache Kafka, enabling customers to easily migrate their on-premises or Amazon Elastic Cloud Compute (Amazon EC2) clusters to Amazon MSK with no code changes. There are no commitments or upfront investment required to run Amazon MSK, and customers only pay for the capacity they use. To get started with Amazon MSK visit https://aws.amazon.com/msk.

Customers use Apache Kafka to capture and analyze real-time data streams from a range of sources, including IoT devices, website clickstreams, financial systems, and database logs. While many customers chose to self-manage their Apache Kafka clusters, they often spend a lot of time and expense securing, scaling, patching, and ensuring high availability for Apache Kafka and Apache ZooKeeper clusters, which Apache Kafka depends on for resource management. Amazon MSK gives customers all of the attributes of Apache Kafka combined with the availability, security, and scalability of AWS. With just a few clicks, customers can create Apache Kafka clusters designed for high availability that span multiple Availability Zones (AZs). Amazon MSK continuously monitors underlying server health, automatically replacing servers when they fail and patching servers in need of updates. Amazon MSK also runs highly available Apache ZooKeeper nodes at no additional cost. Amazon MSK provides multiple levels of security for Apache Kafka clusters, including VPC network isolation, AWS Identity and Access Management (IAM) for AWS Application Programming Interface (API) authorization, encryption at rest, encryption in-transit, TLS based certificate authentication, and authorization using Apache Kafka access control lists (ACLs). Customers can easily scale out cluster storage with a few clicks in the AWS management console to meet changes in demand. Amazon MSK is fully compatible with Apache Kafka, allowing customers to continue to run applications built on Apache Kafka, use Apache Kafka compatible tools and frameworks, and take advantage of new Apache Kafka innovations, without having to change their code.

“Customers who are running Apache Kafka have told us they want to spend less time managing infrastructure and more time building applications based on real-time streaming data,” said Rajesh Sheth, General Manager of Amazon MSK, AWS. “Amazon MSK gives these customers the ability to run Apache Kafka without having to worry about managing the underlying hardware, and it gives them an easy way to integrate their Apache Kafka applications with other AWS services. With Amazon MSK, customers can stand up Apache Kafka clusters in minutes instead of weeks, so they can spend more time focusing on the applications that impact their businesses.”

Customers start by creating a cluster in Amazon MSK today using the AWS Console or the AWS CLI, and Apache Kafka clients can connect to a cluster using Apache Kafka’s open-source APIs. Amazon MSK is available in the US East (N. Virginia), US East (Ohio), US West (Oregon), EU (Ireland), EU (London), EU (Frankfurt), EU (Paris), Asia Pacific (Tokyo), Asia Pacific (Singapore), and Asia Pacific (Sydney), and will expand to additional AWS Regions in the coming year.

Vonage is a global business cloud communications leader providing integrated communications solutions that improve how business gets done by enhancing a company’s customer and employee experience. Vonage uses Apache Kafka for real-time communication between various micro-services. “By using Amazon MSK, we reduced our maintenance overhead and built a micro-services-based platform that enables businesses to collaborate more productively and engage their customers more effectively,” said Venkatesh Ennala, a software engineer with Vonage. “We can now set up new Kafka clusters more quickly and scale these clusters as our demands increase. Amazon MSK has removed the complexity of set up and maintenance, allowing us to focus on what’s most important – building innovative new capabilities for our customers.”

Secureworks (NASDAQ: SCWX) is a technology-driven cybersecurity leader that protects organizations in the digitally connected world. “When developing and launching our security analytics application, Secureworks chose Amazon MSK service to accelerate time to market and reduce infrastructure and management overhead,” said Wendy Thomas, Senior Vice President of Business and Product Strategy at Secureworks. “This allowed us to focus on innovation and our unique differentiators, helping protect our customers from cyber threats.”

Poshmark is a leading social commerce platform for the next generation of retailers and shoppers. “Through technology, our mission is to build the world’s most connected shopping experience, while empowering people to build thriving retail businesses. Amazon MSK has made it easy to setup, maintain and scale Kafka clusters, enabling an end-to-end data ingestion pipeline supported by a fully-managed service,” said Mahesh Pasupuleti, Senior Director of Data Engineering at Poshmark. “As our demands increase, we feel confident that we will be able to scale at ease and expand our streaming ingestion pipelines for data enrichment and real-time machine learning, providing an enhanced experience for our customers.”

Nutmeg is Europe’s largest digital wealth manager, helping consumers to grow their wealth and reach their financial goals by using cost effective technology to boost returns. Nutmeg uses Apache Kafka to underpin their journey towards an event driven architecture. “Since adopting Amazon MSK, we’ve been able to significantly increase the efficiency of our teams and reduce time spent maintaining our cluster,” said Matt Gatrell, CTO of Nutmeg. “As our data requirements and use cases grew, we started to experience considerable overhead and complexity in managing our Kafka clusters. Amazon MSK has allowed us to manage our clusters with confidence, spend less time verifying the performance of the clusters, scale with ease, and focus more time on innovating and building exciting real-time applications.”

Compass is a real estate technology company with a powerful end-to-end platform that supports the entire buying and selling workflow. Compass uses Apache Kafka to provide its agents with quick access to fresh and accurate data from hundreds of real estate data sources nationwide. “Streaming technology is an important part of what we do as a business, but managing streaming technology involves a lot of heavy lifting by our software developers,” said Joseph Sirosh, CTO of Compass. “Amazon MSK has allowed us to eliminate a lot of this heavy lifting. By using Amazon MSK we no longer need to spend effort on ensuring data durability, cluster availability, and scalability, and can now focus on building applications. Amazon MSK relieves our team from the burden of operating and maintaining Kafka and at the same time, we experience less downtime as our clusters are fully-managed.”

Source: Amazon Web Services
aws.amazon.com

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Footer

Recent Posts

  • Unify Raises $40M to Redefine Go-To-Market with AI Agents That Scale Sales
  • Seagate Unleashes 30TB Hard Drives to Fuel AI Infrastructure at the Edge
  • Firefly Takes Flight: Adobe’s Mobile Expansion Sparks New Growth Horizon
  • SkyDrive’s ¥8.3 Billion Pre-Series D Raise Anchors Japan’s Air Mobility Future
  • HPE and Juniper: A Strategic Fusion at the Core of AI-Native Networking
  • Adobe Inc. Analysis Report: Navigating Uncertainty with Resilience
  • NOS: A New Reactor for American Nuclear Ambition
  • Adobe Introduces LLM Optimizer to Help Brands Navigate the Generative AI Shift
  • Why Visa and Mastercard Stocks Slipped After the Stablecoin News
  • iOS 26: The Most Personal, Intelligent, and Private iPhone Experience Yet

Media Partners

  • Market Analysis
  • Cybersecurity Market
EU Blinks First: Temporary Suspension of Tariff Countermeasures Signals Strategic Caution in U.S. Trade Conflict
AMD Set to Surge: $250 Target Within Reach as AI Momentum Accelerates
China’s Strategic Shift to RISC-V: Market Implications and Growth Prospects
Understanding Transfer Pricing: A Key Component of Multinational Business Operations
A Comprehensive Tour of Project Management Tools and Integration Platforms
Implementing Odoo ERP in a Small Manufacturing Enterprise: Costs and Considerations
Economic Optimism Meets Uncertainty: Blue Chip Indicators Highlight Post-Election Fiscal Concerns and AI’s Looming Impact
The Future of Connectivity: Insights from Ericsson’s November 2024 Mobility Report
Platinum Market Faces Sustained Deficit Amidst Strong Demand and Constrained Supply
Breaking Beijing’s Grip: U.S. and Australia Unite Against China’s Rare Earth Monopoly
SquareX Collaborates with Top Fortune 500 CISOs to Launch The Browser Security Field Manual at Black Hat
CrowdStrike Deepens AWS Partnership to Drive Secure AI Adoption and Innovation
CyberArk Expands Identity Security with Secure Cloud Access and Agent Guard in AWS Marketplace AI Category
CyberBay2025: Forging the Future of Digital Defense, October 13–15 2025, Tampa Marriott Water Street
GitGuardian Launches MCP Server to Bring Secrets Security into Developer Workflows
Stellar Cyber 6.0.0: Ushering in the Human-Augmented Autonomous SOC
MITRE Unveils AADAPT Framework to Safeguard Digital Financial Systems
Cogent Security Emerges from Stealth to Tackle the Fastest-Growing Threat in Cybersecurity with AI-Powered Vulnerability Management
Cyber’s Leading Minds Take the Stage at Black Hat USA 2025
INE Security Launches Enhanced eMAPT Certification

Media Partners

  • Market Research Media
  • Technology Conferences
Adobe Set to Hit $640: AI Growth and Financial Strength Signal Imminent Breakout
The Rise of Headless Content Frameworks in Distributed Media Projects
Developing Web Projects: From Concept to Launch
The Rise of APS-C Cameras: A Professional Renaissance in Photography
Market Brief: Disruption in Spanish Orange Supply Chain and Strategic Response by UK Retailers
Global AI-Powered Movie Scenario Market Analysis 2023-2030: Growth, Trends, and Forecast
Market Research Report: US Government Cybersecurity Market in 2024
Market Research Report: Global Advertising Revenue Projections and Trends in the Entertainment & Media Industry
Social Media: The Rise of Formulaic Content
Netflix’s Creative Decline: The Rise of Formulaic Content
Apple Announces WWDC25, June 9 to 13, 2025
Adobe Summit 2025, March 17-20, Las Vegas
Embedded World 2025, from 11 to 13 March 2025 in Nuremberg
SATELLITE 2025: Uniting the Global Satellite and Space Communities
The milestone 10th edition of Chatbot Summit on March 31 – April 1, 2025, The Ritz-Carlton, Berlin
Snowflake Summit 2025, scheduled for June 2-5, 2025, in San Francisco
The NVIDIA GPU Technology Conference (GTC) 2025 is set to take place from March 17 to 21 at the San Jose McEnery Convention Center in San Jose, California
The Taipei Nangang Exhibition Center is set to host COMPUTEX 2025 from May 20 to May 23
The Mobile World Congress (MWC 2025) will kick off from March 3 to 6 in Barcelona, Spain
IOT Solutions World Congress 2025: Forging the Future of Industrial Innovation

Copyright © 2022 Technologies.org

Media Partners: Market Analysis & Market Research and Exclusive Domains