• Skip to main content
  • Skip to secondary menu
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2025-2026
  • Sponsored Post
    • Make a Contribution
  • Technology Jobs
  • Technology Markets
  • About
    • GDPR
  • Contact

MapR Accelerates Separation of Compute and Storage: New advances make it easy to deploy native Spark and Drill applications in Kubernetes

April 3, 2019 By admin Leave a Comment

MapR® Technologies, Inc., visionary creator of the next-generation data platform for AI and Analytics, today announced innovations in the MapR Data Platform that accelerate the compute journey with new, deep integrations with Kubernetes core components for primary workloads on Spark and Drill. These innovations make it easy to better manage highly elastic workloads while also facilitating in-time deployments and the ability to separately scale compute and storage. Organizations restructuring their applications or building next-generation real time data lakes will benefit from these new capabilities in a Kubernetes model, with Spark and Drill, by easily leveraging the elasticity and agility of such clusters.

“Having run a recent survey on organizations’ use of containers to support AI and analytics initiatives, it is clear that a majority of them are exploring the use of containers and Kubernetes in production,” said Mike Leone, senior analyst, ESG. “We are also seeing compute needs are growing rapidly and bursty due to the unpredictability of compute-centric applications and workloads. MapR is solving for this need to independently scale compute while also tightly integrating with Kubernetes in anticipation of organizations’ rapid container adoption.”

In early 2019, MapR enabled persistent storage for compute running in Kubernetes-managed containers through a CSI compliant volume driver plugin. With this announcement, MapR further expands its portfolio of features and allows the deployment of Spark and Drill as compute containers orchestrated by Kubernetes. This deployment model allows end users including data engineers to run compute workloads in a Kubernetes cluster that is independent of where the data is stored or managed. The following core capabilities are included in this release:

Tenant Operator: Creates tenant namespaces (Kubernetes Namespaces) for running compute applications, allowing for a simple way to start complex applications in containers within Kubernetes. An end user can run Spark, Drill, Hive Metastore, Tenant CLI, and Spark History Server in these namespaces. These tenants can, in turn, point to a storage cluster that is located elsewhere.
Spark Job Operator: Creates Spark jobs, allowing for separate versions of Spark to be deployed in separate pods, facilitating the multiple stages of dev, test, and QA that are typical in a data engineer’s workflow.
Drill Operator: Starts a set of Drillbits, allowing for auto-scaling of queries based on demand.
CSI Driver Operator: Standard plugin to mount persistent volumes to run stateful applications in Kubernetes.
“MapR is paving the way for enterprise organizations to easily do two key things: start separating compute and storage and quickly embrace Kubernetes when running analytical AI/ML apps,” said Suresh Ollala, SVP Engineering, MapR. “Deep integration with Kubernetes core components, like operators and namespaces, allows us to define multiple tenants with resource isolation and limits, all running on the same MapR platform. This is a significant enabler for not only applications that need the flexibility and elasticity but also for apps that need to move back and forth from the cloud.”

In this release, MapR delivers on six key benefits:

Handle compute bursts by spinning additional compute containers without having to add more physical host servers;
Isolate resources and prevent applications from starving each other of resources by setting granular limits on quotas, and by using Spark job operators to create different Spark clusters;
Accommodate fluctuating query workload by growing Drillbits dynamically based on load and demand;
Run different versions of Spark and Drill on the same platform,
Allow for multiple tenants to co-exist; and
Deploy Spark and Drill container applications, along with MapR volumes, across multi-cloud environments, including private, hybrid and public clouds;
These capabilities will be available in Q2 2019.

About MapR Technologies
MapR Technologies is a visionary Silicon Valley software company and creator of the next-generation data platform for AI and analytics, with the scale and reliability required by enterprise-grade, mission-critical deployments. The MapR Data Platform delivers the power of dataware to accelerate data-driven innovation. Forward leaning companies such as Cisco, Philips, and Société Générale, are able to create new data-driven solutions to outperform the competition. Learn more: mapr.com.

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Footer

Recent Posts

  • Adobe Introduces LLM Optimizer to Help Brands Navigate the Generative AI Shift
  • Why Visa and Mastercard Stocks Slipped After the Stablecoin News
  • iOS 26: The Most Personal, Intelligent, and Private iPhone Experience Yet
  • Postman Unveils Agentic AI Tooling to Operationalize API-Driven Intelligence
  • AM Batteries Opens New Facility in Billerica to Advance U.S. Battery Supply Chain
  • Meibel Secures $7 Million to Revolutionize AI Runtime Management
  • Tailor Raises $14 Million to Redefine ERP for Modern Businesses with Composable Architecture
  • Intel Unveils New GPUs and AI Accelerators at Computex 2025
  • Unlocking Critical Minerals: USGS Invites States to Turn Mine Waste into Treasure
  • Blacksmith Reimagines Continuous Integration with AI-Optimized Infrastructure

Media Partners

  • Market Analysis
  • Cybersecurity Market
China’s Strategic Shift to RISC-V: Market Implications and Growth Prospects
Understanding Transfer Pricing: A Key Component of Multinational Business Operations
A Comprehensive Tour of Project Management Tools and Integration Platforms
Implementing Odoo ERP in a Small Manufacturing Enterprise: Costs and Considerations
Economic Optimism Meets Uncertainty: Blue Chip Indicators Highlight Post-Election Fiscal Concerns and AI’s Looming Impact
The Future of Connectivity: Insights from Ericsson’s November 2024 Mobility Report
Platinum Market Faces Sustained Deficit Amidst Strong Demand and Constrained Supply
Breaking Beijing’s Grip: U.S. and Australia Unite Against China’s Rare Earth Monopoly
Global AI-Powered Accounting and Audit Services Market Analysis 2023-2030: Growth, Trends, and Forecast
The Re-Emergence of PHP
Passwork Achieves ISO/IEC 27001:2022 Certification, Reinforcing Commitment to Enterprise Security
Halo Security Honored with 2025 MSP Today Product of the Year Award
Cloudflare Log Explorer: A Unified Security and Performance Lens Within the Dashboard
The Rising Tide: AI and Cybersecurity Challenges Loom Large for CISOs
Arsen Launches AI-Powered Vishing Simulation to Help Organizations Combat Voice Phishing at Scale
Cyera Raises $540M to Cement Its Role as AI’s Data Security Backbone
ZeroRISC Secures $10M to Build Transparent, Secure Supply Chains
Cisco Fuses AI Security Into the Network Fabric: A Unified Vision for the Agentic Era
Guardz Raises $56M Series B to Scale AI-Native Cybersecurity Platform for MSPs and SMBs
Horizon3.ai’s $100M Bet on Autonomous Security

Media Partners

  • Market Research Media
  • Technology Conferences
The Rise of Headless Content Frameworks in Distributed Media Projects
Developing Web Projects: From Concept to Launch
The Rise of APS-C Cameras: A Professional Renaissance in Photography
Market Brief: Disruption in Spanish Orange Supply Chain and Strategic Response by UK Retailers
Global AI-Powered Movie Scenario Market Analysis 2023-2030: Growth, Trends, and Forecast
Market Research Report: US Government Cybersecurity Market in 2024
Market Research Report: Global Advertising Revenue Projections and Trends in the Entertainment & Media Industry
Social Media: The Rise of Formulaic Content
Netflix’s Creative Decline: The Rise of Formulaic Content
The Transformation of Media: Navigating the Waning Allure of Social Platforms
Apple Announces WWDC25, June 9 to 13, 2025
Adobe Summit 2025, March 17-20, Las Vegas
Embedded World 2025, from 11 to 13 March 2025 in Nuremberg
SATELLITE 2025: Uniting the Global Satellite and Space Communities
The milestone 10th edition of Chatbot Summit on March 31 – April 1, 2025, The Ritz-Carlton, Berlin
Snowflake Summit 2025, scheduled for June 2-5, 2025, in San Francisco
The NVIDIA GPU Technology Conference (GTC) 2025 is set to take place from March 17 to 21 at the San Jose McEnery Convention Center in San Jose, California
The Taipei Nangang Exhibition Center is set to host COMPUTEX 2025 from May 20 to May 23
The Mobile World Congress (MWC 2025) will kick off from March 3 to 6 in Barcelona, Spain
IOT Solutions World Congress 2025: Forging the Future of Industrial Innovation

Copyright © 2022 Technologies.org

Media Partners: Market Analysis & Market Research and Exclusive Domains