• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Sponsored Post
    • Make a Contribution
    • Technology Job Posting
  • Technology Events 2022-2023
  • Technology Domains
  • Technology Markets
  • Venture Capital
  • Contact
    • About

MapR Accelerates Separation of Compute and Storage: New advances make it easy to deploy native Spark and Drill applications in Kubernetes

April 3, 2019 By Technologies.org Leave a Comment

MapR® Technologies, Inc., visionary creator of the next-generation data platform for AI and Analytics, today announced innovations in the MapR Data Platform that accelerate the compute journey with new, deep integrations with Kubernetes core components for primary workloads on Spark and Drill. These innovations make it easy to better manage highly elastic workloads while also facilitating in-time deployments and the ability to separately scale compute and storage. Organizations restructuring their applications or building next-generation real time data lakes will benefit from these new capabilities in a Kubernetes model, with Spark and Drill, by easily leveraging the elasticity and agility of such clusters.

“Having run a recent survey on organizations’ use of containers to support AI and analytics initiatives, it is clear that a majority of them are exploring the use of containers and Kubernetes in production,” said Mike Leone, senior analyst, ESG. “We are also seeing compute needs are growing rapidly and bursty due to the unpredictability of compute-centric applications and workloads. MapR is solving for this need to independently scale compute while also tightly integrating with Kubernetes in anticipation of organizations’ rapid container adoption.”

In early 2019, MapR enabled persistent storage for compute running in Kubernetes-managed containers through a CSI compliant volume driver plugin. With this announcement, MapR further expands its portfolio of features and allows the deployment of Spark and Drill as compute containers orchestrated by Kubernetes. This deployment model allows end users including data engineers to run compute workloads in a Kubernetes cluster that is independent of where the data is stored or managed. The following core capabilities are included in this release:

Tenant Operator: Creates tenant namespaces (Kubernetes Namespaces) for running compute applications, allowing for a simple way to start complex applications in containers within Kubernetes. An end user can run Spark, Drill, Hive Metastore, Tenant CLI, and Spark History Server in these namespaces. These tenants can, in turn, point to a storage cluster that is located elsewhere.
Spark Job Operator: Creates Spark jobs, allowing for separate versions of Spark to be deployed in separate pods, facilitating the multiple stages of dev, test, and QA that are typical in a data engineer’s workflow.
Drill Operator: Starts a set of Drillbits, allowing for auto-scaling of queries based on demand.
CSI Driver Operator: Standard plugin to mount persistent volumes to run stateful applications in Kubernetes.
“MapR is paving the way for enterprise organizations to easily do two key things: start separating compute and storage and quickly embrace Kubernetes when running analytical AI/ML apps,” said Suresh Ollala, SVP Engineering, MapR. “Deep integration with Kubernetes core components, like operators and namespaces, allows us to define multiple tenants with resource isolation and limits, all running on the same MapR platform. This is a significant enabler for not only applications that need the flexibility and elasticity but also for apps that need to move back and forth from the cloud.”

In this release, MapR delivers on six key benefits:

Handle compute bursts by spinning additional compute containers without having to add more physical host servers;
Isolate resources and prevent applications from starving each other of resources by setting granular limits on quotas, and by using Spark job operators to create different Spark clusters;
Accommodate fluctuating query workload by growing Drillbits dynamically based on load and demand;
Run different versions of Spark and Drill on the same platform,
Allow for multiple tenants to co-exist; and
Deploy Spark and Drill container applications, along with MapR volumes, across multi-cloud environments, including private, hybrid and public clouds;
These capabilities will be available in Q2 2019.

About MapR Technologies
MapR Technologies is a visionary Silicon Valley software company and creator of the next-generation data platform for AI and analytics, with the scale and reliability required by enterprise-grade, mission-critical deployments. The MapR Data Platform delivers the power of dataware to accelerate data-driven innovation. Forward leaning companies such as Cisco, Philips, and Société Générale, are able to create new data-driven solutions to outperform the competition. Learn more: mapr.com.

Related

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Market Research

QuasiQuantumCloud.com (Quasi Quantum Cloud): Accessibility to quantum simulation in the cloud is the game changer
Worldwide government IT spending is forecast to total $565.7 billion in 2022, an increase of 5% from 2021
White House hosts tech summit to discuss open-source security after Log4j
VisualMediaMarket.com: Visual Media Market
NFTstockphotography.com (NFT Stock Photography): NFT Photography is The Next Big Thing
Quantum Computing Market Forecast
Russian oil production succumbing to the impact of Western sanctions

Market Analysis

LuxuryHousing.co: This was the best year on record for home sales at $50 million and above
3G Networks are Dead
Critical Mineral Shortages Could Disrupt Global Supply Chains
Open Source eCommerce as a Viable Alternative
Extended Reality (XR) Technologies
When synthetic biology will disrupt an industry?
The world economy is expected to average annual growth of around 3.2% in the decade ahead

Tech Events

Fira de Barcelona celebrates the extension of MWC Barcelona until 2030
Jamstack Conf 2022, November 7-8 2022, San Francisco and online
Photonics Industry Summit, September 21, 2022, Washington, DC

Secondary Sidebar

Venture Capital

Techstars Continues to Demonstrate Commitment to the Start-up Ecosystem in Korea
Houwzer Raises $118M In Series B Equity and Debt To Expand Within Seven-State Footprint, Launches Three New Consumer Products To Give Clients Competitive Edge
Konnecto Raises $21M to establish a new category in marketing technology
Nautical Commerce Raises $30M to Scale Multi-Vendor Marketplace Technology
Eurora raises $40M for its AI-based system to automate EU e-commerce shipping compliance
Focal Systems Raises $25.8M in Series B Funding to Automate Retail Globally
LucidLink Raises $20 Million in Series B to Solve Remote Collaboration Challenges for Global Creative Teams
Rimsys Closes $16 Million Series A Financing Led by Bessemer Venture Partners
Danish CleanTech ZeroNorth Raises Over $50 Million Series B Round to Help Decarbonise Shipping
Illumina Invests in £30M Venture Fund to Advance Breakthroughs in Human Health

Footer

Recent Posts

  • Oracle Becomes First Hyperscaler to Open a Cloud Region in Mexico
  • Ceres and Shell announce electrolyser agreement for green hydrogen
  • Datadog Launches Audit Trail to Help Businesses Achieve Their Compliance and Governance Objectives
  • Samsung Unveils ISOCELL Image Sensor with Industry’s Smallest 0.56μm Pixel
  • Box Launches Technology Collaboration with FUJIFILM Business Innovation
  • VivaTech, Europe’s number one startup and tech event, makes its big comeback with more than 91,000 participants in Paris
  • Cloudflare Expands Its Zero Trust Platform to Become the Only Cloud-Native Provider with Network Scale
  • New Zealand’s leading port, Ports of Auckland, welcome the world’s first full sized, electric tugboat
  • Energy Dome Successfully Launches First CO2 Battery Long-Duration Energy Storage Plant in the World
  • Resilience Announces $625 Million Series D Financing to Expand Network, Bring Innovative Technologies to Biomanufacturing

Media Partners

  • VPNW
  • S3H
  • OPINT
  • Press Media Release
  • OSINT
  • Digital Market
  • Briefly

Media Partners

  • Technology Conferences
  • Event Sharing Network
  • Defense Conferences
  • Cybersecurity Events
  • Event Calendar
  • Calendarial
  • Opinion
  • Venture Capital

Copyright © 2015 Technologies.org

Technologies, Market Analysis & Market Research Reports

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT