• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2023-2024
  • Sponsored Post
    • Make a Contribution
  • Technology Jobs
  • Technology Markets
    • Venture Capital
  • About
  • Contact

MapR Accelerates Separation of Compute and Storage: New advances make it easy to deploy native Spark and Drill applications in Kubernetes

April 3, 2019 By admin Leave a Comment

MapR® Technologies, Inc., visionary creator of the next-generation data platform for AI and Analytics, today announced innovations in the MapR Data Platform that accelerate the compute journey with new, deep integrations with Kubernetes core components for primary workloads on Spark and Drill. These innovations make it easy to better manage highly elastic workloads while also facilitating in-time deployments and the ability to separately scale compute and storage. Organizations restructuring their applications or building next-generation real time data lakes will benefit from these new capabilities in a Kubernetes model, with Spark and Drill, by easily leveraging the elasticity and agility of such clusters.

“Having run a recent survey on organizations’ use of containers to support AI and analytics initiatives, it is clear that a majority of them are exploring the use of containers and Kubernetes in production,” said Mike Leone, senior analyst, ESG. “We are also seeing compute needs are growing rapidly and bursty due to the unpredictability of compute-centric applications and workloads. MapR is solving for this need to independently scale compute while also tightly integrating with Kubernetes in anticipation of organizations’ rapid container adoption.”

In early 2019, MapR enabled persistent storage for compute running in Kubernetes-managed containers through a CSI compliant volume driver plugin. With this announcement, MapR further expands its portfolio of features and allows the deployment of Spark and Drill as compute containers orchestrated by Kubernetes. This deployment model allows end users including data engineers to run compute workloads in a Kubernetes cluster that is independent of where the data is stored or managed. The following core capabilities are included in this release:

Tenant Operator: Creates tenant namespaces (Kubernetes Namespaces) for running compute applications, allowing for a simple way to start complex applications in containers within Kubernetes. An end user can run Spark, Drill, Hive Metastore, Tenant CLI, and Spark History Server in these namespaces. These tenants can, in turn, point to a storage cluster that is located elsewhere.
Spark Job Operator: Creates Spark jobs, allowing for separate versions of Spark to be deployed in separate pods, facilitating the multiple stages of dev, test, and QA that are typical in a data engineer’s workflow.
Drill Operator: Starts a set of Drillbits, allowing for auto-scaling of queries based on demand.
CSI Driver Operator: Standard plugin to mount persistent volumes to run stateful applications in Kubernetes.
“MapR is paving the way for enterprise organizations to easily do two key things: start separating compute and storage and quickly embrace Kubernetes when running analytical AI/ML apps,” said Suresh Ollala, SVP Engineering, MapR. “Deep integration with Kubernetes core components, like operators and namespaces, allows us to define multiple tenants with resource isolation and limits, all running on the same MapR platform. This is a significant enabler for not only applications that need the flexibility and elasticity but also for apps that need to move back and forth from the cloud.”

In this release, MapR delivers on six key benefits:

Handle compute bursts by spinning additional compute containers without having to add more physical host servers;
Isolate resources and prevent applications from starving each other of resources by setting granular limits on quotas, and by using Spark job operators to create different Spark clusters;
Accommodate fluctuating query workload by growing Drillbits dynamically based on load and demand;
Run different versions of Spark and Drill on the same platform,
Allow for multiple tenants to co-exist; and
Deploy Spark and Drill container applications, along with MapR volumes, across multi-cloud environments, including private, hybrid and public clouds;
These capabilities will be available in Q2 2019.

About MapR Technologies
MapR Technologies is a visionary Silicon Valley software company and creator of the next-generation data platform for AI and analytics, with the scale and reliability required by enterprise-grade, mission-critical deployments. The MapR Data Platform delivers the power of dataware to accelerate data-driven innovation. Forward leaning companies such as Cisco, Philips, and Société Générale, are able to create new data-driven solutions to outperform the competition. Learn more: mapr.com.

Filed Under: Tech

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Market Analysis

DevOps and Agile: Integrating Development and Operations
China’s Use of Golden Shares: From Reducing State Role to Quietly Controlling Tech Giants
Why Amazon Acquired One Medical: Disrupting the Healthcare Industry with Technology-Enabled Care
The End of an Era: Why China is No Longer Viable as the World’s Factory
Cloudflare’s FedRAMP authorization opens up a huge market opportunity in the US government sector
Datadog’s strong financial results for the fourth quarter and fiscal year 2022 provide a solid case for a Buy recommendation
Cisco: Struggling to find new avenues of growth

Market Research Media

Agile Leadership: Leading Agile Teams for Success
Chinese Brands Reach New Heights of Popularity in the West Amid Growing Political Tensions
Unrestricted Streaming: How VPNs Can Enhance Media Consumption Experience
How the world’s biggest companies have built and defended their moats
Virtual Learning Environments: A Game-Changer in Education?
Streaming video, training, and gaming coming together to form a cohesive and diverse media and entertainment ecosystem
Turn Your Story into a Game: The Art of Gamifying Your Plot

Secondary Sidebar

Tech Events

Splash User Conference and Partner Summit will take place from April 17 to 20, 2023 in Washington, D.C.
Fiber Connect 2023, August 20-23 2023, Orlando, Florida
International Battery Seminar & Exhibit (IBSE) on March 20-23, 2023 in Orlando, FL
MIT Technology Review’s Future Compute event, April 30 – May 1, 2023, MIT Campus, Cambridge, Massachusetts
13th Annual 2023 State IT Connect Summit in Baltimore, Maryland, from March 6-8, 2023

Venture Capital

African Venture Investment Soars to Record High, Fueled by Tech Startups
Pitchly Secures $7 Million Series A Funding for SaaS-Based Data Enablement Solution
Agile Project Management: Roles and Responsibilities
Candidly, a student debt and savings optimization platform, has raised $20.5 million in a Series B round of financing
GameTech Startups Attracting Venture Capital Funding: The Importance of VPN Security

Footer

Recent Posts

  • Cloudflare Enters Fraud Detection Market with Cloudflare Fraud Detection
  • Devices utilizing Wi-Fi HaLow technology are gaining momentum
  • Agile Software Development Tools and Technologies
  • Continuous Integration and Continuous Delivery in Agile
  • NuScale Power places first long lead material production order for the manufacture of SMR
  • Potential Applications That Could Accelerate the Adoption of 6G Technology
  • The Need for 6G Technology: Challenges and Opportunities
  • Game Programmer
  • Marketing Automation Specialist
  • Unlock the Power of VPNs: Join our Workshop and Master the Latest VPN Technologies!

App Coding

Creating a Responsive User Interface: Design Principles
The Importance of Mobile App Security
App Quality Assurance: Best Practices for Testing Mobile Apps
Machine Learning Algorithms Cheat Sheet: A Quick Reference Guide for Data Scientists and Practitioners
One-Third of Largest Utilities in the US Lag Behind in Mobile App Availability

API Coding

How to built a gaming API
API and Microservices: The Building Blocks of Modern Software Architecture
How to re-write a legacy API
How to teach yourself API coding
Freedom, Flexibility, and the Thriving World of API Development

Blockchaining

What is Web3?
Experience the Future of Blockchain at Cybertech 2023
Is blockchain a transversal technology?
The Fascinating World of Cryptocurrency
Unlocking the Power of Engagement: Exploring the Connection between Gamification and Blockchaining

Event Calendar

ProMat 2023, the leading trade show for the manufacturing and supply chain industry, March 20-23 2023, Chicago’s McCormick Place
Prints 2023, Printing Conference, March 3, 2023
Milan Design Week 2023, April 17-23 2023, Milan, Italy
The New York International Auto Show, April 7-16 2023, Jacob K. Javits Convention Center
Chicago Auto Show 2024, February 10-19, 2024, McCormick Place, Chicago

Copyright © 2022 Technologies.org

Media Partners: Market Analysis & Market Research and Exclusive Domains

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT