Hortonworks, Mirantis, Red Hat team up on Hadoop
Trio announces plan to accelerate Project Savanna within the OpenStack Foundation
Apache Hadoop contributor Hortonworks, OpenStack systems integrator Mirantis and open source solutions specialist Red Hat, Inc today announced they will work together to contribute to Project Savanna under the OpenStack community guidelines to deliver Apache Hadoop on OpenStack.
The collaboration aims to provide a number of add-ons including the provision of open-source APIs and simpler transitions when moving Hadoop workloads between public and private clouds.
OpenStack is a framework for building and managing private, public and hybrid Infrastructure-as-a-Service (IaaS) clouds, with core software projects providing compute; storage and networking management services; and a shared identity service and dashboard.
Hadoop enables distributed processing of large data sets across clusters of computers using simple programming models. The goal of Project Savanna is to enable OpenStack users to provision and manage elastic Hadoop clusters to speed the development and deployment of cost-effective Hadoop on OpenStack.
The collaborative effort between Hortonworks, Mirantis and Red Hat will focus primarily on contributing engineering resources to Project Savanna, originally introduced as an OpenStack project by Mirantis.
An important initial step for Savanna is to provide an integration point for third-party Hadoop provisioning and management frameworks, such as the Apache Ambari project. This will allow enterprise users to provision Hadoop distributions quickly via OpenStack APIs and dashboard. In addition, Savanna will allow the utilisation of unused compute power from a general purpose OpenStack infrastructure pool for Hadoop workloads. The companies expect to demonstrate the technology at the Hadoop Summit on June 26, 2013 in San Jose, California.
"With its efficient use of hardware and unparalleled agility, the cloud is a logical deployment platform for Apache Hadoop and one that we see many of our customers preferring," said Bob Page, vice president, Products, Hortonworks.
"Coupled with the fact that Hadoop is a net new workload for many organisations, deployment on OpenStack is a logical fit. By committing efforts to simplify the deployment and management of Hadoop on OpenStack through linkage with Ambari, we believe we can meaningfully accelerate the time to production for organisations building out new Hadoop projects."
"Our vision for Savanna was to simplify deployment and management of these big data Hadoop workloads on OpenStack. We are delighted to see industry heavyweights, such as Red Hat and Hortonworks, starting to contribute their expertise to the Savanna project," said Ilya Elterman, senior director of Cloud Services at Mirantis.
"This is a major advancement for the open source community and we are happy to collaborate with Hortonworks and Red Hat."
"As enterprises and service providers look to big data as a competitive differentiator and the open hybrid cloud as an innovation platform, Hadoop deployments can accelerate OpenStack adoption and benefit from consistent interfaces across public and private cloud implementations," said Greg Kleiman, director of strategy, Storage, Red Hat.
"Red Hat is committed to working on Project Savanna within the OpenStack Foundation to make it simpler for enterprises to move big data workloads between public and private clouds easily and cost-effectively."