Today’s question is: where are we regarding MapReduce/Hadoop in the cloud? That is, what are the offerings of Hadoop-as-a-Service or other hosted MapReduce implementations, currently?
A year ago, InfoQ ran a story Hadoop-as-a-Service from Amazon, Cloudera, Microsoft and IBM which will serve us as a baseline here. This article contains the following statement:
According to a 2011 TDWI survey, 34% of the companies use big data analytics to help them making decisions. Big data and Hadoop seem to be playing an important role in the future.
One year later, we learn from a recent MarketsAndMarkets study, Hadoop & Big Data Analytics Market – Trends, Geographical Analysis & Worldwide Market Forecasts (2012 – 2017) that …
The Hadoop market in 2012 is worth $1.5 billion and is expected to grow to about $13.9 billion by 2017, at a [Compound Annual Growth Rate] of 54.9% from 2012 to 2017.
In the past year there have also been some quite vivid discussions around the topic ‘Hadoop in the cloud’.
So, here are some current offerings and announcements I’m aware of:
- Amazon’s Elastic MapReduce (EMR), featuring MapR’s rock-solid and fast Hadoop distribution.
- Google’s App Engine, a PaaS offering, allows for experimental MapReduce processing in Python.
- Microsoft’s Azure, also a PaaS offering, now has Hadoop support.
- VMware has launched Project Serengeti to enable rapid deployment of Hadoop clusters in their Cloud Foundry environment.
- HStreaming’s Cloud Beta hooked up with AWS as well.
- There is a report on a PaaS on Hadoop Yarn – Idea and Prototype available.
… and now it’s up to you dear reader – I would appreciate it if you could point me to more offerings and/or announcements you know of, concerning MapReduce and Hadoop in the cloud!
One player is http://www.altus-insight.de/ : it is a Berlin-based project from Christian Richter ( https://www.xing.com/profile/Christian_Richter121) … the idea is to take ready-to-run hadoop code and let it run on a sizeable cluster.
Posted by dakoller | 2012-11-08, 10:29Thanks a lot Daniel! Yes, https://www.hadoopondemand.com/ looks promising …
Posted by mhausenblas | 2012-11-08, 10:32Nice article,Global Big Data Conference is going to be held on Jan 28, 2013 at the Santa Clara Convention center, 5001 Great America Parkway, Santa Clara, CA, 95054. The purpose of this event is to connect professionals with successful people. Key industry topics such as Big Data, Hadoop, NoSQL, Data Science, Visualization & Interface, Startups Pitch, Analytics and Industry Best Practices etc.. will be covered.
Posted by Big Data Conference | 2012-12-31, 06:14