Amazon Elastic MapReduce
Based on Hadoop, MapReduce equips users with potent distributed data-processing tools
- Doesn't take long to get the hang of
- Currently available in the US region only
You'll want to be familiar with the Apache Hadoop framework before you jump into Elastic MapReduce. It doesn't take long to get the hang of it, though. Most developers can have a MapReduce application running within a few hours.
A review step follows. Once you approve your configuration, your job is launched, and you return to the Job Flows page where the job's progress is monitored. When the job completes, your output data will be stored in the S3 bucket you specified.
Users repelled by Web-based graphical management consoles (such as the AWS Management Console) will be happy to discover that Elastic MapReduce can be powered by a command-line interface. This interface executes in the Ruby programming language (a free download) and provides a single command that sports a battalion of parameters. You can create job flows, define inputs, specify map and reduce functions, and generally do anything covered in the AWS management console.
Personal distributed computing
Setting up an Amazon Elastic MapReduce job flow is remarkably easy. New users should run one of the supplied example applications to familiarize themselves with the complete process. I would also recommend setting the optional parameter for generating log files. The resulting logs are comprehensive and can be confusing if you're new to Hadoop, but they helped me track down repeated failures in my first attempts.
Amazon claims to have tweaked the behavior of its implementation of Hadoop to work optimally with S3. Amazon was guarded about the details of this tweaking, so we'll have to take the company at its word as to the benefits of the optimizations. Nevertheless, if you have a large-scale distributed processing problem but a small-scale budget, you should familiarize yourself with Hadoop, then take Amazon's Elastic MapReduce for a spin.
Join the PC World newsletter!
Most Popular Reviews
- 1 Sony Xperia Z5 Premium review: Is the world ready for a 4K phone?
- 2 D-Link Taipan AC3200 Ultra tri-band modem-router review
- 3 Dell XPS 13 (2016) review: Making the very best Ultrabook
- 4 Microsoft Surface Book review: The verdict on Microsoft's first notebook
- 5 Telstra Wi-Fi 4GX Advanced III review: Testing the world's first 600Mbps wireless hotspot
Best Deals on PC World
Latest News Articles
- Top 30 AWS cloud services
- The Good Guys take serious aim at ASX listing
- Google Daydreams about VR, and enterprises take note
- Microsoft pledges to use more renewable energy in its data centers
- Google's mobile productivity apps bury Microsoft's
GGG Evaluation Team
First impression on unpacking the Q702 test unit was the solid feel and clean, minimalist styling.
For work use, Microsoft Word and Excel programs pre-installed on the device are adequate for preparing short documents.
The Fujitsu LifeBook UH574 allowed for great mobility without being obnoxiously heavy or clunky. Its twelve hours of battery life did not disappoint.
The screen was particularly good. It is bright and visible from most angles, however heat is an issue, particularly around the Windows button on the front, and on the back where the battery housing is located.
My first impression after unboxing the Q702 is that it is a nice looking unit. Styling is somewhat minimalist but very effective. The tablet part, once detached, has a nice weight, and no buttons or switches are located in awkward or intrusive positions.
- CCBusiness Analyst, LifeNSW
- CCProject ManagerACT
- CCContract Analyst Programmer (JAVA/SQL/Web) 160519/AP/453Asia
- CCSenior Systems AnalystSA
- FTPermanent Defence network engineer - career progression & flexible conditionsACT
- FTIT Support - Level 1NSW
- CCAnalyst Programmer (Enterprise Java Beans/J2EE) 160601/AP/982Asia
- CCBusiness Analyst, ReportingNSW
- CCiOS Developer x 2NSW
- FTSenior Developer (.Net)SA
- CCSenior Portfolio Analyst - Risk and MetricsNSW
- FTTechnical/Solutions ArchitectNSW
- CCService Desk analystSA
- CCProject Manager - Healthcare DomainSA
- CCOracle Fusion SOA/BPEL DeveloperVIC
- CCContract Programmer (MS SQL Server/SQL/Web) 160518/P/626Asia
- FTOPEN _ ASAP_Technical Specialist COEACT
- FTJunior Web Developer | CBD | Digital AgencyVIC
- CCSoftware DevelopersACT
- CCTechnical Solutions Specialist - Software Developer (Client facing)NSW
- CCInfrastructure Deployment ManagerVIC
- CCTechnical Digital Producer / Requirements EngineerNSW
- CCAnalyst Programmer (J2EE/Oracle/SQL*PLUS) 160519/AP/432Asia
- CCEnd to End Project Manager - PMO and GovernanceVIC
- CCTest Analyst / Test LeadNSW