Amazon Elastic MapReduce
Based on Hadoop, MapReduce equips users with potent distributed data-processing tools
- Doesn't take long to get the hang of
- Currently available in the US region only
You'll want to be familiar with the Apache Hadoop framework before you jump into Elastic MapReduce. It doesn't take long to get the hang of it, though. Most developers can have a MapReduce application running within a few hours.
A review step follows. Once you approve your configuration, your job is launched, and you return to the Job Flows page where the job's progress is monitored. When the job completes, your output data will be stored in the S3 bucket you specified.
Users repelled by Web-based graphical management consoles (such as the AWS Management Console) will be happy to discover that Elastic MapReduce can be powered by a command-line interface. This interface executes in the Ruby programming language (a free download) and provides a single command that sports a battalion of parameters. You can create job flows, define inputs, specify map and reduce functions, and generally do anything covered in the AWS management console.
Personal distributed computing
Setting up an Amazon Elastic MapReduce job flow is remarkably easy. New users should run one of the supplied example applications to familiarize themselves with the complete process. I would also recommend setting the optional parameter for generating log files. The resulting logs are comprehensive and can be confusing if you're new to Hadoop, but they helped me track down repeated failures in my first attempts.
Amazon claims to have tweaked the behavior of its implementation of Hadoop to work optimally with S3. Amazon was guarded about the details of this tweaking, so we'll have to take the company at its word as to the benefits of the optimizations. Nevertheless, if you have a large-scale distributed processing problem but a small-scale budget, you should familiarize yourself with Hadoop, then take Amazon's Elastic MapReduce for a spin.
Join the PC World newsletter!
Most Popular Reviews
- 1 Huawei P10 smartphone review
- 2 Huawei P10 Plus phone: Full, in-depth review
- 3 Motorola Moto G5 smartphone review
- 4 Oppo A57 phone: full, in-depth review
- 5 Moto G5 Plus phone: full, in-depth review
Latest News Articles
- Wanawiki is the WannaCry fix that might save affected PCs—if you work fast
- The WannaCry ransomware might have a link to North Korea
- Paying the WannaCry ransom will probably get you nothing. Here's why.
- WannaCry attacks are only the beginning
- Vulnerability hits Intel enterprise PCs going back 10 years
PCW Evaluation Team
A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.
I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.
As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.
I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.
Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!
For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.
- LG 2017 OLED TV range full review: W7 Signature Wallpaper, G7, E7 and C7 UHD TVs
- Asus ROG Strix Z270F Gaming motherboard review
- The simple RAM buying guide
- What's the difference between an Intel Core i3, i5 and i7?
- Laser vs. inkjet printers: which is better?
- FTSocial Media Executive / Specialist (Facebook) - online gamblingNSW
- FTJunior .Net DeveloperNSW
- CCSQL Analyst DeveloperNSW
- TPServiceNow ConsultantVIC
- FTLead Drupal DeveloperQLD
- FTSplunk Software Developer | 6mth ContractVIC
- FTData Analyst - 12 months Fixed Term ContractVIC
- CCManaging Architect - Satellite - TelcoVIC
- FTSenior Business Development Manager| SMSF/Accounting SoftwareNSW
- FTBusiness AnalystVIC
- FTNetwork Engineer - IP routing & switchingNSW
- FTSenior React DeveloperNSW
- FTTechnical Solution ArchitectSA
- CCData AnalystNSW
- CCDisaster Recovery SpecialistQLD
- TPDelivery Coordinator - ProjectsQLD
- CCState-wide Business Transition Lead - BrisbaneVIC
- FTHCM Project Manager & Service Implementation Manager - SAP HRNSW
- FTBusiness Intelligence Analyst - Microsoft BI Stack - NewcastleNSW
- FTProject Manager or Coordinator - Retail Store ProjectsNSW
- FTSoftware EngineerWA
- FTDigital Solution ArchitectNSW
- TPOrganisational Change Manager | Dept of CommunitiesQLD
- FTSoftware DeveloperQLD