Hottest job? Data scientists say they're still mostly digital 'janitors'

Upcoming priorities include a focus on machine learning, this report suggests

Data scientists are considered to have the hottest job right now, but a new study suggests they're little more than "digital janitors" who spend most of their time cleaning data to prepare it for analysis.

That's according to CrowdFlower, a crowdsourcing company, which surveyed 80 data scientists with varying levels of experience.

While an advanced degree is usually required for the position, a full 60 percent of respondents said they spend most of their time cleaning and organizing data, leaving little for analytical tasks like building training sets and refining algorithms.

"You have your hardest-to-hire resource spending most of their time cleaning data," said Lukas Biewald, CrowdFlower's cofounder and CEO. "It's a humongous waste for organizations."

Cleaning and organizing data, as it turns out, is also data scientists' least favorite part of the job, according to more than half of CrowdFlower's respondents.

That makes for an unhappy combination, but data scientists remain undaunted: More than 80 percent said they're happy at work.

CrowdFlower's findings also confirm that there's a shortage of data scientists in the business world. In last year's survey, 79 percent of respondents said there was a shortage; this year, that figure was up to 83 percent.

Want to land a data scientist job for yourself? The most in-demand skills, according to CrowdFlower, are SQL, Hadoop, Python, Java, R, Hive, MapReduce, NoSQL, Pig and SAS.

Coming up next is machine learning, which was singled out as especially important by more than half of the respondents CrowdFlower surveyed.

"Over the last couple of years every CEO has been asking, 'what's our big data strategy?'" Biewald said. "They need to start asking about machine learning."

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Katherine Noyes

IDG News Service
Show Comments

Cool Tech

Breitling Superocean Heritage Chronographe 44

Learn more >

SanDisk MicroSDXC™ for Nintendo® Switch™

Learn more >

Toys for Boys

Family Friendly

Panasonic 4K UHD Blu-Ray Player and Full HD Recorder with Netflix - UBT1GL-K

Learn more >

Stocking Stuffer

Razer DeathAdder Expert Ergonomic Gaming Mouse

Learn more >

Christmas Gift Guide

Click for more ›

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?