Google's new cloud service eases data preparation for machine learning

BigQuery gets a bunch of updates for big data, too

IDG

IDG

One of the challenges that data scientists face when running machine learning workloads is processing information before it’s ready for use. Google unveiled a new cloud service Thursday aimed at easing that pain.

Google Cloud Dataprep will automatically detect data schemas, joins, and anomalies such as missing or duplicate values, without requiring coding. After that, it will help users build a set of rules for processing the information. Those rules are then built in Apache Streams format and can be imported into products like Google's Cloud Dataflow for processing information as it's imported into services like the BigQuery data warehouse service.

While Cloud Dataprep is built to prepare data for machine learning, the system also uses machine learning itself to try to determine which rules will be most useful for customers. As of Thursday, it's available in private beta.

BigQuery is receiving a number of enhancements as well, including a new Commercial Datasets program that's now available in public beta. It will let users take information from AccuWeather, Dow Jones, Xignite, HouseCanary, and Remine and directly feed it into BigQuery for further processing.

BigQuery can also now query data stored in Cloud Bigtable, Google’s managed NoSQL database offering for low-latency data. That means users can write one SQL query that can tap into information from Bigtable and BigQuery. In the past, they’d have to write a program to search Bigtable.

Advertising customers will be able to send data from Google Adwords, DoubleClick Campaign Manager, DoubleClick for Publishers, and YouTube to BigQuery for further use in analytics and other big data applications. That feature may help encourage the company’s fleet of advertising customers to try Google’s Cloud as it faces down Amazon and Microsoft.

Speaking of database news, the company announced that its Cloud SQL managed database offering now offers beta support for PostgreSQL in addition to MySQL.

All of the news was announced as part of Google Cloud Next, the company’s user conference for businesses and enterprises taking place in San Francisco. The announcements come alongside other news about the company’s cloud platform, including changes to pricing and support for custom runtimes in AppEngine.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags Google

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Blair Hanley Frank

IDG News Service
Show Comments

Brand Post

Bitdefender 2018

With determination and drive, you achieve outstanding performance! Get Bitdefender Total Security 2018 Now!

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?