Nvidia updates programming tools to speed up GPU performance

CUDA 6 adds support for unified memory, which will make programming for GPUs faster and more efficient

Nvidia has made improvements to its underlying software tools to make it easier to write programs for faster execution across CPUs and graphics processors.

The company on Thursday announced CUDA 6, which will make programming easier for supercomputers, servers, PCs and, to a lesser extent, smartphones. The goal of CUDA is to provide underlying tools so programmers can off-load processing from CPUs to GPUs, which is faster for technical and graphics applications.

CUDA 6 offers unified memory, an advanced management feature that makes GPU memory as readily accessible as CPU memory. Previously, data had to be moved from CPUs to GPUs for execution and then moved back, creating two data pools. But with unified memory, a developer doesn't have to manage where data is to take advantage of the GPU.

The memory management feature will figure out whether to dispatch data to CPU or GPU memory, and that will reduce the need for programmers to add lines of code to define where the data should be sent, said Sumit Gupta, general manager of Tesla Accelerated Computing products at Nvidia.

The developer doesn't have to worry about GPU and CPU memory because those won't be handled by programming but by directives in CUDA, said Dan Olds, principal analyst at Gabriel Consulting Group.

"This addition to CUDA is evolutionary, not revolutionary," Olds said.

For example, GPUs are often used in servers for desktop virtualization and automating memory placement could speed up the deployment of OS instances via virtual machines, Olds said.

CUDA's unified memory feature is similar to the HSA (Heterogeneous System Architecture) Foundation's HUMA specification, in which different memory types in a system are shared between processors. The specification allows programmers to write applications without worrying about which memory resource the code is transferred to. Nvidia is not a member of the HSA Foundation, which was founded last year by companies including Advanced Micro Devices, ARM, Qualcomm and others.

The feature also falls in line with Nvidia's goal to make CPU and GPU memory a shared resource at the hardware level. Nvidia's upcoming Tegra 6 mobile processor code-named Parker will pool CPU and GPU memory in devices, servers and PCs to expand the addressable memory available to programs. Currently, GPU and CPU memory are divided, though the unified memory feature in CUDA 6 should alleviate that problem at a software layer until the implementation of upcoming hardware improvements.

Some of the world's fastest supercomputers use GPUs as co-processors to speed up computing. The last CUDA update, version 5.5, added support for ARM CPUs. CUDA 6 has also has improved libraries that could speed up calculations on graphics processors.

Agam Shah covers PCs, tablets, servers, chips and semiconductors for IDG News Service. Follow Agam on Twitter at @agamsh. Agam's e-mail address is agam_shah@idg.com

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags softwareapplication developmentnvidiaComponentsDevelopment toolsGraphics boards

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Agam Shah

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Cate Bacon

Aruba Instant On AP11D

The strength of the Aruba Instant On AP11D is that the design and feature set support the modern, flexible, and mobile way of working.

Dr Prabigya Shiwakoti

Aruba Instant On AP11D

Aruba backs the AP11D up with a two-year warranty and 24/7 phone support.

Tom Pope

Dynabook Portégé X30L-G

Ultimately this laptop has achieved everything I would hope for in a laptop for work, while fitting that into a form factor and weight that is remarkable.

Tom Sellers

MSI P65

This smart laptop was enjoyable to use and great to work on – creating content was super simple.

Lolita Wang

MSI GT76

It really doesn’t get more “gaming laptop” than this.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?