Pivotal sets the stage for open-source in-memory computing

Pivotal has released the source code for much of its GemFire distributed in-memory database

Following through on a promise to open-source its data analysis software, Pivotal has released the source code that powers its GemFire in-memory database.

Opening up the code could give enterprise customers more input into what new features are added into future versions. For Pivotal, the move provides an entry to those corporate clients that have adopted policies of using open-source software whenever possible, said Roman Shaposhnik, Pivotal's director of open source.

The company also hopes the software, released under the name Project Geode, will find a wider user base, one looking for big data analysis technologies speedier than Hadoop or Spark, Shaposhnik said.

Releasing the code is the first step in Pivotal's plan, formulated earlier this year, to open-source components of the company's Big Data Suite, which includes GemFire. Later this year, the company plans to release the code for its Pivotal Hawq SQL engine for Hadoop and the Pivotal Greenplum Database .

Not all of GemFire is being open-sourced. The company is holding back some advanced features for its commercial edition, such as the ability to stage continuous queries and establish wide-area network connectivity between clusters. Those who pay for the commercial edition will also receive enterprise-level support.

GemFire is distributed in-memory software, which provides a way to hold large amounts of data in the working memory of multiple servers, or nodes. GemFire can balance data across hundreds of nodes, potentially managing terabytes of data.

With this design, GemFire can provide enterprise applications with low-latency access to datasets that are too large to be crammed into the memory of a single server. The software provides all the reliability properties offered by traditional relational databases, which are commonly characterized as ACID (atomicity, consistency, isolation and durability). It includes fail-over capabilities, so the system will remain responsive should one or several individual nodes fail.

Independent software vendor GemStone developed GemFire more than a decade ago, and the code base has grown to more than 1 million lines of code. VMware acquired GemStone in 2010. The technology was transferred to Pivotal, a spin-off company created in 2013 to collect and integrate the growing collection of data analysis technologies owned by VMware and its parent company EMC.

GemFire was originally developed to power mission-critical applications in the financial industry and has been used for large-scale critical operations such as stock trading, financial payments, and ticket sales. Pivotal estimates the software is used to execute more than 10 million transactions a day.

GemFire is one of a number of in-memory databases on the market, said Curt Monash, head of IT analyst firm Monash Research. Alternatives include SAP's HANA, Tibco's ActiveSpace, and AeroSpike's and MemSQL's eponymous databases. Tachyon, the open-source memory-pooling software currently under development for Spark and Hadoop, may also interest enterprises, Monash said.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags databasessoftwareapplicationsPivotal

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Joab Jackson

IDG News Service
Show Comments

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?