Splunk 5 offers fault-tolerant indexing for mission-critical applications

The new edition of the Splunk machine data search engine is designed to eliminate the need for SAN backups

The new version of the Splunk machine data search engine comes with a distributed indexing technology that could save storage costs for those customers running the software as a high-availability service.

"The data that is being collected in Splunk is becoming more mission critical," said Sanjay Mehta, Splunk vice president of product marketing, explaining the need for distributed indexing.

Splunk Enterprise 5 can also generate reports more quickly than its predecessor, the company claims, and comes with new tools to link the software to third-party programs.

The Splunk search engine was designed to collect and index data generated by machines, such as log files from servers and routers. Administrators can use such data to troubleshoot problems and ensure smooth operations. The company has also pitched Splunk as a tool for business managers to collect and analyze operational intelligence.

This is the first version of Splunk to use a new indexing technology that incorporates replication into its routine operations. The software will store multiple copies of its index, which it uses to answer user queries, across different servers. If one server goes down, indexing will continue on the other server, or servers. When the downed server comes back online, it is then updated with the new information. Users consulting Splunk can get their answers from any operational server, which increases the reliability of the service.

"The index data is replicated as it is streaming into Splunk. You can make as many copies as you need," Mehta said. "We have a distributed architecture, so the query tier determines where to fulfill the queries."

With distributed indexing, organizations will no longer need to keep backups on storage area networks (SANs) for fault-tolerant operations, Mehta explained. Instead, the organization can store multiple indexes on commodity servers, he said. "The software layer is providing the replication and availability," Mehta said.

The new version of Splunk also includes new tools to extend its use to other applications. It now includes a JavaScript SDK (software development kit), which will allow administrators to develop JavaScript applications that interact with Splunk.

The company also offers SDKs for Java, Python and PHP, in preview modes. In addition, the company now offers versioned APIs (application programming interfaces), which allow third-party applications to continue to work with Splunk even after Splunk itself is updated with new capabilities. Developers will just have to specify which version of the API they want to use.

The opening of Splunk to third-party developers has been a goal of the company's since the start of the year, Mehta said. Allowing administrators and developers to extend Splunk functionality to other applications allows Splunk to be used in more systems. For example, call center IT support could use Splunk search results to better pinpoint problems. Splunk data can be worked into business intelligence tools, such as Microsoft Excel. Developers could create mobile applications using Splunk data, such as apps that monitor the temperature inside buildings or the health of patients.

"All these sources of data can now link directly through the API," Mehta said.

The new Splunk can also generate reports much faster, thanks to a new data summarization technology the company has added. "We maintain summaries on the indexes. The summaries are up-to-date and they are reusable by other available searches," Mehta said. Reports that used to take a few minutes to compile now should take only a few seconds, Mehta said.

Splunk offers a version of its namesake technology that can be downloaded at no cost. The commercial version of the software starts at US$5,000, for United States customers.

Joab Jackson covers enterprise software and general technology breaking news for The IDG News Service. Follow Joab on Twitter at @Joab_Jackson. Joab's e-mail address is Joab_Jackson@idg.com

Join the PC World newsletter!

Error: Please check your email address.

Tags maintenancestoragesplunksoftware

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Joab Jackson

IDG News Service
Show Comments

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?