Trend Micro mulls VB100 test pull-out

Virus Bulletin 100 tests no longer reflect contemporary malware: Trend Micro

Security giant Trend Micro is considering pulling its anti-virus software from the Virus Bulletin 100 (VB100) tests, claiming they no longer reflect contemporary malware.

In an interview with Techworld, Trend Micro's anti-malware CTO Raimund Genes was blunt about the company's feelings. "It [the VB100] was created in the 20th Century when we had one outbreak per quarter," he said. "The marketing value of the logo is high but it doesn't mean anything."

According to Genes, the VB100 pitted anti-virus products against a whitelist of viruses drawn from the collection of the independently-managed and respected Wildlist.org. However, although drawn from real-world viruses, the volume, variety and evolution of malware now rendered the use of a Wildlist subset almost meaningless.

According to Genes, other vendors were also unhappy with this aspect of the tests. He contrasted the VB100 unfavorably with the huge malware sets used by Austrian outfit AV Comparatives, which he suggested would be a better reflection of the real threats anti-malware programs were now up against.

If the pull-out comes to pass, it will be a blow not just to Virus Bulletin, but to the idea underpinning the VB100 itself. According to Virus Bulletin's website, Trend Micro has taken part in 27 tests carried out over the years by the title. The VB100 - conducted free of charge but vendors must pay to use the logo on paper marketing - would continue, but a major AV engine would no longer be there for comparison.

John Hawes of Virus Bulletin defended the VB100, saying that viewing it as a definitive malware test missed the point. It measured a basic level of competence. Vendors had to score 100 percent in order to be accredited, and had to avoid all false positives, a high but fair level of achievement against malware from a publically-known set.

"The point of the VB100 is that everyone should get everything on that list," said Hawes. "It would be a shame if they [Trend] did not take part."

He revealed that Virus Bulletin was working on a new and more comprehensive test, a sort of "VB1000", which would include leading-edge malware. He was unable to be drawn on timescales for this, but referred to the complexity of designing and carrying out such tests.

Stuart Taylor of Sophos was happy to defend the credibility of the VB100. "Because VB100 is very much a pass or fail test many people expect products to achieve a VB100 as a matter of course. Therefore it is a requirement for most vendors to participate," he said.

However "It has to be acknowledged that testing security products is becoming far more complex and testers need to address the changing threat landscape and the emerging technologies that vendors are using to counter the latest threats," he added.

A promising speck on the horizon comes in the form of the non-profit Anti-Malware Testing Standards Organization (AMTSO), a cross-vendor organization that has held a number of meetings in the hope that some new standards can be agreed on software testing. So far, nothing has come out of its initial meetings held in Bilbao and Amsterdam, but Taylor - a member of the management committee - was hopeful that a forthcoming meeting set for July, to be held at Microsoft's Redmond campus, might speed the plough.

"AMTSO is going to provide guidelines for testing which will help with testing the complexity of today's malware and different technologies. The aim is to raise the bar on testing relevance and quality," said Taylor.

The VB100 has a habit of coming up with a range of interesting tid-bits, including April's revelation that a number of anti-malware products for Vista weren't quite up to scratch.

Join the PC World newsletter!

Error: Please check your email address.

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

John E. Dunn

Techworld
Show Comments

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?