Evaluating Cloud vendors: The ecosystem matters

It's axiomatic that in software of any complexity, the ecosystem of plug-in products, tools, compatible APIs, and developer community can become really important. In certain software product categories, the importance of the ecosystem can swamp any feature advantage that an upstart product may have, leading to what economists call a natural monopoly.

This doesn't apply to all product categories, though. And in very mature technologies, it is possible to unseat the established leader's ecosystem with a "good enough" substitute. Think "The Innovator's Dilemma," and then think Linux, Open Source, and Google docs.

But if you look at cloud computing, there's no part of it that could be called "very mature." The argument can be made that the cloud is all based on Web services, so the ecosystem doesn't matter as much as it did with traditional software. But that argument is naïve, at best: at the detail level, cloud vendors' APIs are proprietary, and learning curves can be quite steep. And that ain't gonna change.

So the number of tools, plug-ins, and developers can really matter when evaluating cloud vendors. Where in the clouds is the ecosystem critically important? The general characteristics of these segments are:

• Technical platforms, such as integration, logging, development, or deployment

• Social Networking platforms -- the usual suspects

• Advertising and gaming networks -- the usual suspects

• Commerce platforms, such as Amazon, eBay, or PayPal

• Services that are toolkits disguised as applications, such as Google or Salesforce.com

For cloud vendors that span two or more of these characteristics, there's a doubling of the ecosystem's impact. The valuation of Facebook and LinkedIn doesn't come just from the number of eyeballs.

At the other end of the spectrum, there are lots of cloud services where the ecosystem isn't critically important, such as e-mail, storage, news feeds, or photo sharing. And certain kinds of cloud apps such as invoicing, banking, or HR can get away with just a couple of connectors to popular accounting packages.

Measuring the Size and Quality of the Ecosystem

In any vendor competition, there's the stuff that counts and there's noise. The same goes with the ecosystem. For example, Microsoft can probably claim the most APIs of any vendor, the largest developer community, the most plug-in products, and the most consultants. But almost none of that applies to the cloud at this point, and nobody thinks they have the strongest cloud ecosystem.

So the first part of measuring the strength of the vendor's ecosystem is clearing away all the obvious marketing chaff. Next step is to look only at the part of the ecosystem that's relevant to the cloud service you will actually be using. What remains still needs to be vetted, as there will plenty of obsolete or uninteresting "information" about the ecosystem. For example, you may find 100 vendors who are nominally partners, but if only 20 of them are in your country and you've never heard of them before, some additional scrutiny is warranted. Likewise, you may find lots of partner products and services that may not have been updated in a long time. A strong ecosystem has vendors who have not only been there a while, but have released several versions of their products or services. If the ecosystem has a vendor ranking and rating system (Salesforce.com's AppExchange is a great example of this), look for the quality and recency of customer feedback.

The two major axes for measuring the ecosystem are products and people. In my experience, the number of people committed to the ecosystem is more important in the long run than the product. If there is plenty of demand and a good supply of practitioners, the plug-in and add- on products will be forthcoming.

Handicapping the Early Scramble

It can be tricky to evaluate cloud vendors when the category is in its early days and there is no clear winner, either in features or ecosystem. If the cloud category you're looking at is strongly impacted by ecosystem effects listed above, you need to gauge:

• Current size and growth rate of developer community

• Relative happiness of the developer community (as indicated by posts into the community forums, number of job/consulting openings, etc.)

• Size and growth of the number of plug-in products or services

• Number, quality, and profitability of vendors participating in the ecosystem

• Number, scope, quality, and documentation of relevant APIs

• The cloud vendor's investment in the quality of the platform and the growth of the ecosystem

• Number of staff the cloud vendor has dedicated to that growth

This might seem like you're a Wall Street analyst trying to predict the future. And in a way, you are -- so it won't hurt for you to see if any of them has opined on the vitality of the cloud vendors in the category you're working with.

David Taber is the author of the new Prentice Hall book, "Salesforce.com Secrets of Success" and is the CEO of SalesLogistix, a certified Salesforce.com consultancy focused on business process improvement through use of CRM systems. SalesLogistix clients are in North America, Europe, Israel, and India, and David has over 25 years experience in high tech, including 10 years at the VP level or above.

Follow everything from CIO.com on Twitter @CIOonline.

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags cloud computinginternet

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

David Taber

Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles


PCW Evaluation Team

Aysha Strobbe

Microsoft Office 365/HP Spectre x360

Microsoft Office continues to make a student’s life that little bit easier by offering reliable, easy to use, time-saving functionality, while continuing to develop new features that further enhance what is already a formidable collection of applications

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill


I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?