Texas hospital struggles to make IBM's Watson cure cancer

Audit committee questions procurement compliance

If IBM is looking for a new application for its Watson machine learning tools, it might consider putting health care providers' procurement and systems integration woes ahead of curing cancer.

After spending more than four years and US$62 million on its Oncology Expert Advisor project, the M.D. Anderson Cancer Center at the University of Texas still looking for answers in all those areas.

The fall-out from that project has now prompted the resignation of the cancer center's president, Ronald DePinho, the Wall Street Journal reported Thursday.

The university recently published an internal audit report into the procurement processes that led it to hand almost $40 million to IBM and over $21 million to PwC for work on the project, almost all of it without board approval. 

It noted that the scope of its review was limited to contracting and procurement practices and compliance issues, and did not cover project management and system development activities.

The audit "should not be interpreted as an opinion on the scientific basis or functional capabilities of the system in its current state," because a separate review of those aspects of the project is being conducted by an external consultant, it said.

The Oncology Expert Advisor was intended to take in medical literature, treatment options, research data and patient records, using IBM's Watson machine learning algorithms to provide clinical advice to help oncologists in the community to provide the same level of care as doctors at the M.D. Anderson Cancer Center. That never happened.

The contract with IBM was first signed in June 2012, and extended 12 times. But as of September 2016, according to the audit, "The system is not in clinical use and has not been piloted outside of M.D. Anderson." Furthermore, IBM ended its support for the pilot and demonstration systems on Sept. 1, 2016. IBM has agreed with the university that the system "is not ready for human investigational or clinical use, and its use in the treatment of patients is prohibited," according to the audit report.

IBM officials were not immediately available to comment, but told the Wall Street Journal that the initial pilot project was a success.

Part of the problem seems to be that M.D. Anderson swapped its old electronic medical records system, ClinicStation, for a new one, Epic, in 2016, and Watson never learned to read the new record format.

"OEA has not been updated to integrate with the current system," the audit noted.

Mission creep also led to the project increasing considerably in scope. Initially focused on advising on myelodysplastic syndrome (MDS) leukemia treatment, it expanded after eight months to include five additional types of leukemia, then two years later to include lung cancer. PwC's work to integrate it with clinical and other databases also expanded as part of M.D. Anderson's Translational Research Accelerator, initially known as its Big Data Initiative (BDI).

The auditor focused criticism on compliance processes. It reviewed six non-competitive procurements worth a total of $51.4 million, finding two that were not formally justified and approved as exclusive non-competitive acquisitions, one contract amendment that was correctly executed, and one change order that was not signed by an authorized party. The project as a whole did not follow required IT governance processes.

Responding to the audit, university chancellor Willam McRaven acknowledged the auditor's finding that contractors were paid regardless of whether the original contracted scope-of-work was completed.

However, he wrote, "The research and development nature of the work inevitably led to goals and expectations that shifted over time, often making original contracts moot in terms of specified deliverables. To the extent that targets and expectations shifted over time, the incomplete documentary record makes it impossible to determine whether or not the revised milestones were met."

M.D. Anderson must improve its systems to record the evidence necessary to justify payments to contractors on projects that evolve over time, he added.

IBM's Watson Oncology tool is doing just fine at Memorial Sloan Kettering Cancer Center in New York.

At M.D. Anderson Cancer Center, though, maybe IBM's best chance to pick up some extra business is with its Watson Regulatory Compliance Analytics tool.

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Peter Sayer

IDG News Service
Show Comments

Brand Post

Most Popular Reviews

Latest Articles


PCW Evaluation Team

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?