Microsoft Azure thrown out of gear during a performance update

Microsoft detailed the cause of Azure service interruptions that continued through Wednesday for some customers

A service interruption on Azure storage services late Tuesday was caused by Microsoft's attempts to roll out a performance update that had been earlier tested for several weeks.

An issue was discovered as part of the update to Azure Storage that resulted in reduced capacity across services using Azure Storage, including Virtual Machines, Visual Studio Online, Websites, Search and other Microsoft services, wrote Jason Zander, corporate vice president of the Microsoft Azure team in a blog post Wednesday.

The interruption impacted storage services across the U.S., Europe and parts of Asia. A limited subset of customers were still affected by intermittent issues on Wednesday, according to the company. On the Azure status page, Microsoft was still reporting problems in the West Europe region on Wednesday evening.

The company had tested the performance update in a subset of its customer-facing storage service for Azure Tables, a process known as 'flighting,' when the company identifies issues before broad deployment of an update.

"During the rollout we discovered an issue that resulted in storage blob front ends going into an infinite loop, which had gone undetected during flighting," wrote Zander. The front ends were as a result unable to handle further traffic, which affected other services built on top, he added.

The change was rolled back once the issue was discovered but a restart of the storage front ends was required in order to fully undo the update, according to Zander.

The blog will be updated with a root cause analysis "to ensure customers understand how we have addressed the issue and the improvements we will make going forward," Zander said. Customers are currently being assisted by both engineering and support teams.

Interruptions like the one starting Tuesday are likely to affect Microsoft's pitch that it is easier to rent computer capacity in the cloud rather than set up systems in-house. A number of websites of businesses and Microsoft's own Xbox Live were hit in the interruption this week, according to reports.

Users complained that the rollout of the update should have been done in stages rather than across all regions at one go. The Microsoft Azure team admitted that it had not followed the standard protocol of applying production changes in incremental batches. One person commented on the Azure blog that as a result of the outage, her company had decided to move all its sites to rival Amazon Web Services.

John Ribeiro covers outsourcing and general technology breaking news from India for The IDG News Service. Follow John on Twitter at @Johnribeiro. John's e-mail address is john_ribeiro@idg.com

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags cloud computingMicrosoftinternet

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

John Ribeiro

IDG News Service
Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Aysha Strobbe

Microsoft Office 365/HP Spectre x360

Microsoft Office continues to make a student’s life that little bit easier by offering reliable, easy to use, time-saving functionality, while continuing to develop new features that further enhance what is already a formidable collection of applications

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?