Thunderstruck: Azure Back in Black(out) after High Voltage causes Flick of the Switch

Lightning storm Shook Texas facility All Night Long


Microsoft is blaming bad weather for the massive outage that knocked a number of Azure cloud and Visual Studio Teams services offline Tuesday.

The Windows giant revealed its South Central US facility in Texas was crippled after severe storms and lightning strikes overloaded its cooling equipment, forcing its servers and other machines to shut down. In short, the facility was hit with a power surge and, facing the choice of having either powered-down computers or melted computers, the plug was pulled and the facility was taken offline amid the emergency.

“A severe weather event, including lightning strikes, occurred near one of the South Central US data centers,” Microsoft said of the lightning strike.

"This resulted in a power voltage increase that impacted cooling systems. Automated datacenter procedures to ensure data and hardware integrity went into effect and critical hardware entered a structured power down process.”

We note that heavy storms are rolling into Texas as category-one Hurricane Gordon menaces America's Gulf coast. A real cloud striking a fake cloud, as it were.

The shutdown not only knocked out services, databases, and virtual machines hosted at the Texas facility, but also took out the Azure Active Directory service starting at around 09:30 UTC. This, in turn, led to the problems that plagued Azure service users in Europe, the US, and elsewhere in the world, particularly those running Visual Studio Team Services, for much of the day.

dog and cat cuddle up

Azure promises to keep your backups safe and snug for up to 10 years

READ MORE

“Customers with organizations outside of the South Central US region may also be experiencing impact with their CI/CD workflows, dashboards due to some internal infrastructure dependencies,” the Visual Studio Team Services group said of its part in the outage.

Microsoft now says it is working to get the facility back online and recover as many of the machines as possible, though a number of services remain offline at time of writing.

“Engineers have successfully restored power to the datacenter. Additionally, engineers have recovered a majority of the impacted network devices,” Microsoft said.

“While some services are starting to see signs of recovery, mitigation efforts are still ongoing.”

Redmond plans to provide further updates on the recovery this (US Pacific time) afternoon. ®

Similar topics


Other stories you might like

  • Want to buy your own piece of the Pi? No 'urgency' says Upton of the listing rumours

    A British success story... what happens next?

    Industry talk is continuing to circulate regarding a possible listing for the UK makers of the diminutive Raspberry Pi computer.

    Over the weekend, UK newspaper The Telegraph reported that a spring listing could be in the offing, with a valuation of more than £370m slapped onto the computer maker.

    Pi boss, Eben Upton, described the article as "interesting" in an email to The Register today, before repeating that "we're always looking at ways to fund the future growth of the business, but the $45m we raised in September has taken some of the urgency out of that."

    Continue reading
  • JetBrains embraces remote development with new IDE for multiple programming languages

    Security, collaboration, flexible working: Fleet does it all, says project lead

    JetBrains has introduced remote development for its range of IDEs as well as previewing a new IDE called Fleet, which will form the basis for fresh tools covering all major programming languages.

    JetBrains has a core IDE used for the IntelliJ IDEA Java tool as well other IDEs such as Android Studio, the official programming environment for Google Android, PyCharm for Python, Rider for C#, and so on. The IDEs run on the Java virtual machine (JVM) and are coded using Java and Kotlin, the latter being primarily a JVM language but with options for compiling to JavaScript or native code.

    Fleet is "both an IDE and a lightweight code editor," said the company in its product announcement, suggesting perhaps that it is feeling some pressure from the success of Microsoft's Visual Studio Code, which is an extensible code editor. Initial language support is for Java, Kotlin, Go, Python, Rust, and JavaScript, though other languages such as C# will follow. Again like VS Code, Fleet can run on a local machine or on a remote server. The new IDE uses technology developed for IntelliJ such as its code-processing engine for features such as code completion and refactoring.

    Continue reading
  • Nextcloud and cloud chums fire off competition complaint to the EU over Microsoft bundling OneDrive with Windows

    No, it isn't the limited levels of storage that have irked European businesses

    EU software and cloud businesses have joined Nextcloud in filing a complaint with the European Commission regarding Microsoft's alleged anti-competitive behaviour over the bundling of its OS with online services.

    The issue is OneDrive and Microsoft's habit of packaging it (and other services such as Teams) with Windows software.

    Nextcloud sells on-premises collaboration platforms that it claims combine "the convenience and ease of use of consumer-grade solutions like Dropbox and Google Drive with the security, privacy and control business needs." Microsoft's cloud storage system, OneDrive, is conspicuous by its absence.

    Continue reading

Biting the hand that feeds IT © 1998–2021