Kubernetes kicks down Azure Front Door

This time outage was not actually Microsoft's fault

If you struggled to access the Azure Portal or Microsoft Entra this morning, you weren't alone – Microsoft has blamed a Kubernetes crash for the outage.

The Windows giant noted problems from 0740 UTC, with multiple regions around the world reporting issues with its services.

"Our monitoring detected a significant capacity loss of about 30 percent of Azure Front Door instances, predominantly across Europe, Middle East, and Africa," Microsoft said.

Surely it hadn't rolled out a borked update yet again? Not this time, it seems. The company continued: "We understand that this is due to a dependency on some underlying Kubernetes instances that crashed. We have ruled out any deployments that could have triggered this event."

That said, losing almost a third of one's capacity due to crashing Kubernetes instances is less than ideal. A properly-architected solution should be able to recover from whatever woes befall the orchestrator, but apparently not Azure.

Social media was its usual supportive self. Some users were attempting to cancel their Game Pass subscriptions following a recent price hike, but were unable to log in due to issues with the service. Others wanted to find out what was going on, but encountered errors suggesting that connectivity had been lost.

In a move familiar to many administrators when faced with similar problems, Microsoft's engineers reached for whatever serves as the on/off switch for its Kubernetes implementation. "We have been restarting these underlying Kubernetes instances, and AFD instances are coming back online," the company said.

The service appears to be staggering back to its feet, and Microsoft has stated that the vast majority of impacted resources have been restored. The company later posted that it kicked off a failover for the Microsoft 365 Portal service to speed things along, and that "we've validated that the service has fully recovered."

This will come as some comfort to users of Microsoft's online services who might have encountered issues today. The company has not, however, elaborated on why the instances went down in the first place or why the recovery was not automatic.

We will update this article if the Windows giant responds to our queries. ®

More about

TIP US OFF

Send us news


Other stories you might like