OVH blames hour-long global outage on human error during 'routine' network reconfiguration

'No impact expected' then pop – and weren't they in the process of an IPO?


Hosting provider OVH reckons that its servers are "gradually returning" following a worldwide outage that lasted for around an hour.

The French co-location biz's services went AWOL from 7:20am UTC. The company had earlier talked of planned "maintenance on our routers" in its Vint Hill, Washington DC, data centre to "improve routing".

CEO Octave Klaba then confirmed: "Following a human error during the reconfiguration of the network on our DC to VH (US-EST), we have a problem on the whole backbone. We are going to isolate the DC VH then fix the conf."

Worldwide outage at OVH

Worldwide outage at OVH

He added "In recent days, the intensity of DDoS attacks has increased significantly. We have decided to increase our DDoS processing capacity by adding new infrastructures in our DC VH (US-EST). A bad configuration of the router caused the failure of the network."

"The router with the wrong D2 configuration has been cut," Klaba concluded.

According to its outage report, the fix involved "the isolation of network equipment in the US."

The routine task is now marked "change cancelled".

The culprit? 'No impact expected'

The culprit? 'No impact expected'

OVH, which is among the larger non-hyperscale hosting and cloud services providers, with 400,000 servers across 30 data centres worldwide, is engaged in an IPO on Euronext Paris though the target price was reduced from €450m to €350m.

The company is well placed to benefit from the concerns about European data sovereignty and the dominance of US-based global corporations in this space. It is the fourth biggest cloud provider in Europe.

Coming (or going) just before the IPO, this outage is therefore an embarrassment. "A few months ago you had a downtime of over 8 hours because of the poor measurements you take on the safety of the buildings... As soon as this downtime is over I am moving out of OVH," said one disgruntled customer.

The company hit the headlines earlier this year following a fire at its Strasbourg premises on 10 March that wiped out two data centres. At least today's incident was nowhere near the scale of that disaster. ®


Other stories you might like

  • Google sours on legacy G Suite freeloaders, demands fee or flee

    Free incarnation of online app package, which became Workplace, is going away

    Google has served eviction notices to its legacy G Suite squatters: the free service will no longer be available in four months and existing users can either pay for a Google Workspace subscription or export their data and take their not particularly valuable businesses elsewhere.

    "If you have the G Suite legacy free edition, you need to upgrade to a paid Google Workspace subscription to keep your services," the company said in a recently revised support document. "The G Suite legacy free edition will no longer be available starting May 1, 2022."

    Continue reading
  • SpaceX Starlink sat streaks now present in nearly a fifth of all astronomical images snapped by Caltech telescope

    Annoying, maybe – but totally ruining this science, maybe not

    SpaceX’s Starlink satellites appear in about a fifth of all images snapped by the Zwicky Transient Facility (ZTF), a camera attached to the Samuel Oschin Telescope in California, which is used by astronomers to study supernovae, gamma ray bursts, asteroids, and suchlike.

    A study led by Przemek Mróz, a former postdoctoral scholar at the California Institute of Technology (Caltech) and now a researcher at the University of Warsaw in Poland, analysed the current and future effects of Starlink satellites on the ZTF. The telescope and camera are housed at the Palomar Observatory, which is operated by Caltech.

    The team of astronomers found 5,301 streaks leftover from the moving satellites in images taken by the instrument between November 2019 and September 2021, according to their paper on the subject, published in the Astrophysical Journal Letters this week.

    Continue reading
  • AI tool finds hundreds of genes related to human motor neuron disease

    Breakthrough could lead to development of drugs to target illness

    A machine-learning algorithm has helped scientists find 690 human genes associated with a higher risk of developing motor neuron disease, according to research published in Cell this week.

    Neuronal cells in the central nervous system and brain break down and die in people with motor neuron disease, like amyotrophic lateral sclerosis (ALS) more commonly known as Lou Gehrig's disease, named after the baseball player who developed it. They lose control over their bodies, and as the disease progresses patients become completely paralyzed. There is currently no verified cure for ALS.

    Motor neuron disease typically affects people in old age and its causes are unknown. Johnathan Cooper-Knock, a clinical lecturer at the University of Sheffield in England and leader of Project MinE, an ambitious effort to perform whole genome sequencing of ALS, believes that understanding how genes affect cellular function could help scientists develop new drugs to treat the disease.

    Continue reading

Biting the hand that feeds IT © 1998–2022