Software

Devops

At last, Atlassian sees an end to its outage ... in two weeks

Cloud collaboration biz says script deleted data that's so far been restored via backups


The Atlassian outage that began on April 5 is likely to last a bit longer for the several hundred customers affected.

In a statement emailed to The Register, a company spokesperson said the reconstruction effort could last another two weeks.

The company's spokesperson explained its engineers ran a script to delete legacy data as part of a scheduled maintenance for unidentified cloud products. But the script went above and beyond its official remit by trashing everything.

"This data was from a deprecated service that had been moved into the core datastore of our products," Atlassian's spokesperson said. "Instead of deleting the legacy data, the script erroneously deleted sites, and all associated products for those sites including connected products, users, and third-party applications."

Atlassian, which has been trying to repair the damage of its errant script, on Friday said it expected "most site recoveries to occur with minimal or no data loss." And so far, though data has been deleted, Atlassian has been able to revive it.

"We maintain extensive backup and recovery systems, and there has been no data loss for customers that have been restored to date," Atlassian's spokesperson said, and stressed that this was not the consequence of a cyberattack and that no authorized access to customer data has occurred.

Jira Software, Jira Work Management, Jira Service Management and Confluence continue to show problems on the Atlassian status page, as do Opsgenie and Atlassian Access. Jira provides software issue tracking while Confluence offers a web-based corporate wiki. Opsgenie is an alert service and Atlassian Access is an identity and access management service.

Onsite JIRA installations have not been affected. Self-managed servers are on the way out, however: Back in October, 2020, Atlassian announced the discontinuation of its server products – it stopped selling new licenses on February 2, 2021 and plans to end support for its server products on February 2, 2024. The reason, the company explained last year, is that the cloud is the future.

"We know this outage is unacceptable and we are fully committed to resolving this," Atlassian's spokesperson said. "Our global engineering teams are working around the clock to achieve full and safe restoration for our approximately 400 impacted customers and they are continuing to make progress on this incident."

As we reported earlier on Monday, the software biz says it has restored functionality for more than 35 per cent of those affected by the service outage.

Atlassian said that the company is doing everything it can to restore service as fast as possible but until today it had been unable to provide a likely recovery date due to the complexity of the rebuilding process.

"While we are beginning to bring some customers back online, we estimate the rebuilding effort to last for up to two more weeks," the company said.

That's quite a bit longer than the "<6 hours" recovery time promised by the company for Tier 1 services like Jira and Confluence.

"We know this is not the news our customers are hoping for, and we apologize for the length and severity of this incident. We don’t take this issue lightly and are taking steps to prevent future reoccurrence." ®

Send us news
48 Comments

Chrome Enterprise Premium promises extra security – for a fee

Paying for browsers is no longer a memory from the 1990s

SAP transformation program a 'euphemism' for job cuts, claims European Works Council

8,000 roles affected worldwide, but Germany will bear heaviest losses

Tough luck, bosses, AI is coming for your job, too

Algorithms as PHBs – who wouldn't want that?

911 goes MIA across multiple US states, cause unclear

Some say various cell services were out, others still say landlines were affected. What just happened?

Google Cloud chief is really psyched about this AI thing

We're on a highway to ML

US Air Force says AI-controlled F-16 fighter jet has been dogfighting with humans

Robo-plane was made to restrain itself so as not to harm pilot or airframe

VMS Software prunes OpenVMS hobbyist program

Vintage OS editions go the way of the dodo as VSI cranks up exclusivity

YouTube now sabotages ad-blocking apps that stream its vids

EFF lambastes latest 'lazy and deliberately malicious move'

Debian spices up APT package manager with a dash of color, squishes ancient bug

2.9 gives a taste of what's to come

OpenAI's GPT-4 can exploit real vulnerabilities by reading security advisories

While some other LLMs appear to flat-out suck

What's up with AI lately? Let's start with soaring costs, public anger, regulations...

'Obtaining genuine consent for training data collection is especially challenging' industry sages say

Microsoft lifts years-old compatibility hold for Windows 11

It probably wasn't only sound driver problems that kept users away