Software

Devops

At last, Atlassian sees an end to its outage ... in two weeks

Cloud collaboration biz says script deleted data that's so far been restored via backups


The Atlassian outage that began on April 5 is likely to last a bit longer for the several hundred customers affected.

In a statement emailed to The Register, a company spokesperson said the reconstruction effort could last another two weeks.

The company's spokesperson explained its engineers ran a script to delete legacy data as part of a scheduled maintenance for unidentified cloud products. But the script went above and beyond its official remit by trashing everything.

"This data was from a deprecated service that had been moved into the core datastore of our products," Atlassian's spokesperson said. "Instead of deleting the legacy data, the script erroneously deleted sites, and all associated products for those sites including connected products, users, and third-party applications."

Atlassian, which has been trying to repair the damage of its errant script, on Friday said it expected "most site recoveries to occur with minimal or no data loss." And so far, though data has been deleted, Atlassian has been able to revive it.

"We maintain extensive backup and recovery systems, and there has been no data loss for customers that have been restored to date," Atlassian's spokesperson said, and stressed that this was not the consequence of a cyberattack and that no authorized access to customer data has occurred.

Jira Software, Jira Work Management, Jira Service Management and Confluence continue to show problems on the Atlassian status page, as do Opsgenie and Atlassian Access. Jira provides software issue tracking while Confluence offers a web-based corporate wiki. Opsgenie is an alert service and Atlassian Access is an identity and access management service.

Onsite JIRA installations have not been affected. Self-managed servers are on the way out, however: Back in October, 2020, Atlassian announced the discontinuation of its server products – it stopped selling new licenses on February 2, 2021 and plans to end support for its server products on February 2, 2024. The reason, the company explained last year, is that the cloud is the future.

"We know this outage is unacceptable and we are fully committed to resolving this," Atlassian's spokesperson said. "Our global engineering teams are working around the clock to achieve full and safe restoration for our approximately 400 impacted customers and they are continuing to make progress on this incident."

As we reported earlier on Monday, the software biz says it has restored functionality for more than 35 per cent of those affected by the service outage.

Atlassian said that the company is doing everything it can to restore service as fast as possible but until today it had been unable to provide a likely recovery date due to the complexity of the rebuilding process.

"While we are beginning to bring some customers back online, we estimate the rebuilding effort to last for up to two more weeks," the company said.

That's quite a bit longer than the "<6 hours" recovery time promised by the company for Tier 1 services like Jira and Confluence.

"We know this is not the news our customers are hoping for, and we apologize for the length and severity of this incident. We don’t take this issue lightly and are taking steps to prevent future reoccurrence." ®

Send us news
48 Comments

Deutsche Bank backs Nvidia's bet to make big bucks on software

German financial giant aids GPU maker's vision of vertical integration

Low code is no replacement for software development, say German-speaking SAP users

'It remains to be seen to what degree of process depth the offer will prove itself in practice'

Software company wins $154k for US Navy's licensing breach

Court lands on less than the millions asked for after sailors made copies of 3D modeling suite 'hundreds of thousands' of times

Google says Android runs better when covered in Rust

Banishing memory safety bugs cuts critical vulnerabilities

Exchange Online and Microsoft Teams went down in APAC because Microsoft broke itself

Legacy process overwhelmed infrastructure, brought ten hours of trouble

Musk's Hotel California erected at Twitter HQ, as some offices converted into bedrooms

You can check out any time you like, and you can eventually leave. Right? Right?

openSUSE makes baseline CPU requirements a little friendlier than feared

Tumbleweed rolling-release distro to need v2 of x86-64 – and drop x86-32 edition

Windows Server domain controllers may stop, restart after recent updates

Microsoft outlines a workaround while pulling together a fix to LSASS memory leak

Egad, did Apple do something right? End-to-end encryption for (most) iCloud services

And remember CSAM scanning plan? Forget that was ever a thing

Lockheed Martin's Army cyber training platform goes civilian

Army civilian employees, that is, but aerospace biz says it could be used in the private sector, too

FAA asks for vendor feedback on $10b tech contract

But keen to avoid any mf bespoke software on the mf planes (and other hardware)

Block Fi seeks bankruptcy protection as 'shocking' FTX contagion spreads

Crypto lending biz wants its money back "as promptly as practicable"