Software

Devops

At last, Atlassian sees an end to its outage ... in two weeks

Cloud collaboration biz says script deleted data that's so far been restored via backups


The Atlassian outage that began on April 5 is likely to last a bit longer for the several hundred customers affected.

In a statement emailed to The Register, a company spokesperson said the reconstruction effort could last another two weeks.

The company's spokesperson explained its engineers ran a script to delete legacy data as part of a scheduled maintenance for unidentified cloud products. But the script went above and beyond its official remit by trashing everything.

"This data was from a deprecated service that had been moved into the core datastore of our products," Atlassian's spokesperson said. "Instead of deleting the legacy data, the script erroneously deleted sites, and all associated products for those sites including connected products, users, and third-party applications."

Atlassian, which has been trying to repair the damage of its errant script, on Friday said it expected "most site recoveries to occur with minimal or no data loss." And so far, though data has been deleted, Atlassian has been able to revive it.

"We maintain extensive backup and recovery systems, and there has been no data loss for customers that have been restored to date," Atlassian's spokesperson said, and stressed that this was not the consequence of a cyberattack and that no authorized access to customer data has occurred.

Jira Software, Jira Work Management, Jira Service Management and Confluence continue to show problems on the Atlassian status page, as do Opsgenie and Atlassian Access. Jira provides software issue tracking while Confluence offers a web-based corporate wiki. Opsgenie is an alert service and Atlassian Access is an identity and access management service.

Onsite JIRA installations have not been affected. Self-managed servers are on the way out, however: Back in October, 2020, Atlassian announced the discontinuation of its server products – it stopped selling new licenses on February 2, 2021 and plans to end support for its server products on February 2, 2024. The reason, the company explained last year, is that the cloud is the future.

"We know this outage is unacceptable and we are fully committed to resolving this," Atlassian's spokesperson said. "Our global engineering teams are working around the clock to achieve full and safe restoration for our approximately 400 impacted customers and they are continuing to make progress on this incident."

As we reported earlier on Monday, the software biz says it has restored functionality for more than 35 per cent of those affected by the service outage.

Atlassian said that the company is doing everything it can to restore service as fast as possible but until today it had been unable to provide a likely recovery date due to the complexity of the rebuilding process.

"While we are beginning to bring some customers back online, we estimate the rebuilding effort to last for up to two more weeks," the company said.

That's quite a bit longer than the "<6 hours" recovery time promised by the company for Tier 1 services like Jira and Confluence.

"We know this is not the news our customers are hoping for, and we apologize for the length and severity of this incident. We don’t take this issue lightly and are taking steps to prevent future reoccurrence." ®

Send us news
48 Comments

The Pentagon has no idea how to deal with bad cloud contracts, say auditors

Terrible IT practices at the DoD? You don't say

Salesforce engineers roll back change after breaking own cloud for hours today

Services said to be returning to normal from downtime though Tableau Cloud still MIA

GNU turns 40: Stallman's baby still not ready for prime time, but hey, there's cake

It turned the software industry upside down regardless

IBM Software tells workers: Get back to the office three days a week

Managers warn company goals can't be achieved unless coders get more face time and less FaceTime

Automating cloud infrastructure: Do you want APIs with that?

Flipping the script to a control plane

Terraform fork OpenTF renamed and relocated as OpenTofu

Open wide!

Marvell disputes claim Cavium backdoored chips for Uncle Sam

Allegations date back a decade to leaked Snowden docs

Signal adopts new alphabet jumble to protect chats from quantum computers

X3DH readied for retirement as PQXDH is rolled out

Former CIO accuses Penn State of faking cybersecurity compliance

Now-NASA boffin not impressed

Azure SQL Database takes Saturday off on US east coast following network power failure

At least it was the weekend

Gandalf chatbot security game counters privacy fireballs

You shall not pass judgement, Lakera AI insists, because exposed player info was harmless

Unity closes offices, cancels town hall after threat in wake of runtime fee restructure

Backlash has spilled offline and into potential violence