Mistake by engineer brings down an entire cloud

UK-based outfit XCalibre saw its FlexiScale cloud go down on Tuesday, and stay down almost two days later. What happened was that an XCalibre engineer accidentally deleted one of the main storage volumes used by the FlexiScale cloud while "tidying things up" on the disk architecture prior. The scheduled maintenance was done before upgrading the cloud to address capacity issues on the back of 30 percent monthly growth in usage. 

The platform should return to normal once engineers are able to restore the lost data from backups to a new disk structure. Unfortunately, the sheer size means that there is insufficient capacity to create a complete duplicate, resulting in the delays. XCalibre CEO Tony Lucas was forthright that something like this shouldn't have occurred, and promised to put safeguards in place once the cloud is brought back up.

For more on this:
- check out this The Register article