Telstra LHC Outage
We have received reports that multiple Cloud servers are offline. Upon further investigation, we have found the below:
All powered equipment in Telstra LHC (London Hosting Centre) went offline at 09:17 BST. We have been informed there are multiple fire engines on site and a suspected UPS fire on the 3rd floor where a majority of comms equipment is located. It seems that London Fire Brigade have ordered building power down as part of electrical safety procedure.
As far as we are aware, this affects all customers and carriers within LHC, and we have confirmation that other carriers with passive connections extending outside the building are also showing offline. This is therefore affecting customers who are directly terminated with active circuits at this location. All passive fibre connections remain unaffected, including those passing through the building.
Updates to follow as they arrive from the DC. We sincerely apologise for any inconvenience this may cause you or your customers.
Thank you.
Team Purple
***UPDATE 1***
Correspondence from DC: Due to a localised fire in the LHC, we have lost the Green system. This provides power to the lower half of the building. The fire has tripped the breakers supporting the busbar. Engineers are on-site and are working to restore power via generator as we speak.
***UPDATE 2***
We have been made aware by the DC that the services are starting to restore. We are monitoring this carefully and will provide you with an update as soon as we have more information.
***UPDATE 3***
Power has partially been restored to our rack in LHC. Some services there are starting to recover however connectivity to Telstra provided subsets is still not possible. We hope to have this resolved as soon as possible.
***UPDATE 4***
Engineers have been working to improve stability in the network and restore the remaining services. All customer SIP & Cloud Hosted services should now be fully restored.
