businessinthenews

PPSPower’s engineers sprang into action at 03:00 following reports of a fire to the uninterruptible power supply (UPS) on a site in Manchester.

The situation

This is a site that PPS provides UPS maintenance and we had made a number of recommendations on two previous service visits. The batteries and fans had all been recommended for replacement due to failures on battery impedance as well as several failed fans. (There are cooling fans on top and on either side of the units.)

The site had four UPS units running at N+3 capacity. The units were originally installed in a large open space with lots of cooling and ventilation (approx. 18.C). The on-site facilities manager decided to have a room built around the UPS systems to keep them separate from all other equipment in the room.

When we arrived on site, we saw a huge change. A new room had been built around the UPS systems but no cooling had been installed, so the units were blowing out hot air and sucking it back in. The walls had been built very close to the sides of the units, without allowing the correct airflow space.

The unit had caught fire internally, which the fire brigade extinguished. Unfortunately the power to the data centre had already been lost as the other three units had failed due to overheating caused by the fire. The front displays on the other units had melted and all the batteries were extremely swollen due to the heat in the room.

Footprints and snapped fan blades could be seen on the tops of UPS units. Annmarie Wakefield, UPS Technical Manager for PPSPower, said:

“The client’s explanation for this was hard to believe. He told me the builders must have stood on top of the units to install the ceiling. There were six fans on top of each unit, which were quite clearly visible and loud, so they couldn’t be missed. I also noticed the batteries had been replaced – I found that this was done at the same time the room was built.”

The solution

It wasn’t quite Mission Impossible but we needed to come up with a quick-fix solution to get the customer’s data centre back up and running with minimal downtime. We organised for a generator to be installed to supply the load directly until we could install replacement UPS units.

Day 1

The customer had two 20ft containers delivered to site so that we could install two Riello MST units in each (N+3). Large holes were cut out of the side of each container and covered with mesh in order to allow hot air from the units to escape. Two air conditioning units were installed in each container to ensure enough cooling and we built batteries on Unistrut frames as a temporary measure.

Day 2 – day

UPS units were put into place, the input and output cables were connected (cables installed by others) battery isolators mounted, DC cabling installed from isolators to UPS and batteries connected. A hole was drilled between the two containers and the parallel cables were run in and connected. The units were powered up and checked for perfect operation.

Day 2 – evening

Two load banks were brought to site and connected to the units, and a one-hour load test was carried out. When all tests were successfully passed the units were powered down, the generator was powered off (controlled shutdown of load) and each UPS was connected onto the load bus bar. The units were started up and commissioned on load.

Within 72 hours of the initial call out we had four brand new units installed and commissioned in a new more suitable location. Our customer can now be confident that their critical systems will operate as expected.