AC problems in Capitol Complex

resolvedJun 9, 2025, 12:01 AM EDT
This issue has been resolved. Please contact the WVNET NOC if you experience network or server issues.
resolvedJun 8, 2025, 11:58 PM EDT
WVNET equipment continues to gradually return to pre-incident operating temperatures. Ambient temperatures are back to within acceptable operating thresholds, and should be back to pre-incident levels within another hour, at this rate.

At 11:09PM, WVOT reported that “The issue affecting the chilled water system in Building 6 has been resolved, and the data center is fully operational. ”

If customers notice issues, please contact the WVNET NOC.

updateJun 8, 2025, 10:30 PM EDT
WVNET sees the inlet temperatures in the network equipment dropping slowly but steadily since 9PM.

Still above normal operating temperatures, but we expect to get back to normal in approx 1-2 more hours, at this rate.

 

cause identifiedJun 8, 2025, 10:06 PM EDT
Pressure is building in the lines. It must be between 40-50 psi before they can turn on the pumps.

Currently at 36 and climbing. Have to wait on automatic air bleeders. Pump is back on and shouldn’t be long to begin cooling.

Continuing to monitor equipment temperature.

updateJun 8, 2025, 9:48 PM EDT
WVOT still has extra fans in the vault and we see temperature steady, moderating just a little.

General Services Division is still working to get the water flowing properly so that cooling can improve to normal levels.

updateJun 8, 2025, 9:00 PM EDT
Michael Ross at OT reports the water has been restored and chilled water is once again flowing to the AC units.

Now waiting for temperatures to normalize.

updateJun 8, 2025, 8:54 PM EDT
WVNET equipment is 2 degrees Celsius below where we will order a shutdown.

WVOT is attempting to get update from General Services Department and then make a decision on shutting down their equipment if they are not close to fixing.

WVNET will follow suit if this outage will continue longer than expected.

updateJun 8, 2025, 7:38 PM EDT
WVNET is seeing inlet temps as high as 51C (123.8F). We are looking at shutting down the network sooner than later. This will effectively cut off the South part of the state from all network connectivity until the AC issues can be resolved and power can be safely re-applied.
partial outageJun 8, 2025, 7:18 PM EDT
Water leak in the basement of a building in the Capitol Complex has negatively affected AC units in data rooms.
A water leak in a Capitol Complex building has caused no chilled water to be fed to a portion of the complex. This includes the Building 6 DataCenter and Vault, where much of the State’s network and server infrastructure resides.

ETA for fix is by 10PM. Some servers are being powered down. WVNET is waiting to see if powering down the network is necessary. Working closely with WVOT on timing of equipment shutdown and updates on AC fix.

Scroll to Top