3ROX has successfully replaced the equipment that was creating the observered errors and traffic has returned to normal. We will continue to monitor the situation closely and maintain regular communication with 3ROX.
The southern segment of the state network remains routed through an alternate path as we continue to monitor the resolved issues. This will persist until we are confident in the reliability of the solution.
Any further issues will be posted on the status page, and you may contact the WVNET helpdesk 24×7 for any addtional assistance.
3ROX is actively working on mitigation steps to address the current network issues. Users should start noticing improvements in connectivity, although some additional problems may persist until the issue is fully resolved.
3ROX has thoroughly investigated the reported issues and is experiencing similar symptoms. They have identified potential equipment problems, which are currently being diagnosed, and are working on mitigation strategies.
Poor performance is still being observed via 3ROX in the Northern part of the state. This is occurring due to dropped packets and increased latency.
3ROX has been asked to escalate with Google peering to resolve this issue.
From 3ROX: “Internet2 swapped out an optic in Ashburn yesterday and we haven’t seen any flaps since about 10pm yesterday. Google is reluctant to turn the peering back up until it has been stable a bit longer.”
Experiencing packet loss out our north connection to the Internet and Internet2.
Began noticing some dropped packets and latency out our northern upstream ISP today around 2:30PM.
Engaged with that ISP and they are working to mitigate and correct the issue. They are reporting it’s related to Google peering services on both Commodity and Internet 2 links.