At 00.10 CEST a darkfiber between DBC and GSA went down, carrying 200 Gbps traffic.

Currently all traffic is send over alternative paths on our ring, DBC - EQX-AM7 and DBC - NZS.

From DBC you might experience increased latency and lower throughput towards routes terminated at our GSA pop.

We have contacted the darkfiber provider euNetworks and requested a repair.

Update 11.50:
It was a planned maintenance of which we were not notified. This has been escalated to euNetworks to resolve.

At 03.10 the darkfiber was partially restored.

At 08.10 the darkfiber was full restored.

This morning after several messages of customers about packetloss with Seabone we started an investigation into these issues.

We found out the issue was with one of our BGP sessions with them and to resolve this while debugging we disabled this BGP session on all of the routers.

We shutdown the connections we had with them on this second connection and found out the issue lied in on of the ports, this issue has been solved now and the BGP sessions have been Established again.

We've tested with some of the IP's customers provided and do not see these issues currently.

Currently there is a fiber cut on the darkfiber connecting Nedzone (NZS) to Equinix AM7 (EQX-AM7).

We noticed that the connection went down on a few occasions after each other and contacted Eurofiber about this issue.

Update 2017-09-08 13.12:
We have seen the network connection re-established and stabilized.

Update 2017-09-08 13.30:
We received the reason of outage from Eurofiber:

Due to non-affecting maintenance from Eurofiber, the engineer of Eurofiber accidentally broke a fiber.

We haven't seen any further interruptions on this connection however we will monitor the connection to ensure stable performance.

Due to redundancy, our service was not effected.

*** Please note that this outage only affects customers with a fiber to the business internet connection. ***

Currently there is a partial outage for internet access customers. The core ring topology carrying traffic from/to customer end-points is experiencing unknown resource issues. This causes mac-addresses to timeout and not immediately get properly (re)installed and exchanged over the ring topology.

We are currently working as hard as we can to solve this issue en get everyone back online.

Update 16.25:
Hardware resources restored on slot 2 (ring-sw2.eqx-am7).

Update 17.25:
Hardware resources restored on chassis (ring-sw2.eqx-am7).

Update 2017-08-22 09.00:
Diagnostic-information send to vendor for debugging.

At 9.00 CEST the darkfiber going from DBC to Globalswitch Amsterdam (GSA) went down.

After having contact with the 3rd party maintaining the fiber a cable cut was discovered along the fiber in question, they are now sending engineers to the location of the cut.

At this moment we do not have an ETR available.

Currently all traffic is send over the other half of our ring between DBC - EQX-AM7, we do not expect issues.

Update 21:17:
Fibre crews are on-site and are currently trying to locate the joint which is buried in a new road scheme. There are construction crews either side of the joint location.

Update 22:00:
Fibre Crews are testing now on the closest joints to the fault. In parallel it is investigated if it is possible to move the route of the affected services to working spare fibres.

Update 00:14:
Due to the local conditions on site at the fault location further
digging works are necessary causing additional delay to the restoration.
We will keep you updated.

Update 9:00:
euNetworks Customer Care sees most of the alarms have cleared on our systems.
However, one Metro System remains down.
We have informed our local fibre provider to check these fibres with high priority to ensure fast restoration.
Please have your services checked and your ports reset.
In case of any problems please report back to us so we can ensure a fast resolution.

Update 15:00:
We have been informed that your service was affected by a fibre cut caused by civil works. There has been a delay in restoring your services as it was a partially fibre cut and it was very hard to locate the damage site. Due to the size of the construction site and to restore your services quicker we needed to move them to an alternate fiber pair. This has caused some extra delay as additional splicing was needed.

Our darkfiber running from DBC to GSA is now back to being fully functional again and the darkfiber ring now back to being redundant.