#807 Outage Global Switch Amsterdam

Posted: 2019-06-07 14:48

Start: 2019-06-07 14:22:00
End : 2019-06-07 14:38:00

Affects: Routing towards GSA, Internet customers terminated at GSA

We have experienced a router linecard crash at 14:22, causing an outage on our network in Global Switch Amsterdam.

The linecard is back online and we have created a case at our vendor regarding to this crash.

Update 10-06-2019:
Vendor confirmed existing bug which is resolved with the next firmware. We are awaiting on the release of this firmware.

#797 Outage connectivity between GSA and NZS

Posted: 2019-04-28 00:17

Start: 2019-04-27 23:12:00
End : 2019-04-27 23:54:00

Affects: Traffic NZS

At 23:12 we received notification of the connection towards GSA (Global Switch Amsterdam) as well as in-house patch connections going down. After inspection we noticed this issue appears to be an in house issue at Nedzone.

At 23:54, we received notification the connection gone up again.

Currently we are still awaiting more information from Nedzone about the issue.

Update 28-04-2019 4:39:
The datacenter has updated us that the cause of this disruption was caused by a power cut. Our floor was unaffected but did cause equipment on the other floor, where our NZS - GSA Connection is connected on to go down.

#796 Packetloss / networkloss DBC

Posted: 2019-04-25 16:51

Start: 2019-04-25 15:25:00
End : 2019-04-25 16:17:00

Affects: Connectivity DBC

At 15:25 we got warning alerts from our monitoring system that packetloss was noticed on multiple switches throughout the network in DBC.

After debugging we traced this back to one of the linecards in one of the coreswitches, as all ports on this card are setup redundantly we have rebooted this linecard.

After it went back online we first tested with a small number of racks to check the stability before enabling all the ports.

At this moment all ports have been enabled and stability has been resumed, we will keep monitoring this linecard and if the same issue occurs we will replace the linecard in question.

#791 Power outage d4.z1 Databarn Capelle

Posted: 2019-04-19 14:22

Start: 2019-04-19 12:52:00
End : 2019-04-19 13:58:00

Affects: Servers in d4.z1 DBC

At 12:52 CEST we had a power outage in rack d4.z1 in Databarn Capelle, causing several servers and one switch to go down.

We sent one of our engineers over right away to assess the situation.
He has replaced a power distribution unit which seems to be defective.

Currently the rack is back online and all servers are operational again.

#787 Darkfiber outage DBC - EQX-AM7

Posted: 2019-04-13 01:52

Start: 2019-04-13 01:00:00
End : 2019-04-14 03:00:00

Affects: Redundancy DBC

At 01:00 CEST a darkfiber between DBC (Datbarn Capelle) and EQX-AM7 (Equinix AM7) went down, carrying 400 Gbps traffic.

Currently all traffic is sent over the alternative path on our ring namely DBC - GSA while we are investigating the cause into this.

Update 2019-04-13 03:32 CEST:
We've spoken to the darkfiber provider euNetworks and this is because of a maintenance which was not communicated to us.

Update 2019-04-14 09:00 CEST:
Currently the line is back online and our redundancy is operational again.