Unified - Internet2 IP Network Operations Report
06/12/2017 - 06/18/2017

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

142204-Normal 2-High Brief Outage Resolved - I2 AL2S Backbone MINN-MISS2 Human ErrorVendor 06/15/2017 9:17 PM 06/15/2017 9:24 PM
142314-Normal 1-Critical Outage - I2 Optical Various Circuits Cut or Damaged FiberVendor 06/16/2017 6:00 PM 06/17/2017 9:26 PM
142334-Normal 2-High Brief Outage Resolved - I2 AL2S Backbone ATLA-CHIC HardwareVendor 06/16/2017 6:00 PM 06/16/2017 6:01 PM
142494-Normal 1-Critical Outage Resolved - I2 Optical DWDM System CINC-INDI Unannounced MaintenanceVendor 06/17/2017 8:45 PM 06/17/2017 9:26 PM

Unscheduled Outages Detail


Ticket No.:14220:144
Subject:Brief Outage Resolved - I2 AL2S Backbone MINN-MISS2
Source Of Impact:Vendor
Affected:AL2S Backbone MINN-MISS2
Net+ Code 42
Start Time:Thursday, June 15, 2017, 9:17 PM (2117) UTC
End Time:Thursday, June 15, 2017, 9:24 PM (2124) UTC
Description:The above listed assets are now available after a brief outage. Zayo and Internet2 Engineers have been contacted. The reason for the outage was due to an unintentional card turn down. No further outages are expected.

Ticket No.:14231:144
Subject:Outage - I2 Optical Various Circuits
Source Of Impact:Vendor
Affected:AL2S Backbone CINC-INDI
IP Backbone CINC-INDI
Optical Member ESnet
IP Connector OARnet (CHIC)
IP Connector Indiana Gigapop (ATLA)
Start Time:Friday, June 16, 2017, 6:00 PM (1800) UTC
End Time:Saturday, June 17, 2017, 9:26 PM (2126) UTC
Description:The above listed assets are currently available. Level(3) Engineers have reported the outage was caused by dirty fiber, and an emergency fiber cleaning maintenance resolved the issue. No further outages are expected at this time.

Ticket No.:14233:144
Subject:Brief Outage Resolved - I2 AL2S Backbone ATLA-CHIC
Source Of Impact:Vendor
Affected:AL2S Backbone ATLA-CHIC
IP Backbone ATLA-CHIC
Start Time:Friday, June 16, 2017, 6:00 PM (1800) UTC
End Time:Friday, June 16, 2017, 6:01 PM (1801) UTC
Description:The above listed asset is available after a brief outage. Level(3) Engineers have reported the outage was related to a vendor hardware issue. All services have restored.

Ticket No.:14249:144
Subject:Outage Resolved - I2 Optical DWDM System CINC-INDI
Source Of Impact:Vendor
Affected:DWDM System CINC-INDI
AL2S Backbone ATLA-CHIC, CINC-INDI
IP Backbone ATLA-CHIC
Optical Member ESnet
Optical Member SoX
Optical Member Nordunet
Optical Member ESnet
Optical Member Indiana Gigapop
Optical Member University of Memphis
Optical Member NOAA N-Wave
Start Time:Saturday, June 17, 2017, 8:45 PM (2045) UTC
End Time:Saturday, June 17, 2017, 9:26 PM (2126) UTC
Description:The above listed assets are currently available. Level(3) Engineers have reported the reason for the outage is emergency fiber cleaning maintenance to resolve a pre-existing fiber issue. Services have restored and no further outages are anticipated at this time.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

14024 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone CHIC-CINC Software Vendor06/16/2017 6:10 AM 06/16/2017 6:12 AM

Scheduled Maintenances Detail

Ticket No.:14024:144
Subject:Maintenance Completed - I2 AL2S Backbone CHIC-CINC
Source Of Impact:Vendor
Affected:AL2S Backbone ATLA-CHIC
IP Backbone ATLA-CHIC
Start Time:Friday, June 16, 2017, 6:10 AM (0610) UTC
End Time:Friday, June 16, 2017, 6:12 AM (0612) UTC
Description: The above listed asset were unavailable while Level(3) Engineers performed maintenance. This maintenance has been completed.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ASHB MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97363%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86073%99.91253%
I2-ASHB-CHIC-VLAN-70336 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
I2-ATLA-CHIC-VLAN-09088 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.06079%99.23270%
I2-ATLA-CHIC-VLAN-09218 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.90578%99.10861%
I2-ATLA-CHIC-VLAN-67356 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93056%99.93340%
I2-ATLA-CHIC-VLAN-69781 0 hr 43 min0 hr 41 min 99.57341%99.59325% 99.51294%99.58770%
I2-ATLA-CHIC-VLAN-69782 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77136%99.81387%
I2-ATLA-CHIC-VLAN-69783 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75713%99.78541%
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51598%99.94536%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51730%99.94554%
I2-ATLA-JCSN-VLAN-70248 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95750%99.99734%
I2-ATLA-LOUI-VLAN-70330 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71805%99.78180%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57328%99.78806%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.59605%99.79072%
I2-CHIC-INDI-VLAN-70294 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88027%99.88027%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.56284%99.88521%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57802%99.88540%
I2-CHIC-STAR-VLAN-69798 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97154%99.99829%
I2-CHIC-WASH-VLAN-12131 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84479%99.97230%
I2-CHIC-WASH-VLAN-12132 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86035%99.98786%
I2-CINC-INDI-VLAN-70295 28 hr 6 min28 hr 6 min 83.27381%83.27381% 99.63836%99.64120%
I2-CLEV-NEWY32A0A-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91500%99.94365%
I2-ELPA-HOUH-VLAN-69875 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96053%99.99981%
I2-HOUH-JCSN-VLAN-70247 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
I2-MINN-MISS2-VLAN-69792 0 hr 7 min0 hr 7 min 99.93056%99.93056% 99.98653%99.98653%
I2-MISS2-SEAT-VLAN-69788 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-NEWY32AOA-PHIL-VLAN-70587 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%99.99981%
Layer3 AL3S Backbone ASHB-ATLA Commodity VLAN 55204 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81671%99.99867%
Layer3 AL3S Backbone ASHB-ATLA R&E VLAN 55199 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.78150%98.96459%
Layer3 AL3S Backbone ASHB-CHIC Commodity VLAN 55203 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86111%99.99564%
Layer3 AL3S Backbone ASHB-CHIC R&E VLAN 55198 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-CLEV Commodity VLAN 55202 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97799%100.00000%
Layer3 AL3S Backbone ASHB-CLEV R&E VLAN 55197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85542%99.97476%
Layer3 AL3S Backbone ASHB-NEWY Commodity VLAN 55206 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74196%99.79110%
Layer3 AL3S Backbone ASHB-NEWY R&E VLAN 55201 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71710%99.78844%
Layer3 AL3S Backbone ASHB-WASH Commodity VLAN 55205 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94460%100.00000%
Layer3 AL3S Backbone ASHB-WASH R&E VLAN 55200 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94346%100.00000%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.26305%99.41352%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.75569%98.99268%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88426%99.99905%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86813%99.99943%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91082%99.99621%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89697%99.97154%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43477%99.61388%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57916%99.77725%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72924%99.85105%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92714%99.94023%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82696%99.91253%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92126%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82184%99.91215%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88198%99.94915%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94194%99.99905%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.20177%99.41485%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.73520%99.14447%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78123%99.98729%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78123%99.98729%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68959%99.99924%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79224%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84024%99.90418%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73550%99.96300%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.21391%99.61160%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.31789%99.57005%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77763%99.99924%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.62963%99.90209%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87117%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87117%100.00000%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97363%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95010%100.00000%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93966%99.99905%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93985%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86073%99.91253%

Aggregate All Unified - Internet2 IP Backbone Circuits 28 hr 56 min0 hr 2 min 99.78200%99.78225% 99.74727%99.86124%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:14382:144
Subject:Maintenance - I2 Optical Circuit I2-NEWY32AOA-WASH-100GE-21036
Affected:
Start Time:Friday, June 30, 2017, 4:00 AM (0400) UTC
End Time:Friday, June 30, 2017, 10:00 AM (1000) UTC
Description: The above listed will be unavailable while Internet2 Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:14327:144
Subject:Maintenance - I2 Optical DWDM System BATO-HOUH
Affected:DWDM System BATO-HOUH
AL2S Backbone BATO-HOUH
IP Backbone BATO-HOUH
Member NOAA N-Wave
Member Louisianna Optical Network
Start Time:Friday, June 30, 2017, 5:00 AM (0500) UTC
End Time:Friday, June 30, 2017, 7:00 AM (0700) UTC
Description: The above listed assets will be unavailable while Level(3) Communications performs maintenance on the managed Ciena network in Iowa, LA. An outage is expected. The entire window is reserved.

Ticket No.:14323:144
Subject:Maintenance - I2 AL2S Backbones DENV-ELPA and ELPA-TUCS
Affected:AL2S Backbones DENV-ELPA and ELPA-TUCS
IP Backbones DENV-ELPA, DENV-KANS, ELPA-TUCS
GEANT - EUMETSAT
Start Time:Friday, June 30, 2017, 6:00 AM (0600) UTC
End Time:Friday, June 30, 2017, 8:00 AM (0800) UTC
Description: The above listed asset will be unavailable while Internet2 Engineers perform maintenance. An outage of less than an hour is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:14337:144
Subject:Maintenance - I2 Optical Member China Educational and Research Network
Affected:Optical Member China Educational and Research Network
Internet2 Singapore
Start Time:Friday, June 30, 2017, 4:00 PM (1600) UTC
End Time:Friday, June 30, 2017, 8:00 PM (2000) UTC
Description: The above listed assets will be unavailable while TATA Engineers perform maintenance. Outages are expected. The entire window is reserved.

Ticket No.:14409:144
Subject:Maintenance - I2 AL2S Backbone MINN-MISS2
Affected:AL2S Backbone MINN-MISS2
IP Backbone MINN-MISS2
Start Time:Saturday, July 15, 2017, 5:00 AM (0500) UTC
End Time:Saturday, July 15, 2017, 11:00 AM (1100) UTC
Description: The above-listed assets will be unavailable while Zayo Engineers perform maintenance. An outage of 6 hours is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:14178:144
Subject:Maintenance - I2 AL2S Backbone MINN-MISS2
Affected:AL2S Backbone MINN-MISS2
Start Time:Sunday, July 16, 2017, 12:00 PM (1200) UTC
End Time:Sunday, July 16, 2017, 6:00 PM (1800) UTC
Description: The above-listed asset will be unavailable while Zayo Engineers perform maintenance. An outage of 6 hours is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.