Unified - Internet2 IP Network Operations Report
12/14/2015 - 12/20/2015

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

66414-Normal 1-Critical Brief Outage Resolved - I2 Optical DWDM System HOUS-JCSN UndeterminedVendor 12/14/2015 4:41 PM 12/14/2015 4:42 PM
66862-High 2-High Outage Resolved - I2 AL2S Backbone HART2-NEWY32AOA HardwareVendor 12/17/2015 12:02 PM 12/18/2015 2:53 AM
67061-Critical 1-Critical Outage Resolved - I2 Optical DWDM System BATO-JACK Cut or Damaged FiberVendor 12/18/2015 8:20 PM 12/19/2015 1:30 PM

Unscheduled Outages Detail


Ticket No.:6641:144
Subject:Brief Outage Resolved - I2 Optical DWDM System HOUS-JCSN
Source Of Impact:Vendor
Affected:DWDM System HOUS-JCSN
AL2S Backbone HOUS-JCSN
Optical Member NOAA N-Wave
Optical Member ESnet
Optical Member MISSiON
Start Time:Monday, December 14, 2015, 4:41 PM (1641) UTC
End Time:Monday, December 14, 2015, 4:42 PM (1642) UTC
Description:The above listed assets were briefly unavailable to the community. Level (3) Communications Engineers have investigated and determined the outage was caused by a partial fiber cut in Jackson, MS. Fiber crews have repaired the damaged fiber and service migration has successfully restored impacted customers. No further outages are expected.

Ticket No.:6686:144
Subject:Outage Resolved - I2 AL2S Backbone HART2-NEWY32AOA
Source Of Impact:Vendor
Affected:AL2S Backbone HART2-NEWY
IP Backbone CHIC-NEWY
IP Backbone CLEV-NEWY
Start Time:Thursday, December 17, 2015, 12:02 PM (1202) UTC
End Time:Friday, December 18, 2015, 2:53 AM (0253) UTC
Description:This ticket was initially sent out indicating a possible issue with IP services in New York, NY. Internet2 Engineers have determined that there is an issue with the above listed AL2S Backbone from HART2-NEWY. This issue caused a monitoring problem that presented a wide scope of possible impact. The actual impact has been determined as that AL2S Backbone and the associated impact is listed above. Internet2 Engineers emergency maintenance effort was successful in the resolution of this issue. The outage was resolved after a line card was replaced. Due to a configuration error, traffic was degraded briefly while engineers restored the link. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone. Backbone traffic re-routed during the impacted times. Issue has been resolved; no further outages are expected.

Ticket No.:6706:144
Subject:Outage Resolved - I2 Optical DWDM System BATO-JACK
Source Of Impact:Vendor
Affected:DWDM System BATO-JACK
AL2S Backbone BATO-JACK
IP Backbone ATLA-HOUS
Start Time:Friday, December 18, 2015, 8:20 PM (2020) UTC
End Time:Saturday, December 19, 2015, 1:30 PM (1330) UTC
Description:The above listed assets are currently available to the community. Level3 Communications Engineers reported the outage was due to fiber damage caused by excavation work being performed in Ponce De Leon, FL. Field Services have completed splicing cable at the damage location. Services have restored and no further outages are anticipated. Closing ticket

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

None during this report period

Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ASHB MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
Layer3 AL3S Backbone ASHB-ATLA R&E VLAN 55199 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%99.99905%
Layer3 AL3S Backbone ASHB-ATLA Commodity VLAN 55204 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%99.99905%
Layer3 AL3S Backbone ASHB-CHIC R&E VLAN 55198 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-CHIC Commodity VLAN 55203 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99526%100.00000%
Layer3 AL3S Backbone ASHB-CLEV R&E VLAN 55197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%100.00000%
Layer3 AL3S Backbone ASHB-CLEV Commodity VLAN 55202 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%100.00000%
Layer3 AL3S Backbone ASHB-NEWY R&E VLAN 55201 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-NEWY Commodity VLAN 55206 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-WASH R&E VLAN 55200 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%100.00000%
Layer3 AL3S Backbone ASHB-WASH Commodity VLAN 55205 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%100.00000%
I2-CHIC-WASH-VLAN-12131 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95370%99.99753%
I2-CHIC-WASH-VLAN-12132 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95370%99.99753%
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67460%99.82525%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 17 hr 10 min17 hr 10 min 89.78175%89.78175% 99.52603%99.62318%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79148%99.84195%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86699%99.96433%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92278%99.99583%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 14 hr 51 min14 hr 51 min 91.16071%91.16071% 99.65505%99.67820%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85902%99.89071%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.49454%99.62223%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.58959%99.65657%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91557%99.98027%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89261%99.93264%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77971%99.88559%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77971%99.88559%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98918%99.99602%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98918%99.99602%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82411%99.89849%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71596%99.74784%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71596%99.74784%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79148%99.84195%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86434%99.93606%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 17 hr 10 min17 hr 10 min 89.78175%89.78175% 99.61749%99.64253%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99279%99.99734%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95294%99.98065%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97666%99.99981%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92524%99.93701%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.63323%99.68257%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98577%99.99962%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97344%99.99962%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98672%100.00000%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90741%99.93359%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84081%99.85770%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99450%99.99829%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74480%99.74803%

Aggregate All Unified - Internet2 IP Backbone Circuits 49 hr 11 min0 hr 0 min 99.52007%99.52007% 99.90172%99.92978%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:6711:144
Subject:Maintenance - I2 AL2S Various Circuits
Affected:
Start Time:Wednesday, December 23, 2015, 5:00 AM (0500) UTC
End Time:Wednesday, December 23, 2015, 6:00 AM (0600) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform a maintenance to swap in a warm spare. An outage of up to one hour is expected; however, the entire window is reserved.

Ticket No.:6657:144
Subject:Maintenance - I2 Optical DWDMs CLEV-DETR, DETR-EQCH DWDM
Affected:DWDM System CLEV-DETR
DWDM System DETR-EQCH
AL2S Backbones(s) ASHB-CHIC and CLEV-EQCH
IP Backbone CHIC-CLEV, CHIC-NEWY, and CHIC-WASH
Customer NORDUnet
Customer Merit Network
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Thursday, January 7, 2016, 6:00 AM (0600) UTC
End Time:Thursday, January 7, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers move the optical node in Detroit to a new rack location. Outages are expected. The entire window is reserved.

Ticket No.:6648:144
Subject:Maintenance 1 of 2 - I2 Optical DWDM System ASHB-PITT
Affected:DWDM System ASHB-PITT
AL2S Backbone(s) ASHB-PITT and ASHB-CHIC
IP Backbone(s) ATLA-CLEV, CHIC-WASH, CLEV-WASH
Connector 3ROX (ASHB)
Customer NORDUnet
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Saturday, January 9, 2016, 5:00 AM (0500) UTC
End Time:Saturday, January 9, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform maintenance to relocate cable in Hancock, MD. An outage of 6 hours is expected; however, the entire window is reserved.

Ticket No.:6650:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM System ASHB-PITT
Affected:DWDM System ASHB-PITT
AL2S Backbone(s) ASHB-PITT and ASHB-CHIC
IP Backbone(s) ATLA-CLEV, CHIC-WASH, CLEV-WASH
Connector 3ROX (ASHB)
Customer NORDUnet
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Sunday, January 10, 2016, 5:00 AM (0500) UTC
End Time:Sunday, January 10, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform maintenance to relocate cable in Hancock, MD. An outage of 6 hours is expected; however, the entire window is reserved. This is an alternate maintenance window if needed.

Ticket No.:6249:144
Subject:Maintenance - I2 Core Node SING
Affected:Core Node Singapore and its Connectors and Participants
Start Time:Thursday, January 14, 2016, 1:00 AM (0100) UTC
End Time:Friday, January 22, 2016, 1:00 PM (1300) UTC
Description: The above listed asset is expected to remain available while TATA performs power maintenance. This power maintenance is set to happen one feed at a time to avoid unnecessary impact. It is a multi-day event. No outages are expected. The entire window is reserved. All connections to the Core Node will be affected in the unlikely event of impact by this maintenance.