Unified - Internet2 IP Network Operations Report
01/09/2017 - 01/15/2017

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

117264-Normal 1-Critical Outage Resolved - I2 Optical DWDM System DENV-KANS Cut or Damaged FiberVendor 01/08/2017 7:49 PM 01/09/2017 3:31 AM
117994-Normal 1-Critical Brief Outage Resolved - I2 Optical DWDM System DALL-HOUS UndeterminedVendor 01/13/2017 5:28 PM 01/13/2017 5:30 PM

Unscheduled Outages Detail


Ticket No.:11726:144
Subject:Outage Resolved - I2 Optical DWDM System DENV-KANS
Source Of Impact:Vendor
Affected:DWDM System DENV-KANS
AL2S Backbone DENV-KANS
IP Backbone KANS-SALT
Optical Member ESnet
Optical Member NOAA N-Wave
Optical Member CENIC
Optical Member Front Range GigaPOP
Peer GEANT
Start Time:Sunday, January 8, 2017, 7:49 PM (1949) UTC
End Time:Monday, January 9, 2017, 3:31 AM (0331) UTC
Description:The above listed assets are now available to the community. Level(3) Communications Engineers arrived on site and reported the outage was due to extensive fiber damage caused by ice buildup. A splicing crew was onsite preparing the replacement fiber. Splicing crews have completed splicing on all tubes. This issue has been resolved. No further outages are expected.

Ticket No.:11799:144
Subject:Brief Outage Resolved - I2 Optical DWDM System DALL-HOUS
Source Of Impact:Vendor
Affected:DWDM System DALL-HOUS
AL2S Backbone DALL-HOUH
IP Backbone(s) HOUS-KANS
Start Time:Friday, January 13, 2017, 5:28 PM (1728) UTC
End Time:Friday, January 13, 2017, 5:30 PM (1730) UTC
Description:The above listed assets are now available to the community. Level (3) Communications Engineers stated that the reason for outage is undetermined.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

11622 3-Elevated 1-Critical Maintenance 1 of 2 Completed - I2 Optical DWDM System DALL-TULS Circuit Vendor01/13/2017 6:01 AM 01/13/2017 7:03 AM
11733 3-Elevated 1-Critical Maintenance Completed - I2 IP Backbone CHIC-KANS CircuitInternal 01/13/2017 6:37 AM 01/13/2017 6:38 AM

Scheduled Maintenances Detail

Ticket No.:11622:144
Subject:Maintenance 1 of 2 Completed - I2 Optical DWDM System DALL-TULS
Source Of Impact:Vendor
Affected:DWDM System DALL-TULS
AL2S Backbone DALL-TULS, HOUS-KANS
IP Backbone HOUS-KANS
Optical Member ESnet
Optical Member NOAA N-Wave
Optical Member OneNet
Start Time:Friday, January 13, 2017, 6:01 AM (0601) UTC
End Time:Friday, January 13, 2017, 7:03 AM (0703) UTC
Description: The above listed assets is now available after Level(3) Communications performed fiber relocation maintenance in Denton, TX. Maintenance has been completed. No further outages are expected. This is maintenance window 1 of 2.

Ticket No.:11733:144
Subject:Maintenance Completed - I2 IP Backbone CHIC-KANS
Source Of Impact:Internal
Affected:IP Backbone CHIC-KANS
Start Time:Friday, January 13, 2017, 6:37 AM (0637) UTC
End Time:Friday, January 13, 2017, 6:38 AM (0638) UTC
Description: The above assets were unavailable while Internet2 Engineers performed maintenance to migrate the backbone. Maintenance has been completed. IP traffic was re-routed during this maintenance.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ASHB MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
Layer3 AL3S Backbone ASHB-ATLA R&E VLAN 55199 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.44460%98.74167%
Layer3 AL3S Backbone ASHB-ATLA Commodity VLAN 55204 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.40622%99.61701%
Layer3 AL3S Backbone ASHB-CHIC R&E VLAN 55198 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-CHIC Commodity VLAN 55203 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71730%99.81551%
Layer3 AL3S Backbone ASHB-CLEV R&E VLAN 55197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81418%99.98392%
Layer3 AL3S Backbone ASHB-CLEV Commodity VLAN 55202 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98808%100.00000%
Layer3 AL3S Backbone ASHB-NEWY R&E VLAN 55201 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.00980%99.29496%
Layer3 AL3S Backbone ASHB-NEWY Commodity VLAN 55206 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60017%99.71768%
Layer3 AL3S Backbone ASHB-WASH R&E VLAN 55200 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87057%99.92658%
Layer3 AL3S Backbone ASHB-WASH Commodity VLAN 55205 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85411%99.92072%
I2-CHIC-WASH-VLAN-12131 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43006%99.61474%
I2-CHIC-WASH-VLAN-12132 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.41133%99.63026%
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.37462%99.64994%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.92068%99.24557%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60736%99.81078%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.62212%99.88912%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 1 min0 hr 0 min 99.99008%100.00000% 99.79659%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79526%99.88798%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.52959%99.88703%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 1 hr 4 min0 hr 2 min 99.36508%99.98016% 99.10309%99.49099%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.45939%99.81475%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.48853%99.79564%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.63707%99.90236%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71106%99.95534%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71106%99.95534%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97408%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97408%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43820%99.57368%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79091%99.99905%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79110%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60736%99.81078%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.33621%99.64861%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.00072%99.27339%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71182%99.84389%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82554%99.88949%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80567%99.99622%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89650%99.98335%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 1 hr 4 min0 hr 2 min 99.36508%99.98016% 99.27604%99.49156%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60358%99.84692%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 3 hr 31 min3 hr 31 min 97.90675%97.90675% 99.51919%99.71938%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78410%99.81229%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92185%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67681%99.86887%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76082%99.87852%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89233%99.99905%

Aggregate All Unified - Internet2 IP Backbone Circuits 5 hr 40 min2 hr 5 min 99.94470%99.96503% 99.69990%99.83887%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:11840:144
Subject:Maintenance - I2 IP Connector MAGPI
Affected:IP Connector MAGPI and its Participants
Start Time:Friday, January 20, 2017, 11:00 AM (1100) UTC
End Time:Saturday, January 21, 2017, 11:00 AM (1100) UTC
Description: *Please Note Maintenance Times Have Updated* The above listed asset will be unavailable while MAGPI Engineers perform co-location relocation maintenance. An outage of 6 hours is expected. The entire window is reserved.

Ticket No.:11863:144
Subject:Maintenance - I2 AL2S Backbone RALE-WASH
Affected:AL2S Backbone RALE-WASH
IP Backbone ATLA-CLEV
Start Time:Saturday, January 21, 2017, 3:00 AM (0300) UTC
End Time:Saturday, January 21, 2017, 5:00 AM (0500) UTC
Description: The above listed asset will be unavailable while Level(3) Engineers perform maintenance to replace an OCLD card in McLean, VA. A brief outage is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:11922:144
Subject:Emergency Maintenance - AL2S Core Node ASHB
Affected:AL2S Core Node XXXX
AL2S Backbone AAAA-ZZZZ *List all affected
IP Backbone AAAA-ZZZZ *If Affected
Start Time:Saturday, January 21, 2017, 5:00 AM (0500) UTC
End Time:Saturday, January 21, 2017, 6:00 AM (0600) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform (XX) maintenance. An outage of (Insert Time) is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:11871:144
Subject:Maintenance - I2 Optical Member China Educational and Research Network
Affected:Member China Educational and Research Network
Start Time:Saturday, January 21, 2017, 8:00 PM (2000) UTC
End Time:Saturday, January 21, 2017, 11:00 PM (2300) UTC
Description: Member China Educational and Research Network's Optical circuit, I2-MEGAI-HK-SING1- 10GE-12130, will be unavailable while China Educational and Research Network Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:11875:144
Subject:Maintenance - I2 AL2S Participant N-Wave
Affected:AL2S Participant NOAA N-Wave
Start Time:Monday, January 23, 2017, 1:30 AM (0130) UTC
End Time:Monday, January 23, 2017, 2:30 PM (1430) UTC
Description: The above listed asset should remain available while N-Wave Engineers perform maintenance. Outages are not expected, however the entire window is reserved.

Ticket No.:11837:144
Subject:Maintenance - I2 AL2S Various Participants (COLU4)
Affected:AL2S Participant USDA
AL2S Participant University of Minnesota
AL2S Participant CENIC
AL2S Participant XSEDE
AL2S Participant GPN
Start Time:Monday, January 23, 2017, 6:00 AM (0600) UTC
End Time:Monday, January 23, 2017, 8:00 AM (0800) UTC
Description: The above listed asset will be unavailable while GlobalNOC Engineers perform maintenance to migrate VLANs. An outage is expected. The entire window is reserved.

Ticket No.:11818:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:Optical Member NOAA N-Wave
Start Time:Tuesday, January 24, 2017, 4:00 AM (0400) UTC
End Time:Wednesday, January 25, 2017, 12:00 PM (1200) UTC
Description: Member N-Wave's above listed Optical circuits will be unavailable while N-Wave Engineers perform core node maintenance in Chicago, IL. Outages are expected, however the entire maintenance window has been reserved.

Ticket No.:11911:144
Subject:Maintenance - I2 IP Net+ Provider Box Inc.
Affected:Net+ Provider Box Inc.
Start Time:Tuesday, January 24, 2017, 8:00 AM (0800) UTC
End Time:Tuesday, January 24, 2017, 10:00 AM (1000) UTC
Description: Net+ Provider Box Inc. will be unavailable while Internet2 engineers perform maintenance. Outages are expected. The entire window is reserved.

Ticket No.:11865:144
Subject:Maintenance Correction - I2 Optical Various Circuits
Affected:AL2S Backbone HART2-NEWY32AOA
Optical Member NOAA N-Wave
IP Connector Max GigaPOP
Start Time:Wednesday, January 25, 2017, 5:00 AM (0500) UTC
End Time:Wednesday, January 25, 2017, 10:00 AM (1000) UTC
Description: *Please note the updated impact for this maintenance.* The above listed assets will be unavailable while Level(3) Communications performs maintenance to replace a WSS card in New York City, NY. Outages are expected throughout and the entire window is reserved.

Ticket No.:11739:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:Member NOAA N-Wave
Start Time:Thursday, January 26, 2017, 5:00 AM (0500) UTC
End Time:Thursday, January 26, 2017, 11:00 AM (1100) UTC
Description: Member NOAA N-Wave's Optical circuit I2-ATLA-CHAR-10GE-07618 will be unavailable while N-Wave Engineers perform maintenance. Outages are expected. The entire maintenance window has been reserved.

Ticket No.:11910:144
Subject:Maintenance - I2 IP Core Node Conversions for SUNN and PORT
Affected:IP Backbone LOSA-SEAT
AL2S Connector Oregon Gigapop
AL2S Connector Northern Crossroads
AL2S Connector ESnet
AL2S Connector CENIC
AL2S Connector U.S. Department of Agriculture
Start Time:Friday, January 27, 2017, 8:00 AM (0800) UTC
End Time:Friday, January 27, 2017, 2:00 PM (1400) UTC
Description: IP Backbone LOSA-SEAT will be unavailable while Internet2 Engineers perform router conversion maintenance to add IP and TR-CPS services to existing AL2S nodes in Portland, OR and Sunnyvale, CA. All other connections to the core nodes should remain available, but the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:11709:144
Subject:Maintenance - I2 Optical Member Center for Education Network Initiatives in California
Affected:Member Center for Education Network Initiatives in California
Start Time:Sunday, January 29, 2017, 8:00 PM (2000) UTC
End Time:Monday, January 30, 2017, 3:00 AM (0300) UTC
Description: Member Center for Education Network Initiatives in California's Optical circuit I2- SEAT-SUNN-100GE-07910 will be unavailable while CENIC Engineers perform maintenance. Outages are expected. The entire window is reserved.

Ticket No.:11730:144
Subject:Maintenance - I2 Optical Circuit GLOBAL-LOND-WASH2-100GE-01601
Affected:
Start Time:Friday, February 3, 2017, 5:00 AM (0500) UTC
End Time:Friday, February 3, 2017, 10:00 AM (1000) UTC
Description: *Kindly Note the Updated Maintenance Schedule* The above listed asset will be unavailable while vendor engineers perform maintenance. Outages are expected. The entire window is reserved.