Internet2 IP Network Operations Report
12/30/2013 - 01/05/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

221102-High 2-High Brief Outage Resolved - I2 IP Backbone LOSA-SEAT Software 01/02/2014 2:06 AM 01/02/2014 2:07 AM
221222-High 2-High Outage Resolved - I2 IP Backbone HOUS-KANS Circuit - Damaged Fiber 01/04/2014 10:10 PM 01/05/2014 8:04 PM

Unscheduled Outages Detail


Ticket No.:22110:45
Subject:Brief Outage Resolved - I2 IP Backbone LOSA-SEAT
Affected:Backbone LOSA-SEAT
Start Time:Thursday, January 2, 2014, 2:06 AM (0206) UTC
End Time:Thursday, January 2, 2014, 2:07 AM (0207) UTC
Description:Backbone LOSA-SEAT was briefly unavailable. Vendor engineers have advised that this was caused by a software issue in their network.

Ticket No.:22122:45
Subject:Outage Resolved - I2 IP Backbone HOUS-KANS
Affected:Backbone HOUS-KANS
Start Time:Saturday, January 4, 2014, 10:10 PM (2210) UTC
End Time:Sunday, January 5, 2014, 8:04 PM (2004) UTC
Description:Backbone HOUS-KANS is now available. Level(3) Communications technicians repaired damaged fiber and reset a faulty module in Dallas, TX to restore services. No further outages are expected. IP traffic should have re-routed.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

22114 3-Elevated 2-High Emergency Maintenance Completed - I2 IP Backbone SALT-SEAT Circuit 01/03/2014 7:08 AM 01/03/2014 7:11 AM
22105 3-Elevated 1-Critical Maintenance Completed - I2 IP Core Nodes ATLA,CHIC, WASH Hardware 01/04/2014 10:05 AM 01/04/2014 10:24 AM

Scheduled Maintenances Detail

Ticket No.:22114:45
Subject:Emergency Maintenance Completed - I2 IP Backbone SALT-SEAT
Affected:Backbone SALT-SEAT
Start Time:Friday, January 3, 2014, 7:08 AM (0708) UTC
End Time:Friday, January 3, 2014, 7:11 AM (0711) UTC
Description: Backbone SALT-SEAT was briefly unavailable while Level3 Communications Technicians performed Emergency maintenance. Maintenance has been completed. Backbone traffic re-routed during this maintenance.

Ticket No.:22105:45
Subject:Maintenance Completed - I2 IP Core Nodes ATLA,CHIC, WASH
Affected:Core Node ATLA and its Connector(s) and Participants
Core Node WASH and its Connector(s) and Participants
Core Node CHIC and its Connector(s) and Participants
Start Time:Saturday, January 4, 2014, 10:05 AM (1005) UTC
End Time:Saturday, January 4, 2014, 10:24 AM (1024) UTC
Description: Core Nodes ATLA and WASH were each briefly unavailable for 3 minutes while Internet2 Engineers restarted the routing process on the nodes. Maintenance has been completed. All connections to Core Nodes ATLA and WASH were affected. Please note that no work needed to be done on the CHIC core node.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 19 min0 hr 0 min 99.81151%100.00000% 99.98141% 99.99981%
CHIC MX960 0 hr 19 min0 hr 0 min 99.81151%100.00000% 99.97021% 99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99753% 99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96983% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96774% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98729% 99.99867%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97382% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96528% 100.00000%
WASH MX960 0 hr 19 min0 hr 0 min 99.81151%100.00000% 99.94725% 99.99962%

Aggregate Internet2 IP Core Nodes0 hr 57 min0 hr 57 min99.94345%100.00000%99.97592%99.99964%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98558%99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94877%99.99848%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82221%99.87591%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96642%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99070%99.99943%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99146%100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98387%100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75751%99.81785%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98482%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99165%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.97097%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95351%99.95636%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99241%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74423%99.81538%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74290%99.81538%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90172%99.96983%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90058%99.97002%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76947%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77080%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88179%99.89754%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88179%99.89754%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93909%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92999%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90893%99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91519%99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94327%99.99696%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93739%99.99696%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 21 hr 54 min21 hr 54 min 86.96429%86.96429% 99.63589%99.65638%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 21 hr 54 min21 hr 54 min 86.96429%86.96429% 99.63589%99.65638%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43211%99.59396%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43173%99.59358%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78085%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78104%99.90949%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82942%99.90930%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74917%99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75239%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.73399%99.82278%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.73399%99.82601%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85105%99.91101%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77857%99.83853%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.95978%99.98596%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.97325%99.99943%

Aggregate All Internet2 IP Backbone Circuits 44 hr 0 min0 hr 9 min 99.45437%99.45623% 99.86574%99.91390%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:22304:45
Subject:Maintenance - I2 IP Core Node KANS
Affected:Core Node KANS and its Connector(s) and Participants
Connector LEARN
Net+ Provider Dell
Start Time:Saturday, February 8, 2014, 11:00 AM (1100) UTC
End Time:Saturday, February 8, 2014, 12:00 PM (1200) UTC
Description: Core Node KANS will be unavailable while Internet2 Engineers reboot the routing engine. An outage is expected, and the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:22231:45
Subject:Maintenance 1 of 2 - I2 IP Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Tuesday, February 25, 2014, 8:00 AM (0800) UTC
End Time:Tuesday, February 25, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. IP traffic will re-route during this maintenance. An alternate window has been reserved for 2/28/14 at 0800-1400, should it be required.

Ticket No.:22234:45
Subject:Maintenance 2 of 2 - I2 IP Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Friday, February 28, 2014, 8:00 AM (0800) UTC
End Time:Friday, February 28, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. IP traffic will re-route during this maintenance. This is an alternate window for ticket 22231:45, should it be required.