Internet2 IP Network Operations Report
09/09/2013 - 09/15/2013

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

215102-High 2-High Internet2 IP Network Backbone Circuit SALT-SEAT Brief Outage Undetermined 09/11/2013 7:22 PM 09/11/2013 7:25 PM
215202-High 2-High Internet2 Advanced Layer 3 Services Backbone Circuit CHIC-CLEV Brief Outage Undetermined 09/13/2013 1:51 PM 09/13/2013 1:52 PM

Unscheduled Outages Detail


Ticket No.:21510:45
Subject:Internet2 IP Network Backbone Circuit SALT-SEAT Brief Outage
Affected:Backbone SALT-SEAT
ION Backbone SALT-SEAT
Start Time:Wednesday, September 11, 2013, 7:22 PM (1922) UTC
End Time:Wednesday, September 11, 2013, 7:25 PM (1925) UTC
Description:Backbone SALT-SEAT was briefly unavailable to the community. Vendor Engineers have been contacted; however, the reason for outage is pending.

Ticket No.:21520:45
Subject:Internet2 Advanced Layer 3 Services Backbone Circuit CHIC-CLEV Brief Outage
Affected:Backbone Circuit CHIC-CLEV
Start Time:Friday, September 13, 2013, 1:51 PM (1351) UTC
End Time:Friday, September 13, 2013, 1:52 PM (1352) UTC
Description:The above listed circuit was briefly unavailable. Vendor Engineers have been contacted. No reason for outage has been provided. Updates will be provided as received.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

21450 3-Elevated 2-High Internet2 IP Network Backbone Circuit ATLA-CHIC Maintenance Completed Circuit 09/12/2013 5:56 AM 09/12/2013 5:57 AM
21516 3-Elevated 2-High Internet2 Advanced Layer 3 Services Backbone Circuits CLEV-CHIC and CHIC KANS Emergency Maintenance Completed Software 09/13/2013 6:06 AM 09/13/2013 6:09 AM
09/13/2013 6:16 AM 09/13/2013 6:19 AM
21517 3-Elevated 2-High Internet2 IP Network Core Nodes CHIC-CHIC and KANS-KANS Inteconnect Emergency Maintenance Completed Software 09/13/2013 6:06 AM 09/13/2013 6:09 AM
09/13/2013 6:16 AM 09/13/2013 6:19 AM
21521 3-Elevated 2-High Internet2 Advanced Layer 3 Services Various Backbone Circuits (ATLA) Emergency Maintenance Completed Software 09/15/2013 8:07 AM 09/15/2013 8:10 AM
21522 3-Elevated 2-High Internet2 Advanced Layer 3 Services Various Backbone Circuits (CLEV) Emergency Maintenance Completed Software 09/15/2013 8:21 AM 09/15/2013 8:24 AM
21523 3-Elevated 2-High Internet2 Advanced Layer 3 Services Various Backbone Circuits (HOUS) Emergency Maintenance Completed Software 09/15/2013 8:34 AM 09/15/2013 8:37 AM
21525 3-Elevated 2-High Internet2 Advanced Layer 3 Services Various Backbone Circuits (NEWY) Emergency Maintenance Completed Software 09/15/2013 8:00 AM 09/15/2013 8:03 AM
21526 3-Elevated 2-High Internet2 Advanced Layer 3 Services Various Backbone Circuits (SALT) Emergency Maintenance Completed Software 09/15/2013 8:49 AM 09/15/2013 8:52 AM

Scheduled Maintenances Detail

Ticket No.:21450:45
Subject:Internet2 IP Network Backbone Circuit ATLA-CHIC Maintenance Completed
Affected:Backbone Circuit ATLA-CHIC
Start Time:Thursday, September 12, 2013, 5:56 AM (0556) UTC
End Time:Thursday, September 12, 2013, 5:57 AM (0557) UTC
Description: Backbone Circuit ATLA-CHIC was unavailable while Level(3) Engineers performed maintenance. Maintenance has been completed.

Ticket No.:21516:45
Subject:Internet2 Advanced Layer 3 Services Backbone Circuits CLEV-CHIC and CHIC KANS Emergency Maintenance Completed
Affected:Backbone Circuits CHIC-CLEV
Backbone Circutis CHIC-KANS
Start Time:Friday, September 13, 2013, 6:06 AM (0606) UTC
End Time:Friday, September 13, 2013, 6:09 AM (0609) UTC
Start Time:Friday, September 13, 2013, 6:16 AM (0616) UTC
End Time:Friday, September 13, 2013, 6:19 AM (0619) UTC
Description: The above listed was unavailable while Internet2 Engineers enabled error correction on the Layer 2 gear. Maintenance has been completed. Backbone Traffic re-routed.

Ticket No.:21517:45
Subject:Internet2 IP Network Core Nodes CHIC-CHIC and KANS-KANS Inteconnect Emergency Maintenance Completed
Affected:Core Node CHIC-CHIC Interconnect
Core Node KANS-KANS Interconnect
Start Time:Friday, September 13, 2013, 6:06 AM (0606) UTC
End Time:Friday, September 13, 2013, 6:09 AM (0609) UTC
Start Time:Friday, September 13, 2013, 6:16 AM (0616) UTC
End Time:Friday, September 13, 2013, 6:19 AM (0619) UTC
Description: The above listed was unavailable while Internet2 Engineers enabled error correction on the Advanced Layer 2 Services gear. Maintenance has been completed. Backbone Traffic re-routed.

Ticket No.:21521:45
Subject:Internet2 Advanced Layer 3 Services Various Backbone Circuits (ATLA) Emergency Maintenance Completed
Affected:Backbone Circuits ATLA-CHIC
Backbone Circuits ATLA-HOUS
Backbone Circuits ATLA-WASH
Start Time:Sunday, September 15, 2013, 8:07 AM (0807) UTC
End Time:Sunday, September 15, 2013, 8:10 AM (0810) UTC
Description: The above affected was briefly unavailable while Internet2 Engineers performed software maintenance to resolve switch fabric errors on the switch. Maintenance has been completed.Traffic re-routed during this maintenance.

Ticket No.:21522:45
Subject:Internet2 Advanced Layer 3 Services Various Backbone Circuits (CLEV) Emergency Maintenance Completed
Affected:Backbone Circuits CHIC-CLEV
Backbone Circuits CLEV-NEWY
Backbone Circuits CLEV-WASH
Start Time:Sunday, September 15, 2013, 8:21 AM (0821) UTC
End Time:Sunday, September 15, 2013, 8:24 AM (0824) UTC
Description: The above affected was briefly unavailable while Internet2 Engineers performed software maintenance to resolve switch fabric errors on the switch. Maintenance has been completed.Traffic re-routed during this maintenance.

Ticket No.:21523:45
Subject:Internet2 Advanced Layer 3 Services Various Backbone Circuits (HOUS) Emergency Maintenance Completed
Affected:Backbone Circuits ATLA-HOUS
Backbone Circuits HOUS-KANS
Backbone Circuits HOUS-LOSA
Start Time:Sunday, September 15, 2013, 8:34 AM (0834) UTC
End Time:Sunday, September 15, 2013, 8:37 AM (0837) UTC
Description: The above affected was briefly unavailable while Internet2 Engineers performed software maintenance to resolve switch fabric errors on the switch. Maintenance has been completed.Traffic re-routed during this maintenance.

Ticket No.:21525:45
Subject:Internet2 Advanced Layer 3 Services Various Backbone Circuits (NEWY) Emergency Maintenance Completed
Affected:Backbone Circuits CLEV-NEWY
Backbone Circuits NEWY-WASH
Start Time:Sunday, September 15, 2013, 8:00 AM (0800) UTC
End Time:Sunday, September 15, 2013, 8:03 AM (0803) UTC
Description: The above affected was briefly unavailable while Internet2 Engineers performed software maintenance to resolve switch fabric errors on the switch. Maintenance has been completed.Traffic re-routed during this maintenance.

Ticket No.:21526:45
Subject:Internet2 Advanced Layer 3 Services Various Backbone Circuits (SALT) Emergency Maintenance Completed
Affected:Backbone Circuits KANS-SALT
Backbone Circuits LOSA-SEAT
Backbone Circuits SALT-SEAT
Start Time:Sunday, September 15, 2013, 8:49 AM (0849) UTC
End Time:Sunday, September 15, 2013, 8:52 AM (0852) UTC
Description: The above affected was briefly unavailable while Internet2 Engineers performed software maintenance to resolve switch fabric errors on the switch. Maintenance has been completed.Traffic re-routed during this maintenance. Traffic will re-route during this maintenance.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98501% 99.99981
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98197% 99.99905
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99924% 100.00000
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96983% 100.00000
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99886% 100.00000
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97382% 100.00000
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98729% 99.99867
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97875% 100.00000
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96604% 100.00000
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.95067% 99.99962

Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97915%99.99971%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99526%99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 6 min0 hr 0 min 99.94048%100.00000% 99.99545%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99545%100.00000%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 16 min0 hr 1 min 99.84127%99.99008% 99.98843%99.99981%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 12 min0 hr 0 min 99.88095%100.00000% 99.99772%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 5 min0 hr 0 min 99.95040%100.00000% 99.99488%100.00000%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99829%100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99943%100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99943%100.00000%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97476%99.99924%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.99905%100.00000%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 6 min0 hr 3 min 99.94048%99.97024% 99.99867%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65714%99.72981%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65714%99.72981%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83341%99.86548%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83341%99.86548%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75562%99.85713%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75562%99.85713%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89754%99.89754%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89754%99.89754%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95712%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93056%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94213%99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94213%99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95029%99.99734%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95029%99.99734%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89659%99.90570%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69547%99.70458%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43913%99.56189%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43894%99.56170%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81652%99.90949%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81671%99.90968%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88065%99.90949%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95294%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95219%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73493%99.82051%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73854%99.82373%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91936%99.97742%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84688%99.90494%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 3 min0 hr 3 min 99.97024%99.97024% 99.96566%99.98596%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 3 min0 hr 3 min 99.97024%99.97024% 99.97913%99.99943%

Aggregate All Internet2 IP Backbone Circuits 2 hr 18 min1 hr 14 min 99.98471%99.99793% 99.89519%99.92878%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:21500:45
Subject:Internet2 Advanced Layer 3 Services, IP Network, and ION Backbone Circuits KANS-SALT Maintenance
Affected:Backbone Circuits KANS-SALT
Start Time:Wednesday, September 25, 2013, 6:00 AM (0600) UTC
End Time:Wednesday, September 25, 2013, 12:00 PM (1200) UTC
Description: Backbone Circuits KANS-SALT will be unavailable while Level(3) Communications fiber relocation maintenance in Broomfield, CO. An outage of 2 hours is expected; however the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:21502:45
Subject:Internet2 Advanced Layer 3 Services, IP Network, and ION Backbone Circuits KANS-SALT Maintenance Alternate Window
Affected:Backbone Circuits KANS-SALT
Start Time:Thursday, September 26, 2013, 6:00 AM (0600) UTC
End Time:Thursday, September 26, 2013, 12:00 PM (1200) UTC
Description: Backbone Circuits KANS-SALT will be unavailable while Level(3) Communications fiber relocation maintenance in Broomfield, CO. An outage of 2 hours is expected; however the entire window is reserved. IP traffic will re-route during this maintenance. This is an alternate window for ticket 21500:45, should it be required.