Generated Report for Internet2 IP

Internet2 IP Network Operations Report
12/02/2013 - 12/08/2013

Internet2 IP Network Operations Center
at Indiana University

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

21976	2-High	2-High	Brief Outage - I2 IP Backbone CHIC-CLEV and ATLA-WASH	Undetermined	12/04/2013 4:29 PM	12/04/2013 4:30 PM
21986	2-High	2-High	Availability - I2 IP Backbone ATLA-HOUS	Undetermined	12/06/2013 6:28 AM	12/06/2013 6:29 AM
21987	3-Elevated	3-Elevated	Brief Outage Resolved - I2 IP Backbone HOUS-KANS	Circuit - Bumped Fiber	12/06/2013 3:40 PM	12/06/2013 3:41 PM

Unscheduled Outages Detail

Ticket No.:	21976:45
Subject:	Brief Outage - I2 IP Backbone CHIC-CLEV and ATLA-WASH
Affected:	Backbones ATLA-WASH and CHIC-CLEV
Start Time:	Wednesday, December 4, 2013, 4:29 PM (1629) UTC
End Time:	Wednesday, December 4, 2013, 4:30 PM (1630) UTC
Description:	Backbones ATLA-WASH and CHIC-CLEV were briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. IP traffic was re-routed.

Ticket No.:	21986:45
Subject:	Availability - I2 IP Backbone ATLA-HOUS
Affected:	Backbone Circuit ATLA-HOUS
Start Time:	Friday, December 6, 2013, 6:28 AM (0628) UTC
End Time:	Friday, December 6, 2013, 6:29 AM (0629) UTC
Description:	Backbone Circuit ATLA-HOUS was briefly operating at a reduced capacity. Level(3) Communications is investigating the cause; however, the reason for the outage is pending. Traffic continued to pass over the backbone, at a reduced capacity. The Internet2 IP Network (R&E/Commodity) Backbone ATLA-HOUS remained available.

Ticket No.:	21987:45
Subject:	Brief Outage Resolved - I2 IP Backbone HOUS-KANS
Affected:	Backbone HOUS-KANS
Start Time:	Friday, December 6, 2013, 3:40 PM (1540) UTC
End Time:	Friday, December 6, 2013, 3:41 PM (1541) UTC
Description:	Backbone HOUS-KANS was briefly unavailable. Vendor Engineers report the outage was due to a fiber bump in Tuscon, AZ. Traffic was re-routed.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

21950	3-Elevated	2-High	Maintenance Completed - I2 IP Backbone ATLA-CHIC	Circuit	12/03/2013 3:10 AM	12/03/2013 3:12 AM
21939	3-Elevated	2-High	Maintenance Completed - I2 IP Backbone ATLA-WASH	Hardware	12/03/2013 5:22 AM	12/03/2013 5:39 AM
21884	3-Elevated	2-High	Maintenance Completed - I2 IP Backbone KANS-SALT	Circuit	12/03/2013 7:30 AM	12/03/2013 10:42 AM
21991	3-Elevated	2-High	Emergency Maintenance Completed - I2 IP Backbone CLEV-NEWY32AOA	Circuit	12/07/2013 8:17 PM	12/07/2013 8:50 PM

Scheduled Maintenances Detail

Ticket No.:	21950:45
Subject:	Maintenance Completed - I2 IP Backbone ATLA-CHIC
Affected:	IP Backbone ATLA-CHIC Connector University of Louisville (KyRON) Connector SOX via Internet2 Optical
Start Time:	Tuesday, December 3, 2013, 3:10 AM (0310) UTC
End Time:	Tuesday, December 3, 2013, 3:12 AM (0312) UTC
Description:	IP Backbone ATLA-CHIC was briefly unavailable while Level(3) Communications performed maintenance in Caneyville, KY. Maintenance has been completed.

Ticket No.:	21939:45
Subject:	Maintenance Completed - I2 IP Backbone ATLA-WASH
Affected:	Backbone ATLA-WASH
Start Time:	Tuesday, December 3, 2013, 5:22 AM (0522) UTC
End Time:	Tuesday, December 3, 2013, 5:39 AM (0539) UTC
Description:	Backbone ATLA-WASH was unavailable while Internet2 AL2S Engineers performed maintenance to install a new core node in Charlotte, NC. Maintenance has been completed.

Ticket No.:	21884:45
Subject:	Maintenance Completed - I2 IP Backbone KANS-SALT
Affected:	Connector CalREN (KANS)* Backbone KANS-SALT
Start Time:	Tuesday, December 3, 2013, 7:30 AM (0730) UTC
End Time:	Tuesday, December 3, 2013, 10:42 AM (1042) UTC
Description:	The above listed was unavailable while Level(3) Communications performed fiber maintenance in Denver, CO. Maintenance has been completed. * denotes connector is multihomed and will remain available to the community.

Ticket No.:	21991:45
Subject:	Emergency Maintenance Completed - I2 IP Backbone CLEV-NEWY32AOA
Affected:	Backbone CLEV-NEWY32AOA
Start Time:	Saturday, December 7, 2013, 8:17 PM (2017) UTC
End Time:	Saturday, December 7, 2013, 8:50 PM (2050) UTC
Description:	Backbone CLEV-NEWY32AOA was unavailable while vendor Engineers performed maintenance. The maintenance has been completed. IP traffic was re-routed during this maintenance.

Downtime and Availability

Internet2 IP Core Nodes	Down Time		Reporting Period Availability		52 Week Availability
ATLA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.98501%	99.99981
CHIC MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.98216%	99.99905
CLEV MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.99848%	99.99924
HOUS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.96983%	100.00000
KANS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.99886%	100.00000
LOSA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.97059%	100.00000
NEWY MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.98729%	99.99867
SALT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.97875%	100.00000
SEAT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.96604%	100.00000
WASH MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000	99.95086%	99.99962

Aggregate Internet2 IP Core Nodes	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97879%	99.99964%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone Circuits	Down Time		Reporting Period Availability		52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181	0 hr 2 min	0 hr 0 min	99.98016%	100.00000%	99.99488%	99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99545%	100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179	0 hr 18 min	0 hr 1 min	99.82143%	99.99008%	99.94877%	99.99848%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.98179%	99.99962%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99772%	100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99355%	99.99943%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99241%	100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99943%	100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.76624%	99.81785%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99943%	100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99943%	100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97476%	99.99924%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95541%	99.95636%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99867%	99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419	0 hr 2 min	0 hr 0 min	99.98016%	100.00000%	99.75353%	99.81538%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638	0 hr 2 min	0 hr 0 min	99.98016%	100.00000%	99.75353%	99.81538%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.90760%	99.96983%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.90779%	99.97002%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.77080%	99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.77080%	99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99981%	99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.89109%	99.89754%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.89109%	99.89754%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95712%	100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94801%	100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893	0 hr 33 min	0 hr 0 min	99.67262%	100.00000%	99.91177%	99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.91803%	99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94460%	99.99734%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.93871%	99.99734%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.90077%	99.90570%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.90077%	99.90570%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.44084%	99.59396%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.44046%	99.59358%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138	3 hr 12 min	0 hr 0 min	98.09524%	100.00000%	99.79565%	99.90949%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566	3 hr 12 min	0 hr 0 min	98.09524%	100.00000%	99.79584%	99.90968%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935	3 hr 12 min	0 hr 0 min	98.09524%	100.00000%	99.84422%	99.90949%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.75713%	99.80685%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.76036%	99.80685%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73550%	99.82070%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73550%	99.82392%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84422%	99.90228%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.77174%	99.82980%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96604%	99.98596%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97951%	99.99943%

Aggregate All Internet2 IP Backbone Circuits	10 hr 36 min	10 hr 32 min	99.86855%	99.99917%	99.88606%	99.92645%

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances

Ticket No.:	21990:45
Subject:	Maintenance Tracking - I2 IP Backbone NEWY32AOA-WASH and ATLA-WASH
Affected:	Backbone NEWY32AOA-WASH
Start Time:	Wednesday, December 11, 2013, 5:01 AM (0501) UTC
End Time:	Wednesday, December 11, 2013, 7:01 AM (0701) UTC
Description:	Backbone NEWY32AOA-WASH will be unavailable while Internet2 Engineers perform maintenance to install a new core node in Philadelphia, PA. Outages are expected, and the entire window is reserved. Traffic will re- route during the maintenance.

Ticket No.:	21944:45
Subject:	Maintenance 1 of 2 - I2 IP Connector MissiON (ATLA)
Affected:	Connector MissiON and its Participants (ATLA)
Start Time:	Wednesday, December 11, 2013, 6:00 AM (0600) UTC
End Time:	Wednesday, December 11, 2013, 12:00 PM (1200) UTC
Description:	Connector MissiON (ATLA) will be unavailable while Level(3) Communications performs fiber maintenance to repair fiber destroyed by a lightning strike in Savannah, TN. An outage of 30 mins to 6 hours is expected; however the entire window is reserved. An alternate window has been scheduled for December 12, 2013 from 6:00 - 12:00 UTC.

Ticket No.:	21945:45
Subject:	Maintenance 2 of 2 - I2 IP Connector MissiON (ATLA)
Affected:	Connector MissiON and its Participants (ATLA)
Start Time:	Thursday, December 12, 2013, 6:00 AM (0600) UTC
End Time:	Thursday, December 12, 2013, 12:00 PM (1200) UTC
Description:	Connector MissiON (ATLA) will be unavailable while Level(3) Communications performs fiber maintenance to repair fiber destroyed by a lightning strike in Savannah, TN. An outage of 30 mins to 6 hours is expected; however the entire window is reserved. This is the alternate window for maintenance ticket 2424 being performed on December 11, 2013 from 6:00-12:00 UTC

Ticket No.:	21995:45
Subject:	Maintenance - I2 IP Backbones CHIC-CLEV and CHIC-KANS
Affected:	Backbones CHIC-CLEV and CHIC-KANS
Start Time:	Friday, December 13, 2013, 6:00 AM (0600) UTC
End Time:	Friday, December 13, 2013, 10:00 AM (1000) UTC
Description:	The above listed will be unavailable while Internet2 Engineers perform power maintenance in the Internet2 Chicago suite. The Internet2 AL2S CHIC core node will be unavailable for approximately 1 hour however the entire maintenance window is reserved.