Generated Report for Internet2 IP

Internet2 IP Network Operations Report
02/24/2014 - 03/02/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

22456	2-High	2-High	Outage Resolved - I2 IP Backbone ATLA-WASH	Circuit - Bumped Fiber	02/24/2014 8:24 PM	02/24/2014 9:04 PM
22461	2-High	2-High	Instability Resolved - I2 IP Backbone CLEV-WASH	Circuit - Bumped Fiber	02/25/2014 5:01 PM	02/25/2014 6:17 PM
22474	2-High	2-High	Brief Outage Resolved - I2 IP Backbone CLEV-WASH	Circuit - Damaged Fiber	02/26/2014 7:40 PM	02/26/2014 7:45 PM
22486	2-High	2-High	Degraded Condition Resolved - I2 IP Backbone KANS-SALT	Hardware	02/27/2014 5:50 PM	02/27/2014 6:27 PM

Unscheduled Outages Detail

Ticket No.:	22456:45
Subject:	Outage Resolved - I2 IP Backbone ATLA-WASH
Affected:	Backbone ATLA-WASH
Start Time:	Monday, February 24, 2014, 8:24 PM (2024) UTC
End Time:	Monday, February 24, 2014, 9:04 PM (2104) UTC
Description:	Backbone ATLA-WASH is now available. Vendor Engineers caused the outage during troubleshooting. No further outages are expected. IP re-routed during the outage.

Ticket No.:	22461:45
Subject:	Instability Resolved - I2 IP Backbone CLEV-WASH
Affected:	Backbone CLEV-WASH
Start Time:	Tuesday, February 25, 2014, 5:01 PM (1701) UTC
End Time:	Tuesday, February 25, 2014, 6:17 PM (1817) UTC
Description:	Backbone CLEV-WASH is now stable. Internet2's fiber provider has indicated that the reason for the outage is multiple fiber bumps associated with non-Internet2 fiber testing. IP traffic re-routed during the instability.

Ticket No.:	22474:45
Subject:	Brief Outage Resolved - I2 IP Backbone CLEV-WASH
Affected:	Backbone CLEV-WASH
Start Time:	Wednesday, February 26, 2014, 7:40 PM (1940) UTC
End Time:	Wednesday, February 26, 2014, 7:45 PM (1945) UTC
Description:	Backbone CLEV-WASH was briefly unavailable. Vendor Engineers have indicated that the reason for the outage is fiber damage. IP traffic will re-route.

Ticket No.:	22486:45
Subject:	Degraded Condition Resolved - I2 IP Backbone KANS-SALT
Affected:	Backbone KANS-SALT
Start Time:	Thursday, February 27, 2014, 5:50 PM (1750) UTC
End Time:	Thursday, February 27, 2014, 6:27 PM (1827) UTC
Description:	Backbone KANS-SALT is available after being in a degraded state at the above listed times. Vendor Engineers resolved a hardware issue that was causing this degraded condition. A maintenance will occur within the next 4 hours to permanently resolve the issue.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

22231	3-Elevated	2-High	Maintenance 1 of 2 Completed - I2 IP Backbone LOSA-SALT	Circuit	02/25/2014 9:25 AM	02/25/2014 10:28 AM
22416	3-Elevated	2-High	Maintenance Completed - I2 IP Backbone ATLA-HOUS	Hardware	02/27/2014 6:08 AM	02/27/2014 6:12 AM
22464	3-Elevated	2-High	Emergency Maintenance Reschedule Completed - I2 IP Backbone KANS-SALT	Hardware	02/27/2014 9:31 PM	02/27/2014 10:02 PM
22492	3-Elevated	2-High	Emergency Maintenance Completed - I2 IP Backbone CLEV-WASH	Circuit	02/28/2014 9:12 AM	02/28/2014 10:31 AM

Scheduled Maintenances Detail

Ticket No.:	22231:45
Subject:	Maintenance 1 of 2 Completed - I2 IP Backbone LOSA-SALT
Affected:	Backbone LOSA-SALT
Start Time:	Tuesday, February 25, 2014, 9:25 AM (0925) UTC
End Time:	Tuesday, February 25, 2014, 10:28 AM (1028) UTC
Description:	Backbone LOSA-SALT was unavailable while Level(3) Communications performed fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. Maintenance has been completed. IP traffic re-routed during this maintenance. A second window has been reserved for 2/28/14 at 0800-1400.

Ticket No.:	22416:45
Subject:	Maintenance Completed - I2 IP Backbone ATLA-HOUS
Affected:	Backbone ATLA-HOUS
Start Time:	Thursday, February 27, 2014, 6:08 AM (0608) UTC
End Time:	Thursday, February 27, 2014, 6:12 AM (0612) UTC
Description:	Backbone ATLA-HOUS was briefly unavailable while Level(3) Engineers performed maintenance. Maintenance has been completed. IP traffic re-routed during this maintenance.

Ticket No.:	22464:45
Subject:	Emergency Maintenance Reschedule Completed - I2 IP Backbone KANS-SALT
Affected:	Backbone KANS-SALT
Start Time:	Thursday, February 27, 2014, 9:31 PM (2131) UTC
End Time:	Thursday, February 27, 2014, 10:02 PM (2202) UTC
Description:	Backbone KANS-SALT was unavailable while Internet2 AL2S Engineering performed maintenance. The maintenance has been completed and no more outages are expected. IP traffic re-routed during this maintenance.

Ticket No.:	22492:45
Subject:	Emergency Maintenance Completed - I2 IP Backbone CLEV-WASH
Affected:	Backbone CLEV-WASH Connector MREN Connector 3ROX
Start Time:	Friday, February 28, 2014, 9:12 AM (0912) UTC
End Time:	Friday, February 28, 2014, 10:31 AM (1031) UTC
Description:	Backbone CLEV-WASH was unavailable while vendor Engineers performed maintenance. Maintenance has been completed. IP traffic re-routed during this maintenance.

Downtime and Availability

Internet2 IP Core Nodes	Down Time		Reporting Period Availability		52 Week Availability
ATLA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98065%	99.99981%
CHIC MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98520%	99.99905%
CLEV MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99146%	99.99924%
HOUS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96888%	100.00000%
KANS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99791%	100.00000%
LOSA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96680%	100.00000%
NEWY MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
SALT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99317%	100.00000%
SEAT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96452%	100.00000%
WASH MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94175%	99.99962%

Aggregate Internet2 IP Core Nodes	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97903%	99.99977%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone Circuits	Down Time		Reporting Period Availability		52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94517%	99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182	0 hr 4 min	0 hr 0 min	99.96032%	100.00000%	99.98691%	100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179	0 hr 40 min	0 hr 40 min	99.60317%	99.60317%	99.93909%	99.99089%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.80874%	99.86434%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96433%	100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98881%	99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178	2 hr 40 min	1 hr 21 min	98.41270%	99.19643%	99.95617%	99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.89469%	99.92885%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.75448%	99.81671%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185	1 hr 8 min	0 hr 37 min	99.32540%	99.63294%	99.93947%	99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188	1 hr 3 min	0 hr 0 min	99.37500%	100.00000%	99.97780%	100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96907%	99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95200%	99.95636%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99051%	99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.72393%	99.81557%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.72260%	99.81557%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423	0 hr 4 min	0 hr 0 min	99.96032%	100.00000%	99.62413%	99.96983%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562	0 hr 4 min	0 hr 0 min	99.96032%	100.00000%	99.62299%	99.97002%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.76738%	99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.76871%	99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99772%	99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.86434%	99.88540%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.86092%	99.88540%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.93701%	100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.92790%	100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.90741%	99.95712%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.91367%	99.95712%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889	1 hr 16 min	1 hr 16 min	99.24603%	99.24603%	99.82886%	99.88464%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890	2 hr 35 min	1 hr 16 min	98.46230%	99.24603%	99.80798%	99.88464%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.59320%	99.65657%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.59320%	99.65657%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.51749%	99.68105%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.51332%	99.68067%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138	0 hr 31 min	0 hr 0 min	99.69246%	100.00000%	99.79983%	99.90930%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566	0 hr 31 min	0 hr 0 min	99.69246%	100.00000%	99.79983%	99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935	0 hr 31 min	0 hr 0 min	99.69246%	100.00000%	99.81861%	99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563	1 hr 3 min	0 hr 0 min	99.37500%	100.00000%	99.75581%	99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571	1 hr 3 min	0 hr 0 min	99.37500%	100.00000%	99.75903%	99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73304%	99.82278%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73987%	99.83284%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73076%	99.91101%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.73076%	99.91101%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99127%	99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99127%	99.99943%

Aggregate All Internet2 IP Backbone Circuits	13 hr 13 min	8 hr 3 min	99.83610%	99.93593%	99.84188%	99.91136%

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances

Ticket No.:	22501:45
Subject:	Maintenance - I2 IP Backbone LOSA-SEAT and Connector Oregon Gigapop (LOSA)
Affected:	I2-LOSA-PORT-10GE-04189 I2-LOSA-SEAT-10GE-05564 I2-LOSA-SEAT-ISIS-09044 I2-LOSA-SEAT-ISIS-09047 I2-LOSA-SEAT-ISIS-09263 I2-LOSA-SEAT-LAG-06154 I2-LOSA-SEAT-VLAN-06155 I2-LOSA-SEAT-VLAN-06156 I2-LOSA-SEAT-VLAN-09238 Connector Oregon Gigapop (LOSA)
Start Time:	Saturday, March 8, 2014, 8:00 AM (0800) UTC
End Time:	Saturday, March 8, 2014, 10:00 AM (1000) UTC
Description:	The above listed IP Backbone circuits and Connector will be unavailable while Internet2's fiber provider performs maintenance. A brief outage is expected, however the entire maintenance window has been reserved. Connector Oregon Gigapop is multihomed and therefore will remain reachable to the community.