Internet2 IP Network Operations Report
10/21/2013 - 10/27/2013

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





217142-High
2-High

Outage Resolved - I2 IP Backbone LOSA-WASH
Circuit - Other
10/21/2013 2:59 AM
10/21/2013 3:18 AM


217182-High
2-High

Outage Resolved - I2 IP Backbone HOUS-LOSA
Hardware
10/21/2013 11:27 AM
10/21/2013 11:28 AM


10/21/2013 11:29 AM
10/21/2013 11:30 AM


10/21/2013 11:31 AM
10/21/2013 12:09 PM






Unscheduled Outages Detail






Ticket No.:21714:45



Subject:Outage Resolved - I2 IP Backbone LOSA-WASH



Affected:Backbone LOSA-WASH



Start Time:Monday, October 21, 2013, 2:59 AM (0259) UTC



End Time:Monday, October 21, 2013, 3:18 AM (0318) UTC


Description:Backbone LOSA-WASH was briefly unavailable. Internet2 Engineers have
determined the outage was caused by Oscars deleting the circuit.  IP
traffic re-routed.







Ticket No.:21718:45



Subject:Outage Resolved - I2 IP Backbone HOUS-LOSA



Affected:Backbone HOUS-LOSA
ION Backbone HOUS-LOSA



Start Time:Monday, October 21, 2013, 11:27 AM (1127) UTC



End Time:Monday, October 21, 2013, 11:28 AM (1128) UTC


Start Time:Monday, October 21, 2013, 11:29 AM (1129) UTC



End Time:Monday, October 21, 2013, 11:30 AM (1130) UTC


Start Time:Monday, October 21, 2013, 11:31 AM (1131) UTC



End Time:Monday, October 21, 2013, 12:09 PM (1209) UTC


Description:The above listed is now available. The reason for the outage was a
card malfunction in Tucson, AZ. A maintenance on 10/22/2013 resolved
the issue.  IP traffic re- routed during the outage.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





21680
3-Elevated
2-High

Maintenance Completed - I2 IP Backbone HOUS-LOSA
Circuit
10/21/2013 5:00 AM
10/21/2013 5:04 AM


21721
3-Elevated
2-High

Emergency Maintenance Completed - I2 IP Backbone HOUS-LOSA
Hardware
10/22/2013 12:34 AM
10/22/2013 12:44 AM


21708
3-Elevated
2-High

Maintenance Completed - I2 IP 10GE LAG Backbone Circuits CLEV-NEWY
Hardware
10/24/2013 4:17 AM
10/24/2013 6:24 AM


21722
3-Elevated
2-High

Maintenance Completed - I2 IP Backbone CLEV-NEWY and ATLA-CHIC
Software
10/24/2013 4:06 AM
10/24/2013 4:10 AM




Scheduled Maintenances Detail





Ticket No.:21680:45



Subject:Maintenance Completed - I2 IP Backbone HOUS-LOSA



Affected:Backbone HOUS-LOSA
ION Backbone HOUS-LOSA



Start Time:Monday, October 21, 2013, 5:00 AM (0500) UTC



End Time:Monday, October 21, 2013, 5:04 AM (0504) UTC


Description:   Backbone HOUS-LOSA was unavailable while Level(3) Engineers performed
maintenance.  Maintenance has been completed.  IP traffic will
re-route during this maintenance.



  







Ticket No.:21721:45



Subject:Emergency Maintenance Completed - I2 IP Backbone HOUS-LOSA



Affected:Backbone HOUS-LOSA



Start Time:Tuesday, October 22, 2013, 12:34 AM (0034) UTC



End Time:Tuesday, October 22, 2013, 12:44 AM (0044) UTC


Description:   Backbone HOUS-LOSA was unavailable while Level(3) Engineers performed
emergency hardware maintenance. Maintenance has been completed.



  







Ticket No.:21708:45



Subject:Maintenance Completed - I2 IP 10GE LAG Backbone Circuits CLEV-NEWY



Affected:ION Backbone CLEV-NEWY



Start Time:Thursday, October 24, 2013, 4:17 AM (0417) UTC



End Time:Thursday, October 24, 2013, 6:24 AM (0624) UTC


Description:   Backbone CLEV-NEWY was unavailable while Internet2 Engineers
performed maintenance.  Maintenance has been completed. IP traffic
re-routed during this
maintenance.



  







Ticket No.:21722:45



Subject:Maintenance Completed - I2 IP Backbone CLEV-NEWY and ATLA-CHIC



Affected:Backbones CLEV-NEWY and ATLA-CHIC



Start Time:Thursday, October 24, 2013, 4:06 AM (0406) UTC



End Time:Thursday, October 24, 2013, 4:10 AM (0410) UTC


Description:   Backbones CLEV-NEWY and ATLA-CHIC was briefly unavailable while
Internet2 Engineers performed maintenance.  Maintenance has been
completed..  IP traffic re-routed during this maintenance.



  










Downtime and Availability







Internet2 IP Core Nodes
Down TimeReporting Period Availability52 Week Availability


ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98501%  99.99981
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98216%  99.99905
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99848%  99.99924
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96983%  100.00000
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99886%  100.00000
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97059%  100.00000
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98729%  99.99867
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97875%  100.00000
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96604%  100.00000
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.95086%  99.99962
      
Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97879%99.99964%

** Less than 52 weeks of data available
 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 IP Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99526%99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99545%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99545%100.00000%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98197%99.99981%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99772%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177
               0 hr 4 min0 hr 0 min
               99.96032%100.00000%
               99.99355%99.99943%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99260%100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189
               0 hr 13 min0 hr 0 min
               99.87103%100.00000%
               99.94839%100.00000%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97476%99.99924%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%100.00000%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99867%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73987%99.81254%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73987%99.81254%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94080%99.96736%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94080%99.96736%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76890%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76890%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89109%99.89754%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89109%99.89754%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95712%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93720%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893
               2 hr 7 min0 hr 0 min
               98.74008%100.00000%
               99.91803%99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894
               2 hr 7 min0 hr 0 min
               98.74008%100.00000%
               99.91803%99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94460%99.99734%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94460%99.99734%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89659%99.90570%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.69547%99.70458%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559
               0 hr 53 min0 hr 40 min
               99.47421%99.60317%
               99.38525%99.55430%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581
               0 hr 53 min0 hr 40 min
               99.47421%99.60317%
               99.38506%99.55411%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82316%99.90949%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82335%99.90968%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88065%99.90949%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95029%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95351%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73512%99.82070%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73550%99.82392%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93094%99.98900%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85845%99.91651%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96566%99.98596%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97913%99.99943%
      
Aggregate All Internet2 IP Backbone Circuits
                   10 hr 74 min6 hr 17 min
                   99.92208%99.98347%
                   99.89937%99.93679%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
*  Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances