Internet2 IP Network Operations Report
11/04/2013 - 11/10/2013

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





217742-High
2-High

Brief Outage Resolved - I2 IP Backbone ATLA-WASH
Software
11/04/2013 3:01 PM
11/04/2013 3:08 PM






Unscheduled Outages Detail






Ticket No.:21774:45



Subject:Brief Outage Resolved - I2 IP Backbone ATLA-WASH



Affected:Backbone ATLA-WASH



Start Time:Monday, November 4, 2013, 3:01 PM (1501) UTC



End Time:Monday, November 4, 2013, 3:08 PM (1508) UTC


Description:Backbone ATLA-WASH is now available after a brief outage. Internet2
AL2S Engineers advised that there was a software issue on the Core
Node in Raleigh, NC that caused a restart of the Routing Engine.  IP
traffic re-routed during the event. No further outages are expected.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





21772
3-Elevated
2-High

Emergency Maintenance Completed - I2 IP Backbone ATLA-WASH
Circuit
11/05/2013 5:02 AM
11/05/2013 6:43 AM


21800
3-Elevated
2-High

Emergency Maintenance Completed - I2 IP Backbone ATLA-WASH
Circuit
11/06/2013 5:10 AM
11/06/2013 7:10 AM




Scheduled Maintenances Detail





Ticket No.:21772:45



Subject:Emergency Maintenance Completed - I2 IP Backbone ATLA-WASH



Affected:Backbone ATLA-WASH



Start Time:Tuesday, November 5, 2013, 5:02 AM (0502) UTC



End Time:Tuesday, November 5, 2013, 6:43 AM (0643) UTC


Description:   Backbone ATLA-WASH was unavailable while Internet2 Engineers performed
maintenance to insert core node CHAR. The maintenance was unsuccessful
due to faulty hardware.  The maintenance will be rescheduled at a
future date.



  







Ticket No.:21800:45



Subject:Emergency Maintenance Completed - I2 IP Backbone ATLA-WASH



Affected:Backbone ATLA-WASH



Start Time:Wednesday, November 6, 2013, 5:10 AM (0510) UTC



End Time:Wednesday, November 6, 2013, 7:10 AM (0710) UTC


Description:   Backbone ATLA-WASH was unavailable while Internet2 AL2S Engineers
processed maintenance to install a new core node in Charlotte, NC.
The maintenance was unsuccessful due to faulty hardware.
Maintenance will be rescheduled at a future date. Traffic should have
re-routed during the maintenance.



  










Downtime and Availability







Internet2 IP Core Nodes
Down TimeReporting Period Availability52 Week Availability


ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98501%  99.99981
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98216%  99.99905
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99848%  99.99924
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96983%  100.00000
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99886%  100.00000
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97059%  100.00000
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98729%  99.99867
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97875%  100.00000
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.96604%  100.00000
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.95086%  99.99962
      
Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97879%99.99964%

** Less than 52 weeks of data available
 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 IP Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99526%99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99545%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179
               3 hr 48 min0 hr 7 min
               97.73810%99.93056%
               99.95219%99.99867%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98197%99.99981%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99772%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99355%99.99943%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99241%100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94839%100.00000%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99943%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97476%99.99924%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%100.00000%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99867%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.75106%99.81254%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.75106%99.81254%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94327%99.96983%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94327%99.96983%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76890%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76890%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89109%99.89754%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89109%99.89754%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95712%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93720%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91803%99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91803%99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94460%99.99734%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94441%99.99734%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89659%99.90570%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.69547%99.70458%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.32472%99.47784%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.32453%99.47765%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82316%99.90949%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82335%99.90968%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88065%99.90949%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95029%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95351%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73550%99.82070%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73550%99.82392%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93226%99.99032%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85978%99.91784%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96604%99.98596%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97951%99.99943%
      
Aggregate All Internet2 IP Backbone Circuits
                   3 hr 48 min3 hr 41 min
                   99.95288%99.99855%
                   99.89659%99.93373%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
*  Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances





Ticket No.:21766:45



Subject:Maintenance - I2 IP Backbone CLEV-WASH



Affected:Backbone CLEV-WASH
Connector MREN



Start Time:Thursday, November 14, 2013, 5:00 AM (0500) UTC



End Time:Thursday, November 14, 2013, 11:00 AM (1100) UTC



Description:   Backbone CLEV-WASH will be unavailable while Level(3) Communications perform scheduled maintenance to relocate cable as mandated by the Penn DOT and Norfolk Southern Railroad due to a road construction and a bridge demolition project between the boroughs of New Brighton and Fallston, Pennsylvania. An outage up to 2 hours is expected; however the entire window is reserved.  IP traffic will re-route during this maintenance. This is the primary maintenance window. An alternate window is scheduled for 19-Nov-2013 05:00:00 UTC to 19-Nov-2013 11:00:00 UTC to be used if needed.



  







Ticket No.:21767:45



Subject:Maintenance - I2 IP Backbone CLEV-WASH Alternate Window



Affected:Backbone CLEV-WASH
Connector MREN



Start Time:Tuesday, November 19, 2013, 5:00 AM (0500) UTC



End Time:Tuesday, November 19, 2013, 11:00 AM (1100) UTC



Description:   Backbone CLEV-WASH will be unavailable while Level(3)
Communications perform scheduled maintenance to relocate cable as
mandated by the Penn DOT and Norfolk Southern Railroad due to a road
construction and a bridge demolition project between the boroughs of
New Brighton and Fallston, Pennsylvania. An outage up to 2 hours is
expected; however the entire window is reserved.  IP traffic will re-route
during this maintenance. This is the primary maintenance window. This is
the alternate window for ticket 21766:45, should it be required.