Internet2 IP Network Operations Report
07/04/2014 - 07/10/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





234042-High
2-High

Outage Resolved - I2 IP Backbone ATLA-CHIC
Cut or Damaged FiberVendor
07/06/2014 7:19 PM
07/07/2014 2:35 PM


234072-High
2-High

Outage Resolved - I2 IP Backbone HOUS-KANS
Cut or Damaged FiberVendor
07/07/2014 3:21 PM
07/07/2014 8:13 PM


234092-High
2-High

Brief Outage Resolved - I2 IP Backbone ATLA-CHIC
UndeterminedUndetermined
07/07/2014 6:27 PM
07/07/2014 6:28 PM


234382-High
2-High

Brief Outage - I2 IP Backbone ATLA-HOUS
UndeterminedUndetermined
07/10/2014 7:44 PM
07/10/2014 7:45 PM






Unscheduled Outages Detail






Ticket No.:23404:45



Subject:Outage Resolved - I2 IP Backbone ATLA-CHIC



Source Of Impact:Vendor



Affected:Backbone ATLA-CHIC
Connector KYRON



Start Time:Sunday, July 6, 2014, 7:19 PM (1919) UTC



End Time:Monday, July 7, 2014, 2:35 PM (1435) UTC


Description:Backbone ATLA-CHIC is currently available to the community.
Internet2 Optical Vendor technicians repaired a fiber cut in
Chattanooga, TN. Level(3) has completed splicing to restore service.







Ticket No.:23407:45



Subject:Outage Resolved - I2 IP Backbone HOUS-KANS



Source Of Impact:Vendor



Affected:Backbone HOUS-KANS



Start Time:Monday, July 7, 2014, 3:21 PM (1521) UTC



End Time:Monday, July 7, 2014, 8:13 PM (2013) UTC


Description:Backbone HOUS-KANS  is now available to the community. Fiber provider
Engineers report the reason for outage was damaged fiber near
Montgomery, TX which was caused by a company digging on private
property who then dug too close to railroad access.  The fiber has
been rolled  to spare fiber and all services have been restored.  No
more outages are expected. A maintenance may be scheduled to provide a
permanent fix.  Notifications will be sent once a  maintenance window
has been determined.







Ticket No.:23409:45



Subject:Brief Outage Resolved - I2 IP Backbone ATLA-CHIC



Source Of Impact:Undetermined



Affected:Backbone ATLA-CHIC



Start Time:Monday, July 7, 2014, 6:27 PM (1827) UTC



End Time:Monday, July 7, 2014, 6:28 PM (1828) UTC


Description:Backbone ATLA-CHIC was briefly unavailable. Internet2's fiber provider reports the reason for outage is undetermined.  IP traffic
re-routed.







Ticket No.:23438:45



Subject:Brief Outage - I2 IP Backbone ATLA-HOUS



Source Of Impact:Undetermined



Affected:Backbone ATLA-HOUS



Start Time:Thursday, July 10, 2014, 7:44 PM (1944) UTC



End Time:Thursday, July 10, 2014, 7:45 PM (1945) UTC


Description:Backbone ATLA-HOUS was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage remains
pending.  IP
traffic re-routed during the outage.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





23385
3-Elevated
2-High

Maintenance Completed - I2 IP Various Backbones
Hardware
Vendor07/07/2014 7:01 AM
07/07/2014 7:10 AM


07/07/2014 8:27 AM
07/07/2014 8:45 AM




Scheduled Maintenances Detail





Ticket No.:23385:45



Subject:Maintenance Completed - I2 IP Various Backbones



Source Of Impact:Vendor



Affected:Backbone CLEV-NEWY
Backbone LOSA-SEAT



Start Time:Monday, July 7, 2014, 7:01 AM (0701) UTC



End Time:Monday, July 7, 2014, 7:10 AM (0710) UTC


Start Time:Monday, July 7, 2014, 8:27 AM (0827) UTC


		    
End Time:Monday, July 7, 2014, 8:45 AM (0845) UTC


Description:   The above Backbones was unavailable while Internet2's fiber provider
performed maintenance. The maintenance has been successfully completed.



  










Downtime and Availability







Internet2 IP Core Nodes
Down TimeReporting Period Availability52 Week Availability


ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99355%  99.99867%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98501%  99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99089%  99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99734%  100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639%  100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99184%  100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99317%  99.99981%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639%  100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98843%  100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
      
Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99437%99.99973%

** Less than 52 weeks of data available
 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 IP Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.76681%99.95560%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.72241%99.89507%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78749%99.84138%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.58978%99.74860%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92126%99.97723%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177
               0 hr 27 min0 hr 0 min
               99.73214%100.00000%
               99.97230%99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86092%99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184
               4 hr 52 min4 hr 52 min
               97.10317%97.10317%
               99.67270%99.71748%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.58428%99.68333%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93568%99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94592%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187
               0 hr 27 min0 hr 0 min
               99.73214%100.00000%
               99.95465%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328
               0 hr 27 min0 hr 0 min
               99.73214%100.00000%
               99.94991%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94479%99.95598%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98710%99.99924%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98729%99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.74556%99.82961%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89564%99.96774%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.38202%99.73399%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84707%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84707%99.85030%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891
               19 hr 16 min19 hr 16 min
               88.53175%88.53175%
               99.74670%99.76852%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95048%99.98710%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95048%99.98710%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96053%99.99981%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82886%99.83891%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.67839%99.75011%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.50269%99.60667%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.81500%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.81481%99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.74992%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96243%99.99772%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95921%99.99772%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78825%99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98956%99.99943%
      
Aggregate All Internet2 IP Backbone Circuits
                   25 hr 31 min1 hr 21 min
                   99.58950%99.61122%
                   99.83778%99.90336%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
*  Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances





Ticket No.:23583:45



Subject:Maintenance - I2 IP Backbone LOSA-SEAT



Affected:Backbone LOSA-SEAT
Connector Oregon GigaPOP



Start Time:Friday, August 15, 2014, 7:00 AM (0700) UTC



End Time:Friday, August 15, 2014, 9:00 AM (0900) UTC



Description:   The above listed will be unavailable while Internet2's Fiber Provider performs
hardware maintenance.  An outage is expected, and the entire window is
reserved. IP traffic will re-route during this maintenance.



  







Ticket No.:23560:45



Subject:Maintenance 1 of 2 - I2 IP Backbone CHIC-CLEV & Connector MREN



Affected:Backbone CHIC-CLEV
Connector MREN



Start Time:Thursday, August 28, 2014, 4:00 AM (0400) UTC



End Time:Thursday, August 28, 2014, 10:00 AM (1000) UTC



Description:   The above listed backbone and connector will be unavailable while
Internet2's Fiber Provider Engineers perform
maintenance.  An outage of 2 hours is expected;
however, the entire window is reserved.  IP traffic
will re-route during this maintenance. An alternate window has been reserved for date/time, should it be required.



  







Ticket No.:23561:45



Subject:Maintenance 2 of 2 - I2 IP Backbone CHIC-CLEV & Connector MREN



Affected:Backbone CHIC-CLEV
Connector MREN



Start Time:Friday, August 29, 2014, 4:00 AM (0400) UTC



End Time:Friday, August 29, 2014, 10:00 AM (1000) UTC



Description:   The above listed backbone and connector will be unavailable while
Internet2's Fiber Provider Engineers perform
maintenance.  An outage of 2 hours is expected;
however, the entire window is reserved.  IP traffic
will re-route during this maintenance. This is an alternate window for ticket 23560:45, should it be required.