Internet2 IP Network Operations Report
07/15/2013 - 07/21/2013

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





212231-Critical
1-Critical

Internet2 IP Network Core Node NEWY Brief Outage
Undetermined
07/15/2013 1:34 PM
07/15/2013 1:35 PM


212341-Critical
1-Critical

Internet2 IP Network Core Node CHIC Brief Outage
Hardware
07/17/2013 8:44 AM
07/17/2013 8:49 AM


212462-High
2-High

Internet2 IP Network Backbone Circuit HOUS-LOSA Brief Outage Resolved
Unannounced Maintenance
07/18/2013 5:21 AM
07/18/2013 5:27 AM






Unscheduled Outages Detail






Ticket No.:21223:45



Subject:Internet2 IP Network Core Node NEWY Brief Outage



Affected:Core Node NEWY and its Connector(s) and Participants.



Start Time:Monday, July 15, 2013, 1:34 PM (1334) UTC



End Time:Monday, July 15, 2013, 1:35 PM (1335) UTC


Description:Core Node NEWY was briefly unavailable. Internet2  Engineers are
investigating the cause; however, the reason for the outage is
pending. All connections to the Core Node were affected.







Ticket No.:21234:45



Subject:Internet2 IP Network Core Node CHIC Brief Outage



Affected:Core Node CHIC and its Connector(s) and Participants.



Start Time:Wednesday, July 17, 2013, 8:44 AM (0844) UTC



End Time:Wednesday, July 17, 2013, 8:49 AM (0849) UTC


Description:Core Node CHIC was briefly unavailable. Internet2 Engineers report 
that the outage was due to a failed routing engine. The core node is
running on the backup RE. Internet2 Engineers are working to replace
the failed RE. All connections to the Core Node were affected.







Ticket No.:21246:45



Subject:Internet2 IP Network Backbone Circuit HOUS-LOSA Brief Outage Resolved



Affected:Backbone Circuit  HOUS-LOSA



Start Time:Thursday, July 18, 2013, 5:21 AM (0521) UTC



End Time:Thursday, July 18, 2013, 5:27 AM (0527) UTC


Description:Backbone Circuit HOUS-LOSA was briefly unavailable. Level (3)
Communications technicians have determined that the outage was due to
a scheduled maintenance to replace a rectifer. No further outages are
expected.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





21197
3-Elevated
2-High

Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed
Circuit
07/16/2013 7:31 AM
07/16/2013 8:54 AM




Scheduled Maintenances Detail





Ticket No.:21197:45



Subject:Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed



Affected:Backbone Circuit HOUS-LOSA



Start Time:Tuesday, July 16, 2013, 7:31 AM (0731) UTC



End Time:Tuesday, July 16, 2013, 8:54 AM (0854) UTC


Description:   Backbone Circuit HOUS-LOSA was unavailable while
Level(3) Communications Engineers performed
maintenance.  Maintenance has been completed. IP traffic re-routed
during this maintenance.



  










Downtime and Availability







Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability


CHIC T16000 hr 5 min99.95040%99.98292%
NEWY T16000 hr 1 min99.99008%99.98805%
SEAT MX9600 hr 0 min100.00000%99.96699%
WASH T16000 hr 0 min100.00000%99.95162%
HOUS MX9600 hr 0 min100.00000%99.97040%
LOSA T16000 hr 0 min100.00000%99.97401%
ATLA T16000 hr 0 min100.00000%99.98558%
SALT T16000 hr 0 min100.00000%99.97875%
KANS T16000 hr 0 min100.00000%99.99981%
      
Aggregate Internet2 IP Core Nodes0 hr 6 min99.99339%99.97757%

** Less than 52 weeks of data available

	    

	    
Internet2 IP Backbone CircuitsDown TimeReporting Period Availability52 Week Availability


I2-HOUS-LOSA-10GE-055591 hr 29 min99.11706%99.63229%
I2-ATLA-CHIC-10GE-054190 hr 0 min100.00000%99.60041%
** I2-HOUS-KANS-10GE-055600 hr 0 min100.00000%99.89659%
I2-CHIC-NEWY32AOA-10GE-052390 hr 0 min100.00000%99.97628%
** I2-CHIC-NEWY32AOA-10GE-056670 hr 0 min100.00000%99.97628%
** I2-NEWY32AOA-WASH-100GE-061260 hr 0 min100.00000%99.74423%
** I2-CHIC-WASH-100GE-061790 hr 0 min100.00000%99.99051%
** I2-HOUS-KANS-10GE-055610 hr 0 min100.00000%99.69547%
I2-ATLA-WASH-10GE-052510 hr 0 min100.00000%99.75543%
I2-ATLA-WASH-10GE-051330 hr 0 min100.00000%99.75543%
I2-ATLA-HOUS-10GE-054230 hr 0 min100.00000%99.80020%
** I2-ATLA-HOUS-10GE-055620 hr 0 min100.00000%99.80020%
** I2-KANS-SALT-10GE-055660 hr 0 min100.00000%99.90703%
I2-KANS-SALT-10GE-051380 hr 0 min100.00000%99.90684%
** I2-SALT-SEAT-10GE-055650 hr 0 min100.00000%99.96623%
** I2-SALT-SEAT-10GE-055730 hr 0 min100.00000%99.97970%
** I2-LOSA-SALT-10GE-055710 hr 0 min100.00000%99.95219%
** I2-LOSA-SALT-10GE-055630 hr 0 min100.00000%99.95294%
I2-ATLA-CHIC-10GE-056380 hr 0 min100.00000%99.65392%
I2-CHIC-KANS-10GE-055670 hr 0 min100.00000%99.97647%
I2-CHIC-KANS-10GE-055680 hr 0 min100.00000%99.97799%
I2-CHIC-KANS-10GE-059760 hr 0 min100.00000%99.92600%
I2-LOSA-SEAT-10GE-055640 hr 0 min100.00000%99.75068%
I2-LOSA-SEAT-10GE-055720 hr 0 min100.00000%99.75429%
I2-HOUS-LOSA-10GE-055811 hr 29 min99.11706%99.63210%
      
Aggregate All Internet2 IP Backbone Circuits2 hr 58 min99.92936%99.83839%



Upcoming Scheduled Maintenances





Ticket No.:21141:45



Subject:Internet2 IP Network Backbone Circuit LOSA-SALT Maintenance 



Affected:Backbone Circuit LOSA-SALT



Start Time:Tuesday, July 23, 2013, 7:00 AM (0700) UTC



End Time:Tuesday, July 23, 2013, 1:00 PM (1300) UTC



Description:   Backbone Circuit LOSA-SALT will be unavailable while Level(3)
Communications Engineers perform maintenance.  An outage of two hours
is expected;however, the entire window is reserved.  IP traffic will
re-route during this maintenance. An alternate window has been
reserved for 7/25/2013 0700-1300 UTC, should it be required.



  







Ticket No.:21180:45



Subject:Internet2 IP Network Core Node (CLEV) Maintenance



Affected:Core Node CLEV and its Connector(s) and Participants
ION Backbone Circuit CHIC-CLEV



Start Time:Wednesday, July 24, 2013, 4:00 AM (0400) UTC



End Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



Description:   *Please note this maintenance has been rescheduled*
Core Node CLEV will be unavailable while Internet2 Engineers 
perform software upgrade maintenance.  An outage of up to 5 minutes 
is expected; however, the entire window is reserved.  All connections 
to the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21181:45



Subject:Internet2 IP Network Core Node (ATLA) Maintenance



Affected:Core Node ATLA and its Connectors and Participants



Start Time:Wednesday, July 24, 2013, 4:00 AM (0400) UTC



End Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



Description:   *Please note the updated maintenance date.*

Core Node (ATLA) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21177:45



Subject:Internet2 IP Network Core Node (NEWY) Maintenance



Affected:Core Node (NEWY) and its Connector(s) and Participants



Start Time:Wednesday, July 24, 2013, 4:00 AM (0400) UTC



End Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



Description:   Core Node (NEWY) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21179:45



Subject:Internet2 IP Network Core Node (WASH) Maintenance



Affected:Core Node (WASH) and all its Connector(s) and Participants
ION Backbone Circuit NEWY-WASH
ION Backbone Circuit LOSA-WASH



Start Time:Wednesday, July 24, 2013, 4:00 AM (0400) UTC



End Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



Description:   The above listed will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21182:45



Subject:Internet2 IP Network Core Node (CHIC) Maintenance



Affected:Core Node (CHIC) and its Connector(s) and Participants
ION Backbone Circuit ATLA-CHIC



Start Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



End Time:Wednesday, July 24, 2013, 6:00 AM (0600) UTC



Description:   Core Node (CHIC) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21183:45



Subject:Internet2 IP Network Core Node (KANS) Maintenance



Affected:Core Node (KANS) and its Connector(s) and Participants



Start Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



End Time:Wednesday, July 24, 2013, 6:00 AM (0600) UTC



Description:   Core Node (KANS) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21184:45



Subject:Internet2 IP Network Core Node (HOUS) Maintenance



Affected:Core Node (HOUS) and its Connector(s) and Participants



Start Time:Wednesday, July 24, 2013, 5:00 AM (0500) UTC



End Time:Wednesday, July 24, 2013, 6:00 AM (0600) UTC



Description:   Core Node (HOUS) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21185:45



Subject:Internet2 IP Network Core Node (SEAT) Maintenance



Affected:Core Node (SEAT) and its Connector(s) and Participants



Start Time:Wednesday, July 24, 2013, 7:00 AM (0700) UTC



End Time:Wednesday, July 24, 2013, 8:00 AM (0800) UTC



Description:   Core Node (SEAT) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21186:45



Subject:Internet2 IP Network Core Node (LOSA) Maintenance



Affected:Core Node (LOSA) and its Connector(s) and Participants



Start Time:Wednesday, July 24, 2013, 7:00 AM (0700) UTC



End Time:Wednesday, July 24, 2013, 8:00 AM (0800) UTC



Description:   Core Node (LOSA) will be unavailable while Internet2 Engineers perform
software upgrade maintenance.  An outage of up to 5 minutes is
expected; however, the entire window is reserved.  All connections to
the Core Node will be affected.

Other core nodes in this region will also be affected within this
window; however, they will be down individually in succession with one
another and traffic should re-route.



  







Ticket No.:21142:45



Subject:Internet2 IP Network Backbone Circuit LOSA-SALT Maintenance Alternate Window



Affected:Backbone Circuit LOSA-SALT



Start Time:Thursday, July 25, 2013, 7:00 AM (0700) UTC



End Time:Thursday, July 25, 2013, 1:00 PM (1300) UTC



Description:   Backbone Circuit LOSA-SALT will be unavailable while Level(3)
Communications Engineers perform maintenance.  An outage of two hours
is expected; however, the entire window is reserved.  IP traffic will
re-route during this maintenance. This is an alternate window for
ticket 21141:45, should it be required.