SoX Network Operations Report
10/01/2015 - 10/31/2015

SoX Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

223-Elevated 3-Elevated Instability - SOX Router oob.56mar.sox.net UndeterminedUndetermined 10/07/2015 6:55 PM 10/09/2015 9:00 AM
303-Elevated 3-Elevated Availability - SOX Node oob.mplex.sox.net UndeterminedUndetermined 10/12/2015 5:03 AM 10/12/2015 5:15 AM
10/12/2015 9:31 AM 10/12/2015 2:06 PM
563-Elevated 3-Elevated Availability - SoX Node oob.sidco.sox.net Circuit - OtherVendor 10/27/2015 6:30 AM 10/27/2015 7:28 AM
10/27/2015 9:31 AM 10/27/2015 10:22 AM

Unscheduled Outages Detail


Ticket No.:22:154
Subject:Instability - SOX Router oob.56mar.sox.net
Source Of Impact:Undetermined
Affected:
Start Time:Wednesday, October 7, 2015, 6:55 PM (1855) UTC
End Time:Friday, October 9, 2015, 9:00 AM (0900) UTC
Description:SoX is going to increase the monitoring frequency which will clear of such alarms. Scott would like this ticket to be closed now.

Ticket No.:30:154
Subject:Availability - SOX Node oob.mplex.sox.net
Source Of Impact:Undetermined
Affected:Node oob.mplex.sox.net
Start Time:Monday, October 12, 2015, 5:03 AM (0503) UTC
End Time:Monday, October 12, 2015, 5:15 AM (0515) UTC
Start Time:Monday, October 12, 2015, 9:31 AM (0931) UTC
End Time:Monday, October 12, 2015, 2:06 PM (1406) UTC
Description:Node oob.mplex.sox.net is now available. SOX Engineers have been contacted; however, the reason for outage is undetermined.

Ticket No.:56:154
Subject:Availability - SoX Node oob.sidco.sox.net
Source Of Impact:Vendor
Affected:Node oob.sidco.sox.net
Start Time:Tuesday, October 27, 2015, 6:30 AM (0630) UTC
End Time:Tuesday, October 27, 2015, 7:28 AM (0728) UTC
Start Time:Tuesday, October 27, 2015, 9:31 AM (0931) UTC
End Time:Tuesday, October 27, 2015, 10:22 AM (1022) UTC
Description:Node oob.sidco.sox.net is now available. SOX Engineers indicated the reason for outage was suspected to be the cellular connection.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

None during this report period

Downtime and Availability



SoX Core NodesDown TimeReporting Period Availability52 Week Availability
bbsw.56mar.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
dcp.court.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
dcp.sidco.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
mgmtsw.court.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
mgmtsw.mplex.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
mgmtsw.sidco.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
oob.56mar.sox.net 38 hr 5 min38 hr 5 min 94.88127%94.88127% 99.56645% 99.56645%
oob.court.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
oob.mplex.sox.net 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554% 99.94554%
oob.sidco.sox.net 1 hr 49 min1 hr 49 min 99.75582%99.75582% 99.97932% 99.97932%
rtr.56mar.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtr.akard.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtr.mplex.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtr.sidco.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
oob.sidco.sox.net 1 hr 49 min1 hr 49 min 99.75582%99.75582% 99.97932% 99.97932%
rtr.sidco.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sw1.55mar.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sw1.56mar.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sw1.gtrch.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sw2.56mar.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sw2.gtrch.sox.net 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate SoX Core Nodes46 hr 30 min46 hr 30 min99.70238%99.70238%99.97479%99.97479%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

SoX Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
SOX-56MAR-SIDCO-VLAN-01506 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-MPLEX-SIDCO-VLAN-01509 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-MPLEX-56MAR-VLAN-01522 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-MPLEX-SIDCO-VLAN-01531 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-AKARD-MPLEX-VLAN-01541 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-AKARD-IMART-VLAN-01549 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-IMART-56MAR-VLAN-01562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-AKARD-AKARD-10GE-01563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-AKARD-56MAR-VLAN-01590 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-VLAN-01665 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-100GE-01666 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01718 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01719 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-55MAR-10GE-01730 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-MPLEX-VLAN-01731 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01775 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01828 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01839 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-LAG-01862 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-55MAR-10GE-01885 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-55MAR-56MAR-LAG-01892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-55MAR-55MAR-LAG-01893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-55MAR-55MAR-LAG-01894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01895 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-COURT-GIGE-01927 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-COURT-GIGE-01928 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-COURT-GIGE-01929 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-COURT-GIGE-01930 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-GTRCH-GIGE-01931 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-COURT-GIGE-01932 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01933 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-10GE-01936 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01937 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01938 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01939 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01940 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01941 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01943 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-FE-01944 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01945 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01946 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01947 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01948 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-56MAR-56MAR-GIGE-01949 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-COURT-COURT-GIGE-01950 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-COURT-COURT-GIGE-01951 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-COURT-COURT-GIGE-01952 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-MPLEX-MPLEX-FE-01953 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554%99.94554%
SOX-MPLEX-MPLEX-FE-01954 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554%99.94554%
SOX-MPLEX-MPLEX-FE-01955 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554%99.94554%
SOX-MPLEX-MPLEX-FE-01956 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554%99.94554%
SOX-MPLEX-MPLEX-FE-01957 4 hr 47 min4 hr 47 min 99.35708%99.35708% 99.94554%99.94554%
SOX-SIDCO-SIDCO-FE-01958 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-SIDCO-SIDCO-FE-01959 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-SIDCO-SIDCO-FE-01960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-SIDCO-SIDCO-FE-01961 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-SIDCO-SIDCO-FE-01962 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
SOX-55MAR-56MAR-10GE-01963 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%

Aggregate All SoX Backbone Circuits 23 hr 55 min0 hr 0 min 99.94730%99.94730% 99.99554%99.99554%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:81:154
Subject:Maintenance 1 of 2 - SoX Participant AREN
Affected:
Start Time:Friday, December 4, 2015, 4:00 AM (0400) UTC
End Time:Friday, December 4, 2015, 10:00 AM (1000) UTC
Description: Participant ASC will be unavailable while ASC Engineers perform maintenance to OS Upgrades and equipment movement. An outage of up to 4 hours per client is expected; however, the entire window is reserved.

Ticket No.:82:154
Subject:Maintenance 2 of 2 - SoX Participant AREN
Affected:
Start Time:Sunday, December 6, 2015, 4:00 AM (0400) UTC
End Time:Sunday, December 6, 2015, 10:00 AM (1000) UTC
Description: Participant AREN will be unavailable while AREN Engineers perform maintenance to install new datacenter firewalls and switches. An outage of up to 4 hours per client is expected; however, the entire window is reserved.