SOX Network Operations Report
2018-12-01 - 2018-12-31
SOX Network Operations Center
| Connector | Type | Date | Sponsor |
|---|
None
None
None
| Incident Number | Customer Impact | Network Impact | Title | Outage Type | Source of Impact | Current State | Start Time (UTC) | End Time (UTC) |
|---|---|---|---|---|---|---|---|---|
| INC0024804 | 3 - Moderate | 3 - Moderate | Availability - SoX Participant Morehouse | Undetermined | Undetermined | Resolved | 2018-12-01 08:17:32 | 2018-12-01 08:58:39 |
| INC0025008 | 3 - Moderate | 3 - Moderate | Availability - SoX Core Node 56MAR (OOB) | Undetermined | Undetermined | Resolved | 2018-12-04 05:20:09 | 2018-12-04 06:19:19 |
| INC0025298 | 3 - Moderate | 3 - Moderate | Instability Resolved - SoX Backbone 56MAR-56MAR | Hardware | Internal | Closed | 2018-12-06 16:11:17 | 2018-12-06 19:14:54 |
| INC0025325 | 3 - Moderate | 3 - Moderate | Availability - SoX Participant Auburn | Undetermined | Undetermined | Resolved | 2018-12-06 23:12:53 | 2018-12-07 00:47:30 |
| INC0025823 | 3 - Moderate | 3 - Moderate | Stability - SoX Core Node 56MAR OOB | Undetermined | Undetermined | Closed | 2018-12-12 14:42:00
2018-12-12 18:06:08 |
2018-12-12 16:29:15
2018-12-13 16:04:48 |
| Ticket No.: | INC0024804 |
| Subject: | Availability - SoX Participant Morehouse |
| Source Of Impact: | Undetermined |
| Affected: | SOX-56MAR-56MAR-GIGE-01832
SOX-56MAR-56MAR-GIGE-01836 Participant Morehouse |
| Current State: | Resolved |
| Start Time: | 2018-12-01 08:17:32 |
| End Time: | 2018-12-01 08:58:39 |
| Description | Participant Morehouse is now available. Morehouse Engineers have been contacted and the reason for the outage is pending. |
| Ticket No.: | INC0025008 |
| Subject: | Availability - SoX Core Node 56MAR (OOB) |
| Source Of Impact: | Undetermined |
| Affected: | oob.56mar.sox.net
Core Node 56MAR (OOB) |
| Current State: | Resolved |
| Start Time: | 2018-12-04 05:20:09 |
| End Time: | 2018-12-04 06:19:19 |
| Description | The OOB for Core Node 56 Marietta St Available. SoX Engineers have been contacted to investiage; however the reason for outage is pending. |
| Ticket No.: | INC0025298 |
| Subject: | Instability Resolved - SoX Backbone 56MAR-56MAR |
| Source Of Impact: | Internal |
| Affected: | SOX-56MAR-56MAR-GIGE-01933
SOX-56MAR-56MAR-GIGE-01934 SOX-56MAR-56MAR-FE-01935 SOX-56MAR-56MAR-10GE-01936 Backbone 56MAR-56MAR Participant Georgia Institute of Technology |
| Current State: | Closed |
| Start Time: | 2018-12-06 16:11:17 |
| End Time: | 2018-12-06 19:14:54 |
| Description | The Backbone between the 56 Marietta St OOB and the 56 Marietta St switch is currently unstable. SoX Engineers confirmed a hardware failure on switch 3 of the sw1.56mar.sox.net stack. They dispatched to the site and replaced the switch stack. No further outages are expected. |
| Ticket No.: | INC0025325 |
| Subject: | Availability - SoX Participant Auburn |
| Source Of Impact: | Undetermined |
| Affected: | SOX-56MAR-56MAR-10GE-01847
Participant Auburn |
| Current State: | Resolved |
| Start Time: | 2018-12-06 23:12:53 |
| End Time: | 2018-12-07 00:47:30 |
| Description | Participant Auburn is now available. Auburn Engineers have been contacted; however, the reason for the outage is pending. |
| Ticket No.: | INC0025823 |
| Subject: | Stability - SoX Core Node 56MAR OOB |
| Source Of Impact: | Undetermined |
| Affected: | oob.56mar.sox.net
Core Node 56MAR OOB |
| Current State: | Closed |
| Start Time: | 2018-12-12 14:42:00 |
| End Time: | 2018-12-12 16:29:15 |
| Description | The 56 Marietta OOB is now stable. SoX Engineering rebooted the device and no further outages are expected. The cause of the instability is unknown. |
| Ticket Number | Customer Impact | Network Impact | Title | Maintenance Type | Source Of Impact | Current State | Start Time (UTC) | End Time (UTC) |
|---|---|---|---|---|---|---|---|---|
| CHG0034216 | 3 - Moderate | 3 - Normal | Maintenance Completed - SoX Core Node 56MAR OOB | Hardware | Internal | Closed | 2018-12-13 16:02:48 | 2018-12-13 16:04:48 |
| Ticket No.: | CHG0034216 |
| Subject: | Maintenance Completed - SoX Core Node 56MAR OOB |
| Source Of Impact: | Internal |
| Affected: | oob.56mar.sox.net
Core Node 56MAR OOB |
| Current State: | Closed |
| Start Time: | 2018-12-13 16:02:48 |
| End Time: | 2018-12-13 16:04:48 |
| Description | The 56 Marietta OOB was unavailable while SoX Engineers reloaded the device. No network impact was observed, however, monitoring was affected while the device reboots. Maintenance has been completed. |
| SOX Nodes | Down Time | Reporting Period Availability | 52 Week Availability |
| rtr.365dc.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 99.69314% | 99.69314% |
| dcp.365dc.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| rtr.56mar.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| mgmtsw.court.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| sw2.gtrch.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| sw1.55mar.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 99.97310% | 99.97310% |
| dcp.sidco.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| sw1.gtrch.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| sw1.56mar.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| rtr.sidco.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| dcp.court.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| bbsw.56mar.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| mgmtsw.365dc.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 99.94234% | 99.94234% |
| sw2.56mar.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 99.77091% | 99.77091% |
| mgmtsw.sidco.sox.net | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| Aggregate SOX Core Nodes | 0 days 0 hr 0 min | 0 days 0 hr 0 min | 100.00000% | 100.00000% | 99.95863% | 99.95863% |
NOTE: Numbers in italics represent downtime with scheduled maintenance excluded.
| SOX Backbone Circuits | Down Time | Reporting Period Availability | 52 Week Availability |
| SOX-56MAR-56MAR-FE-01935 | 3 hr 3 min | 3 hr 3 min | 99.58867% | 99.58867% | 99.96516% | 99.96516% |
| SOX-56MAR-56MAR-GIGE-01828 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-FE-01938 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01946 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-FE-01941 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-VLAN-01665 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-COURT-COURT-GIGE-01950 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-55MAR-56MAR-LAG-01892 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01934 | 3 hr 3 min | 3 hr 3 min | 99.58867% | 99.58867% | 99.96516% | 99.96516% |
| SOX-56MAR-56MAR-10GE-01718 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-365DC-365DC-FE-01954 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-FE-01944 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-55MAR-55MAR-LAG-01894 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-SIDCO-SIDCO-FE-01959 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-COURT-COURT-GIGE-01952 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01948 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-10GE-01775 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-365DC-365DC-FE-01955 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01947 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-10GE-01719 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-FE-01937 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-365DC-365DC-FE-01956 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-LAG-01862 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-365DC-365DC-FE-01953 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-COURT-GIGE-01930 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-COURT-GIGE-01929 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-365DC-56MAR-VLAN-01506 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-SIDCO-SIDCO-FE-01962 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01939 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01940 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-SIDCO-SIDCO-FE-01961 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-SIDCO-SIDCO-FE-01958 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01945 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-COURT-GIGE-01927 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-10GE-01743 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-100GE-01666 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 99.99571% | 99.99571% |
| SOX-56MAR-56MAR-10GE-01936 | 3 hr 3 min | 3 hr 3 min | 99.58867% | 99.58867% | 99.96516% | 99.96516% |
| SOX-56MAR-56MAR-GIGE-01933 | 3 hr 3 min | 3 hr 3 min | 99.58867% | 99.58867% | 99.96516% | 99.96516% |
| SOX-56MAR-GTRCH-GIGE-01931 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-FE-01943 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-SIDCO-SIDCO-FE-01960 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-COURT-COURT-GIGE-01951 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-55MAR-55MAR-LAG-01893 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-55MAR-10GE-01730 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-COURT-GIGE-01932 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| SOX-56MAR-56MAR-GIGE-01949 | 00 hr 00 min | 00 hr 00 min | 100.00000% | 100.00000% | 100.00000% | 100.00000% |
| Aggregate All SOX Backbone Circuits | 0 days 12 hr 14 min |0 days 12 hr 14 min | 99.96423% | 99.96423% | 99.99688% | 99.99688% |
NOTE: Numbers in italics represent downtime with scheduled maintenance excluded.