I-Light Network Operations Report
2022-03-18 - 2022-03-31
I-Light Network Operations Center
| Incident Number | Customer Impact | Network Impact | Title | Outage Type | Source of Impact | Current State | Start Time (UTC) | End Time (UTC) | Duration |
|---|---|---|---|---|---|---|---|---|---|
| INC0106593 | 3 - Moderate | 3 - Moderate | Outage Resolved - I-Light Backbone IPHE-IPIU | Hardware | Internal | Resolved | 2022-03-25 10:20:00 | 2022-03-25 12:56:00 | 0 days 2 hr 36 min |
| INC0106601 | 3 - Moderate | 3 - Moderate | Outage Resolved - I-Light Backbone IPHE-IPIU | Hardware | Internal | Closed | 2022-03-25 13:20:07 | 2022-03-25 15:07:19 | 0 days 1 hr 47 min |
| INC0106619 | 3 - Moderate | 3 - Moderate | Instability Resolved - I-Light Backbones IPHE-IPHE and IPHE-IPIU | Hardware | Internal | Resolved | 2022-03-25 16:04:24 | 2022-03-25 18:15:19 | 0 days 2 hr 10 min |
| INC0106709 | 3 - Moderate | 3 - Moderate | Outage Resolved - I-Light Backbone IPHE-IPHE | Hardware | Internal | Resolved | 2022-03-27 16:37:17 | 2022-03-27 17:17:17 | 0 days 0 hr 40 min |
| INC0106723 | 3 - Moderate | 3 - Moderate | Outage Resolved - I-Light Backbone IPHE-IPIU | Hardware | Internal | Resolved | 2022-03-28 01:50:52 | 2022-03-28 04:21:25 | 0 days 2 hr 30 min |
| Ticket No.: | INC0106593 |
| Subject: | Outage Resolved - I-Light Backbone IPHE-IPIU |
| Source Of Impact: | Internal |
| Affected: | ILN-IPHE-IPIU-10GE-1703
ILN-IPHE-IPIU-10GE-4078 Backbone IPHE-IPIU Member Butler University Member Marian University Member University of Indianapolis Member Wabash College Member WFYI Member Ivy Tech Community College Member Indiana Office of Technology |
| Current State: | Resolved |
| Start Time: | 2022-03-25 10:20:00 |
| End Time: | 2022-03-25 12:56:00 |
| Outgoing Notification Text | Backbone IPHE-IPIU is now unavailable. I-Light Engineers were engaged and dispatched to POP Lifeline Data Center to resolve an issue where FPC 9 and FPC 11 accumulated major errors that brought interfaces down. They conducted a restart on both FPCs resolving the issue and restoring service. No further outages are expected. |
| Ticket No.: | INC0106601 |
| Subject: | Outage Resolved - I-Light Backbone IPHE-IPIU |
| Source Of Impact: | Internal |
| Affected: | ILN-IPHE-IPIU-100GE-23907
ILN-IPHE-IPIU-VLAN-23908 Backbone IPHE-IPIU |
| Current State: | Closed |
| Start Time: | 2022-03-25 13:20:07 |
| End Time: | 2022-03-25 15:07:19 |
| Outgoing Notification Text | Backbone IPHE-IPIU is now available. I-Light Engineers dispatched to POP Lifeline Data Center to resolve an issue on FPC 9. Once a restart was conducted, the issue was resolved restoring services. No further outages are expected. |
| Ticket No.: | INC0106619 |
| Subject: | Instability Resolved - I-Light Backbones IPHE-IPHE and IPHE-IPIU |
| Source Of Impact: | Internal |
| Affected: | ILN-IPHE-IPHE-100GE-24243
ILN-IPHE-IPHE-100GE-24244 ILN-IPHE-IPIU-100GE-23907 Backbone IPHE-IPHE Backbone IPHE-IPIU Member Vincennes University Lebanon Member Valparaiso University Member Wabash College Member Trine University Member Saint Mary of the Woods College Member Ball State University Member Manchester University North Manchester Campus Member Manchester University Ft. Wayne Campus Member Goshen College Member University of Southern Indiana |
| Current State: | Resolved |
| Start Time: | 2022-03-25 16:04:24 |
| End Time: | 2022-03-25 18:15:19 |
| Outgoing Notification Text | Backbones IPHE-IPHE and IPHE-IPIU are now stable. I-Light and JTAC Engineers found a transient issue on FPC7 that caused control board communication issues with other FPCs. Initially, JTAC recommended swapping REs since they thought it was a control board issue. After jumping on a zoom call, they saw the two connection issues on FPC 7. Once FPC7 was rebooted, the control board errors cleared. FPC 5 and FPC 10 were also rebooted which were also down. All connections are up and have been stable with no errors for the last 15 minutes. No further outages are expected. |
| Ticket No.: | INC0106709 |
| Subject: | Outage Resolved - I-Light Backbone IPHE-IPHE |
| Source Of Impact: | Internal |
| Affected: | ILN-IPHE-IPHE-100GE-24244
ILN-IPHE-IPHE-100GE-24243 Backbone IPHE-IPHE Member Vincennes University Lebanon Member Valparaiso University Member Wabash College Member Trine University Member Saint Mary of the Woods College Member Ball State University Member Manchester University North Manchester Campus Member Manchester University Ft. Wayne Campus Member Goshen College Member University of Southern Indiana Member Depauw University Member Huntington University Member Rose-Hulman Institute of Technology Member University of Evansville Member Indiana Wesleyan Member Indiana State University Member Hanover College Member Franklin College Member Earlham College |
| Current State: | Resolved |
| Start Time: | 2022-03-27 16:37:17 |
| End Time: | 2022-03-27 17:17:17 |
| Outgoing Notification Text | Backbone IPHE-IPHE is now available. I-Light Engineers were engaged and dispatched to correct an instability on Core Node IPHE via CHG0058681. No further outages are expected. |
| Ticket No.: | INC0106723 |
| Subject: | Outage Resolved - I-Light Backbone IPHE-IPIU |
| Source Of Impact: | Internal |
| Affected: | ILN-IPHE-IPIU-100GE-23907
Backbone IPHE-IPIU |
| Current State: | Resolved |
| Start Time: | 2022-03-28 01:50:52 |
| End Time: | 2022-03-28 04:21:25 |
| Outgoing Notification Text | Backbone IPHE-IPIU is now available. I-Light Engineers were engaged and dispatched to correct an instability on Core Node IPHE via CHG0058681. No further outages are expected. |