ACES
Systems Operational
Saturday, December 6, 2025 at 03:52:35

LOS on Optics – BNE Aggregation

Minor
Resolved

Incident INC-000000692 • Created 2025-06-22 07:00 UTC

SLA DEADLINE
Met
ASSIGNED TO
Mike Chen
CUSTOMERS AFFECTED
1
CORRELATED TICKETS
0
Network Topology
10G10G1G1GBNE CoreBNE CoreBNE Agg-01BNE AggBNE Agg-02BNE AggCustomer CPECustomer Site
Operational
Degraded
Down
Fiber
Ethernet
MPLS

Affected Components

BNE Agg-02
BNE Agg
operational
Primary Affected Component
Component Name
BNE agg-sw-02
Type
Aggregation Switch
Location
BNE Aggregation
Current Status
operational
Incident Information

Description

Loss of Signal detected on optical interface at BNE aggregation switch, affecting single customer connection with automatic failover to backup path.

Root Cause Analysis

Fiber connector degradation due to environmental factors. Optical power levels dropped below operational threshold causing LOS alarm.

Estimated Resolution

Resolved at 2025-06-22 08:12 UTC
Incident Analysis
System Logs
2025-06-19 13:46:12.345
ERROR
cor01-etp-454stpau-bne: BFD session removed on interface FourHundredGigE0/0/0/3
BFD neighbor 10.1.1.2 state changed from Up to Down
2025-06-19 13:46:15.123
WARN
monitoring-system: Interface FourHundredGigE0/0/0/3 operationally down
Link state change detected, triggering alarm
2025-06-19 13:46:18.567
ERROR
cor01-etp-47bourke-syd: Loss of Signal detected on optical interface
Optical power level dropped below threshold (-20.5 dBm)
2025-06-19 13:46:22.890
INFO
mpls-engine: TE tunnel Tunnel-te421 state changed to down
Tunnel rerouting initiated via backup path
2025-06-19 13:46:25.234
CRITICAL
service-monitor: Customer EVC services impacted
3 customer services affected by link failure
Resolution Steps
4/4 Complete

Verify optical power levels and LOS alarm status

Assigned to: Mike Chen

Completed: 2025-06-22 07:10 UTC

Check backup path activation and customer traffic flow

Assigned to: Mike Chen

Completed: 2025-06-22 07:20 UTC

Clean and reseat fiber connectors

Assigned to: Mike Chen

Completed: 2025-06-22 07:45 UTC

Verify optical signal restoration and clear alarms

Assigned to: Mike Chen

Completed: 2025-06-22 08:12 UTC

Quick Actions
Emergency Contacts
NOC Manager
David Wilson
On-Call Engineer
Available 24/7
Impact Metrics
optical Power-15.2 dBm (restored to -3.1 dBm)
failover Time< 50ms
availability99.8%
error Rate0.1%