Incomplete Closure of Epoch 19,674
Incident Report for Helium
Resolved
The automated job that was supposed to end the November 13th epoch (19,674) at UTC midnight stalled due to a dropped transaction. The job continued to wait for confirmation on a transaction that was never picked up by Solana. The epoch was manually ended by Core Developers at 15:30 UTC. No further action is needed. The team will be improving alerting to ensure we are notified earlier when epochs fail to close. Additionally, they will be repairing the automated job to include a timeout on transaction confirmations.
Posted Nov 14, 2023 - 15:50 UTC