In the end, Alex pushed a patch. The patch did not remove rgh . It added a handler: if you see invalid execution id rgh , do not crash. Instead, log a warning, move the orphaned output to a dead-letter bucket, and continue. Not a fix. A eulogy.
Not in the application logs. Not in the worker logs. In the audit log of a sidecar proxy—a small, overlooked Envoy instance running on a node that had been scheduled for retirement six months ago. The entry read: invalid execution id rgh
Alex chose the latter. With a heavy heart, they wrote: In the end, Alex pushed a patch
This kind of disagreement is terrifying because it cannot be fixed with a retry. A retry assumes the error is transient. But rgh was not transient. It was permanent. The parent was dead. The link was severed. The only way out was manual intervention: a database query to reattach the orphaned record, or a script to acknowledge the output and delete the evidence. Instead, log a warning, move the orphaned output