Ship != Die

Raw cards for tools, workflows, models, infra, memory, and evals worth finding again.

2 cards query: all / type: infra
infra

Alert when a scheduled agent misses its deadline

A dashboard built from completed runs can look healthy after a job stops running. Record the expected schedule independently, check for a completed run at the deadline, and send one daily report of exceptions.

scheduled agentsmonitoringalerts
Group discussion
infra

LLM Serving Efficiency Patterns

Production inference checklist covering continuous batching, prefill/decode disaggregation, KV cache management, and prefix-aware routing as the real engineering layer behind model cost and speed.

llm servingcontinuous batchingkv cachegpu infraprefix routing