Topics / Tag
#Reliability
2 articles
- A model call is a distributed systems problemTo your application, an AI model is a slow, metered, rate-limited remote dependency. How to design for it: ambiguous timeouts, backpressure, token capacity, versioned contracts and planned failure.10 min read
- Don't build business logic on an expiry notificationA background process that was going to be triggered by a cache telling us a key had expired. Why that's fragile, the queue-and-scheduler design we chose instead, and why we deliberately stopped short of a full event-driven rebuild.4 min read