Daily edition · Architecture
TILens turns technical updates into a focused daily brief: official releases, trusted reporting, and practitioner analysis, deduplicated and organized by topic.
4 articles · 4 sources ·
Top topics: Architecture · AI
We’re introducing ZGateway, the proxy we are using to unify traffic through ZippyDB, Meta’s most widely-used key value store. As a bonus, it also enables admission control, load balancing, cross-region resilience, and…
Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost. By Sergio De Simone
So how do we handle such bugs? This is what we are going to try to answer in this article.
#174: tradeoffs behind designing scalable, reliable systems
