Blogsby GlyphEval-driven development: Lessons from evaluating GenAI at scale
How Airbnb teams build trustworthy Generative AI products by treating evaluation as a first-class engineering discipline; not an afterthought.
3 of 800 posts
Tue Jul 281 post
Tue Jul 211 post
Personalizing Airbnb search by learning from the guest journey
How we built a Transformer-based sequence model that encodes years of guest behavior to surface the right listings at the right time.
Tue Jul 141 post
From weeks to a day: how we made LLM evaluation fast enough to iterate on
Training an LLM is the easy part. The hard part is designing experiments and evaluations that you can trust enough to know whether the new model is actually an improvement.