· ai-devtools
Airbnb Introduces CASTLE for Training Natural Language Search Models with Synthetic Data
The approach uses de-identified booking sessions and large language models (LLMs) to jointly generate synthetic search queries and relevance labels, enabling model training before enough real search traffic is available.
Natural language search allows guests to describe their preferences in everyday language, such as "romantic cabin near skiing" or "pet-friendly beach house that sleeps eight", rather than relying exclusively on predefined filters. Training such systems presents two challenges: generating queries that reflect actual user behavior and determining which property listings are relevant to each query. Previous approaches, including InPars and Promptagator, address query generation and relevance labeling as separate tasks.
They use LLMs to generate queries from documents or examples, followed by extra model-based judgments to assign relevance labels. According to the researchers, this separation can introduce extra sources of error and differences between synthetic and real-user query distributions. CASTLE uses contrastive listing pairs derived from de-identified booking sessions. When a guest books a property after viewing several alternatives, the selected listing becomes a positive example, while another viewed but unbooked property serves as a negative example.





