⭐⭐⭐ · 60 min · 200 PTSnot enough attempts yetEarly draft
The RAG Cost Blowup
RAG cost ballooned for no clear reason. The bill jumped 8x this month. A quick look shows someone 'improved recall' by raising k from 3 to 20 chunks per query. Quality nudged up slightly — cost exploded. You have the traces, the billing numbers, and an eval set.
Success: Cut cost at the same quality.
RAG cost optimization
You need a free account to attempt. Sign in