Challenges/The RAG Cost Blowup
⭐⭐⭐ · 60 min · 200 PTSnot enough attempts yetEarly draft

The RAG Cost Blowup

RAG cost ballooned for no clear reason. The bill jumped 8x this month. A quick look shows someone 'improved recall' by raising k from 3 to 20 chunks per query. Quality nudged up slightly — cost exploded. You have the traces, the billing numbers, and an eval set.

Success: Cut cost at the same quality.

RAG cost optimization

You need a free account to attempt. Sign in