GenAI – How Will You Decide The Chunk Size For Your LLM ?
Scenario:
- You’re asked whether to use 200-token chunks or 800-token chunks in your RAG pipeline. How would you decide?
Answer:
GenAI – How Will You Decide The Chunk Size For Your LLM ?