r/computerscience 4d ago

Discussion how often have your RAG issues actually turned out to be document parsing issues?

I’ve been thinking about this a lot lately.

When a RAG system gives bad answers, the first instinct is usually to look at chunking, embeddings, retrieval, or the model.

But sometimes the problem started earlier.

If the parser already destroyed the table structure, heading hierarchy, or reading order, retrieval is working with bad input from the beginning.

Curious how often others have run into this.

Was the real bottleneck actually the ingestion/parsing layer?

0 Upvotes

1 comment sorted by

1

u/thejauntyconsul 4d ago

in my experience it's almost always the parsing, at least for anything with tables or multi-column layouts. chunking gets the blame but the damage was already done upstream

spent way too long tweaking retrieval params once before realizing the parser was just reading columns left to right across the whole page like a newspaper from hell