LLMs are pretty good for office jobs where you have huge amounts of documents to churn through, chunking them into a RAG, and then asking the documents questions about itself that you can then verify by getting the page and line number that it pulled the reference from is super handy.
Local LLMs, or SLMs, are surprisingly efficient at document handling with vague inputs, which was a weakness of traditional search algorithms. You can use a mid tier GPU for that.
When the bubble pops, that’s where the research community will go.
LLMs are pretty good for office jobs where you have huge amounts of documents to churn through, chunking them into a RAG, and then asking the documents questions about itself that you can then verify by getting the page and line number that it pulled the reference from is super handy.
We’ve had tools for fuzzy searching files for ages. Didn’t need to steal all human work and burn the planet to make search a tiny bit easier
Local LLMs, or SLMs, are surprisingly efficient at document handling with vague inputs, which was a weakness of traditional search algorithms. You can use a mid tier GPU for that.
When the bubble pops, that’s where the research community will go.