I agree with you, but I liken to to how companies tend to replace competence with bureaucracy. With enough layers, a significant amount of mistakes get caught. It just slows everything down and costs a bunch of money. There are still problems that get through, just less of them.
I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
I know I am getting down voted for this because people haven’t tried it.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
It doing sgupid stuff is another issue separate from hallucinations. Preventing LLM from doing dumb shit is more difficult, you need more guards and harnesses.
I don’t agree it’s a separate issue. Sure you can add in more guardrails, and spend more time making the best prompt. But no matter what you do, at some point it WILL do something you either didn’t ask for, or explicitly told it not to do.
This logically leads to a similar question to OP’s again: if it’s so easy to cut down on hallucinations, then why haven’t the designers of this software already integrated that in?
Or any AI hallucination
I love the assumption that if you spend enough tokens, it won’t hallucinate, like it isn’t a mathematical certainty or anything.
I agree with you, but I liken to to how companies tend to replace competence with bureaucracy. With enough layers, a significant amount of mistakes get caught. It just slows everything down and costs a bunch of money. There are still problems that get through, just less of them.
Right like. The more tokens you spend, the more hallucinations you get.
You can cut hallucinations by 90% just by prompting the LLM to.not guess API and function names and to provide it with full docs or MCP to find docs.
Yeah but it’s not guessing in the first place. It has zero reasoning skills. It just outputs the most likely next word. Even when you ‘tell it not to’
I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
It helps, sure. But it still does stupid shit CONSTANTLY.
So do humans. Constantly.
It doing sgupid stuff is another issue separate from hallucinations. Preventing LLM from doing dumb shit is more difficult, you need more guards and harnesses.
I don’t agree it’s a separate issue. Sure you can add in more guardrails, and spend more time making the best prompt. But no matter what you do, at some point it WILL do something you either didn’t ask for, or explicitly told it not to do.
Agree, That is why I said 90% reduction of hallucinations.
This logically leads to a similar question to OP’s again: if it’s so easy to cut down on hallucinations, then why haven’t the designers of this software already integrated that in?