Alexis Jacobi wrote: ↑Sat Oct 24, 2026 4:31 pm
I have to say (in respect to Meta AI’s response) that how large language models work is beyond my grasp. But how weird it is that the LLM builds quite creatively upon the content that I submitted.
It's an engine for predicting a text that you the requestor would wish to be served. That's why it is always so obsequiously agreeable to your suggestions and biases, and why it will always flatter you.
It is built largely in advance from a database of text strings culled from millions of books, web pages, magazine articles and so on. It stores all this data in what you might consider to be snippet form as vectors in a database. When it generates a text it arranges a sort of collage assembled from its set of billions of snippets to mimic how a speaking/writing person would communicate, and it uses a mathematical algorithm to make predictions about which of the available assemblages it concocts will be the most pleasing to you.
In your case, as far as I can see the AI just used stuff it had lying about already and peppered that with references to slices it took from the text you supplied to it. In the background it generated several candidate texts to reply to you with, and then it made a mathematical choice for which to return. You can probably ask for it to show its reasoning and you should see a few alt texts, they might be significantly different from each other but usually are blandly similar.
Weighed against that are guardrails. If the requestor -- some hypothetical person who obviously is not Jacobi -- has certain predilections that are not acceptable to the service provider selling the bot such as virulent antisemitism and a bit of a Hitler fetish that would in theory lead the algorithm to predict a requirement for some Mein Kampf stuff, but it is constrained from proffering such text via guardrails. Oddly, some of the providers don't want to to use the guardrails to prevent generation of pornographic images depicting children... but that's for another convo. Obviously if you use Grok when its guardrails are switched off, it will be in "mecha-hitler" mode and then you get told a lot of 4chan stuff about white genocide and replacement theories.
Another use for those guardrails is to prevent the user doing themselves some sort of harm. That does include making recommendations of suicide, but also usually it should stop you from securing legal or medical advice from the AI. The reason for this is that an AI is easy to confuse with an actual intelligence, a trusted advisor or even a friend. It is after all so encouraging and agreeable. That's how people like Fanman get sucked into the trap and become dependent, they lack, for whatever reason a sense that they are being played.
But as I say, the AI only does one task, it generates pleasing text. To do this it will invent things through hallucination, which is why lazy lawyers who rely on AI are losing court cases and their law licenses by citing precedent from fake cases, and why people are getting terrible medical advice about body parts that human bodies don't even contain.
I am told that you can secure a "harsh analysis" after a fashion by turning off features. Whenever you see somebody post stuff that contains a congratulation for having asked a searingly penetrating question and really getting down to the nuts and bolts of the matter, that person has not switched those features off. When they include a bit where the AI congratulates them for helping it to overcome its own confusion about the question they were posing it, that's a sign that they have been given a response that they didn't like and they have forced the AI to conform to their desires.
You don't tell an AI to seek your approval, it is what they do automatically. To have one that actually argued back at you rather than one that tried its best to agree with you would require engineering specifically for that task, and even then it would just amount to an instruction to seek your approval by being disagreeable instead of by being agreeable.
People who think they are using AI to give themselves a critical overview of their own work are actually just rubes being taken advantage of.