Mathematical Argument GPT-4 is not a Random Parrot: If it were to happen, the entire universe would collapse
Cressi originates from the Temple of AofeiQuantum bit | official account QbitAIA common explanation for the working principle of ChatGPT is to predict the next word based on statistical rules.But recently, an engineer named Jacob Bayless came to an astonishing conclusion using mathematical methods:If so, the amount of information required is sufficient toThe entire universe collapsed into a black hole
Cressi originates from the Temple of Aofei
Quantum bit | official account QbitAI
A common explanation for the working principle of ChatGPT is to predict the next word based on statistical rules.
But recently, an engineer named Jacob Bayless came to an astonishing conclusion using mathematical methods:
If so, the amount of information required is sufficient toThe entire universe collapsed into a black hole.
This data volume is50000 ^ 8000According toBeckenstein upper limit(Bekenstein bound).
.
The difference between ChatGPT and pure statistical prediction can be analogized as follows:
.
.
- According to.
From paper OnTheDangersof StochasticParrots: CanLanguageModelsBeTooBig
.
n-gram.
.
.
- N=0: RECOIVEFALLSURPRISEDFRIDAYINGREDIENT
N=1: REPRESENTINGANDSPEEDILISANGOOD
N=2: THECHARACTEROFTHISPOINTISTHEREFORE
n.
n-gram.
Based on this, some people speculate that GPT-4 may just be an advanced n-gram?
BaylessGPTGPT-4.
GPT-4 is not just a 'random parrot'
.
.
Then it can imitate the movements of any other chess player or program through the "memorization method"
StockfishStockfish.
2^154.
Stockfish50MB.
Stockfish.
GPT.
GPT-3token5token.
n-gramn8000.
50000 ^ 8000.
.
GPT.
The height that the 'random parrot' cannot reach
.
.
- A farmer has a boat, along with wolves, sheep, and vegetables. The farmer needs to transport these three things to the other side of the river. The farmer can only transport at most one thing through this boat at a time. To prevent wolves from eating sheep and sheep from eating cabbage (that is, they cannot be on the same shore without the farmer), how should they get by?
.
.
.
GPT.
GPT-4GPT-3.5.
.
.
.
.
If GPTs are allowed to learn numerical sorting, will they only remember the given numerical sorting, or will they really develop a sorting algorithm?
GPT.
If 10 numbers are randomly selected from 1-100 and their order is disrupted, there will be a total of these situations:
.
GPT.
AIAndrej KaparthynanoGPT.
.
16.
.
GPU.
GPT-4.
Reference link:
https://jbconsulting.substack.com/p/its-not-just-statistics-gpt-4-does
Tag: Mathematical Argument GPT-4 is not Random Parrot If it
Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.
