Andrew Y. Ng's ChatGPT class became popular: AI gave up writing backward words, but understood the whole world
Mingmin Yang Jing originates from Aofei TempleQuantum bit | official account QbitAIUnexpectedly, even today, ChatGPT will still make low-level mistakes?Andrew Y. Ng pointed out in the latest class:ChatGPT does not reverse words!For example, if it were to invert the word lollipop, the output would be pilollol, completely chaotic
Mingmin Yang Jing originates from Aofei Temple
Quantum bit | official account QbitAI
Unexpectedly, even today, ChatGPT will still make low-level mistakes?
Andrew Y. Ng pointed out in the latest class:
ChatGPT does not reverse words!
For example, if it were to invert the word lollipop, the output would be pilollol, completely chaotic.
Oh, that's a bit surprising.
So much so that after listening to class netizens posting on Reddit, they immediately attracted a large number of onlookers,Post popularity quickly reached 6k.
bugChatGPTletService.
BardBing.
Others followed roast, ChatGPT was dealing with these simplewordletService.
Wordle.
Hey? What the hell is this for?
The key lies in the Token
The key to this phenomenon is thatToken.TokenToken.
wordword.TokenToken.
wordletServiceToken.
TokenToken.
ChatGPT.
For a more intuitive understanding, OpenAI even released a GPT-3Tokenizer.
For example, the word lollipop will be understood by GPT-3 asI. Oll, ipop.
.
- 1Token4
- 100Token75word
- 1-230Token
- 100Token1500word2048Token
word.Token1.2 to 2.7x.
Token-to-charTokenword.Tokenize.
It can be understood in this way,Token..
wordTokenword.
TransformerswordTokenToken.
Just likeAnnoyinglyIs divided intoAnnoying and ly.
ChatGPT.
as forwordletService.
word~
ChatGPTTokenize.
.
GPT-4.
TokenAI.
AIToken.
AI.
Token
TokenMore fine-grained.letService.
Token.
Therefore,Token.
TokenPaLM 23.6Token.
Token
Andrej Karpathy, an AI scientist who switched jobs from Tesla to OpenAI this year, stated in a speech:
Token.
.
LLaMAGPT-365B vs 175BToken1.4T vs 300BLLaMA.
And with its direct impact on model performance,TokenAI.
OpenAI1KTokenToken.
AIToken.
Token
Token.
.
GPT-4 thinks it's better to call it "word element" or "marker", do you think?
Reference link:
[1] https://www.reddit.com/r/ChatGPT/comments/13xxehx/chatgpt_is_unable_to_reverse_words/
[2]https://help.openai.com/en/articles/4936856-what-are-Tokens-and-how-to-count-them
[3] https://openai.com/pricing
Tag: Andrew Ng ChatGPT class became popular AI gave up
Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.
