#shorts ChatGPT’s level of understanding
Watch the full conversation:
Transcript:
Very exciting as well is the idea of you Know it’s got like at least rudimentary In introspection capabilities if it Writes a book you can be like hey There’s a bug you know can you fix it And sometimes it’s like gives you a Beautiful explanation of it And like all these models are trained to Do is like token token prediction you Know predict the next few words if you Do a good job predicting the next few Words or at least traditionally you know I guess it’s changed a little bit in the Last year but the guts of it the bulk of The training is just predict the next Token predict the next word And there is something amazing happening Here which is that just doing that at Scale You get to some level of understanding
