I'm wholeheartedly confused why so many people are only just now learning of OpenAI/GPT-3 and its chat mode, I guess presentation truly is everything. Nothing here is particularly new, it's just a better model than before.
Statements like "the people haven't realized it yet" confuse me because "the people" is two groups. People in the know, and people not in the know. Everyone in the know realizes where this is headed and what the potential is.
Those not in the know simply lack the technical background to have followed the incremental developments up till now which have led to this moment, for them it's a parlor trick because even today they cannot grasp the potential of existing technology. I could similarly lament about how people treat the Internet.
It's like with Dalle-2 and StableDiffusion, so many people were just not understanding how it was even possible, some people even going as far as calling it a hoax in some way.
But for anyone paying attention, it's been easy to see the progression. I'm not even an ML person but I could give you a map from every paper to every other paper for how this has all been happening faster and faster, basically starting with AlexNet in 2012.
That said, this chatGPT is different than GPT-3's first demos earlier last year or the Codex interface in that it is implementing a consistent memory and seems to have a token length capability much, much longer than before. This is having a huge effect on what you can coax out of a chat with it. You can tell it to act a certain way and then continuously interact with that entity- with GPT, you got the one prompt, but once you tried again with a new prompt that memory was gone. You could attempt to feed the entire output back in as input, but at least initially the token length would cut things off eventually. Meanwhile, with chatGPT, I just had a 20-minute conversation with a "girl from Reseda, CA' who's a barista and like, totally is going to go on a keto diet like her sister. " because I told it that is who it should act like it is and under all circumstances it should respond to my chat in that way.
BTW she says that "bangs are totally in style right now" and she really likes "exploring new hairstyles like ones from the 90's"
Statements like "the people haven't realized it yet" confuse me because "the people" is two groups. People in the know, and people not in the know. Everyone in the know realizes where this is headed and what the potential is.
Those not in the know simply lack the technical background to have followed the incremental developments up till now which have led to this moment, for them it's a parlor trick because even today they cannot grasp the potential of existing technology. I could similarly lament about how people treat the Internet.