Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

My guess is that the question translated to a medium/strong penalization for the word "the" and that's why it did so well at first, but as it generated more and more this original penalization got diluted by the new probabilities of the decoder (as "the" would have a high generation probability for obvious reasons). And since the decoder is greedy, it eventually wrote itself into a corner where "the" overcome whichever penalty the original prompt set.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: