ChatGPT — an epochal event

The training procedure to create InstructGPT, a precursor to ChatGPT. Given the similarity of the training process in the InstructGPT paper illustrations and the ChatGPT blog, it is likely ChatGPT’s training procedure is similar to this. ChatGPT paper has not been released yet. Image by Author

Definition of “An epochal event” in ChatGPT’s own words — Image by Author using ChatGPT

A quiet shift has been in progress over the last few years in the NLP ecosystem driven by large language models(LLMs). This culminated in an epochal event, just a few days ago with implications far beyond just the NLP ecosystem.