ChatGPT — an epochal event

Ajit Rajasekharan
12 min readDec 17, 2022
The training procedure to create InstructGPT, a precursor to ChatGPT. Given the similarity of the training process in the InstructGPT paper illustrations and the ChatGPT blog, it is likely ChatGPT’s training procedure is similar to this. ChatGPT paper has not been released yet. Image by Author
Definition of “An epochal event” in ChatGPT’s own words — Image by Author using ChatGPT

A quiet shift has been in progress over the last few years in the NLP ecosystem driven by large language models(LLMs). This culminated in an epochal event, just a few days ago with implications far beyond just the NLP ecosystem.

Ajit Rajasekharan

Machine learning practitioner