The GPT-3 Vocabulary Size [We Did The Math]

GPT-3 is one of the most powerful large language models available worldwide. It was trained on a corpus of more than half a trillion words, but how many of those words are unique? With GPT-3 being available in 46 languages…