Transformers: Why the T in ChatGPT is AI’s biggest breakthrough – and greatest risk

A good neural network architecture is vital when developing artificial intelligence

SHUTTERSTOCK/Qpt

When ChatGPT first took the world by storm in 2022, its capabilities were so impressive that people happily looked past its awkward name. Yet hidden within those initials lies a key breakthrough responsible for sending artificial intelligence rocketing these past few years – and potentially a limitation that could see it crashing back to Earth.

GPT stands for generative pre-trained transformer, and it is the last word that matters most. The term was coined in a 2017 paper by a team at Google, which introduced a concept called…

Comments

No comments yet. Why don’t you start the discussion?

Leave a Reply

Your email address will not be published. Required fields are marked *