Generative AI Trivia: How Language Models Work

What does a generative AI system produce?

• New content such as text, images or audio
• Only classifications of existing data
• Physical objects on demand
• Verified mathematical proofs

In a language model, what is a token?

• A small chunk of text, such as a word or a word piece
• A paid subscription level
• A unit of computing power
• A saved conversation

Which architecture, introduced in a 2017 paper, powers modern language models?

• The transformer
• The perceptron
• The decision tree
• The convolutional network