2.1.5: Recap

Summary: How Generative AI Processes Text

When you enter a prompt like:
➡️ "Explain black holes"

A Generative AI model follows these steps:

Step 1: Tokenization

Breaks text into smaller parts (tokens).
Example:
"Explain black holes" → ["explain", "black", "holes"]

Step 2: Embeddings
Each token is converted into a numerical vector for processing.

Step 3: Transformer Model Processing

• Self-attention determines which words matter the most.
• Multiple layers refine understanding.

Step 4: Text Generation

• Predicts the most likely next token at each step.
• Constructs output based on learned patterns.