GenAI – How Embeddings Are Learned ?
Table Of Contents:
- What Are Vector Embeddings.
- What’s the Goal of Learning Embeddings?
- Define What to Represent.
- Initialize the Embedding Matrix.
- Choose a Training Objective (Task).
- Prepare the Training Data.
- Forward Pass.
- Compute Loss.
- Backpropagation.
- Repeat Over Many Batches.
- Use or Export Embeddings.
(1) What Are Vector Embedding ?
(2) What’s the Goal of Learning Embeddings ?
Step-1: Define What to Represent
Step-2: Initialize the Embedding Matrix
Step-3: Choose a Training Objective (Task)
Step-4: Prepare The Training Data
Step-5: Forward Pass
Step-6: Compute Loss
Step-7: Backpropagation
Step-8: Repeat Over Many Batches
Step-9: Use or Export Embeddings
