Architecture
Latent Space
A compressed, abstract representation space learned by a model where input data is encoded as vectors, capturing meaningful structure and relationships.
Explained at five levels
Level 1
A secret map inside the AI's brain where similar things are stored close together — like cats near dogs but far from cars.
Level 2
An invisible space where AI organizes its understanding — similar concepts are placed near each other, letting the AI see relationships between things.
Level 3
A compressed, abstract representation space learned by a model where input data is encoded as vectors, capturing meaningful structure and relationships.
Level 4
The continuous vector space learned by encoder models where data points are represented as dense vectors, with geometric relationships (distance, direction) corresponding to semantic properties.
Level 5
A learned manifold in ℝⁿ where the data distribution is mapped via an encoder function — traversable for interpolation, disentangled along semantically meaningful axes, and decodable back to observation space, forming the basis of VAEs, diffusion models, and representation learning.
Definitions are educational summaries. Terminology can vary by source and context.
Sources
- NIST Trustworthy and Responsible AI Resource Center: Glossary — National Institute of Standards and Technology. Accessed 2026-07-20.