Ideas
- Jul 22, 2025 Why the Loss Landscape Metaphor is Misleading
Most visualizations of loss landscapes are 2D slices of astronomically high-dimensional spaces. Here's why that matters and what we should think about instead.
Most visualizations of loss landscapes are 2D slices of astronomically high-dimensional spaces. Here's why that matters and what we should think about instead.