The 90-year-old idea behind JEPA models: Canonical Correlation Analysis

Harold Hotelling’s 1936 Canonical Correlation Analysis (CCA) forms the theoretical and intuitive foundation for modern embedding prediction techniques, including JEPA models.