1: \begin{abstract}

2: We argue that representations in AI models, particularly deep networks, are converging. First, we survey many examples of convergence in the literature: over time and across multiple domains, the ways by which different neural networks represent data are becoming more aligned. 

3: Next, we demonstrate convergence across data modalities: as vision models and language models get larger, they measure distance between datapoints in a more and more alike way. 

4: We hypothesize that this convergence is driving toward a shared statistical model of reality, akin to Plato's concept of an ideal reality. We term such a representation the \textit{platonic representation} and discuss several possible selective pressures toward it. Finally, we discuss the implications of these trends, their limitations, and counterexamples to our analysis.

5: 

6: \vspace*{0pt}

7: \begingroup%

8: \fontsize{8.5pt}{10pt}\selectfont%

9: \noindent\begin{tabular}{@{}lr@{}}

10: \textbf{\fontsize{9.5pt}{10pt}\selectfont Project Page:}\hspace{0.2em} & \hspace{-1.025em}\href{https://phillipi.github.io/prh/}{\texttt{phillipi.github.io/prh}}\\[0.8ex]

11: {\textbf{\fontsize{9.5pt}{10pt}\selectfont Code:}} & \hspace{-1.75em}%

12: {

13: \href{https://github.com/minyoungg/platonic-rep/}%

14: {\texttt{github.com/minyoungg/platonic-rep}}%

15: }

16: \end{tabular}%

17: \endgroup%

18: \vspace*{-7.25pt}

19: \end{abstract}

20: