Ivan Pleshkov personal blog
A polynomial autoencoder beats PCA on transformer embeddings
A closed-form autoencoder: PCA encoder + quadratic Ridge decoder. On FiQA it gives 4× compression of mxbai-embed-large-v1 at -0.88 p.p. NDCG@10, +1.34 p.p. over PCA. No SGD, no neural networks.
- Points
- 106
- HN comments
- 36
- Submissions
- 1
- Cited by
- 0 commenters
AI & Machine LearningDatabases & Data2026
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| May 5, 2026 | A polynomial autoencoder beats PCA on transformer embeddings by timvisee | 106 | 36 |
