AI Research Engineering

tuned.org.uk

The Graph Wiring framework: exploiting feature-space spectral structure in vector search, with Spectral Indexing as its task-specific instantiation. Couples geometric similarity with spectral information to improve head–tail coherence and semantic alignment beyond purely geometric retrieval, supports adaptive search…

Popular posts: 1
Total points: 144
HN comments: 58
Rank: #16,441 personal

Visit tuned.org.uk → RSS feedOn Hacker News Jan 2026 – Jan 2026

Math & Algorithms 1 AI & Machine Learning 1

Most points Most discussed Most cited Newest

Starting from scratch: Training a 30M Topological Transformer

2026144 points58 comments AI & Machine Learning details

Tauformer is a topological transformer (see paper ) that replaces dot‑product attention with a Laplacian-derived scalar (taumode) per token/head, then attends using distances in that scalar space. Below is a post-style overview of the idea and the first training signals from a 30M-parameter run.