2821
New
The latest blog posts to take off on Hacker News. 6,331 posts.
2822
What happens if we remove 50 percent of Llama?
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
2823
The industry structure of LLM makers
The Netscapes of AI
2824
Model Context Protocol
MCP is an open standard for connecting AI assistants to the systems where data lives, from content repositories to business tools.
2825
32k context length text embedding models
TL;DR – We are excited to announce voyage-3 and voyage-3-lite embedding models, advancing the frontier of retrieval quality, latency, and cost. voyage-3 outperforms OpenAI v3 large by 7.55% on aver…
2826
Against the Dark Forest
The complex of ideas I’m going to call the Dark Internet Forest emerges from mostly insidery tech thinking, but from multiple directions.
2827
OK, I can partly explain the LLM chess weirdness now
(“make LLMs play better with one weird trick”)
2828
AlphaQubit: AI to identify errors in Quantum Computers
AlphaQubit is an AI-based decoder that identifies quantum computing errors with state-of-the-art accuracy.
2829
2830
2831
Hand Tracking for Mouse Input (2023)
The other day I saw the launch of Apple Vision Pro, the whole thing was very interesting, but one thing that caught my attention was the finger input. It seems very intuitive, by using the finger pinching as sort of like a cursor or mouse input. I figured I want to try it out, so I took it upon myself to create it.
2832
Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference
Llama 3.1 405B on Cerebras is by far the fastest frontier model in the world – 12x faster than GPT-4o and 18x faster than Claude 3.5 Sonnet.
2833
Extending the context length to 1M tokens
API Documentation (Chinese) HuggingFace Demo ModelScope Demo Introduction After the release of Qwen2.5, we heard the community’s demand for processing longer contexts. In recent months, we have made many optimizations for the model capabilities and inference performance of extremely long context. Today, we are proud…
2834
2835
AlphaProof's Greatest Hits
Here I’ll try to explain the coolest ideas in each of AlphaProof’s IMO 2024 solutions. AlphaProof produces proofs in Lean, and each Lean proof is composed of a series of tactics. So I’ll pick out the tactics that correspond to these ideas in the proofs for problems 1, 2 and 6 (the three problems that AlphaProof…
2836
All-in-one embedding model for interleaved text, images, and screenshots
TL;DR — We are excited to announce voyage-multimodal-3, a new state-of-the-art for multimodal embeddings and a big step forward towards seamless RAG and semantic search for documents rich with both…
2837
YC is wrong about LLMs for chip design
LLMs don’t make chips better. Good engineers do.
2838
Something weird is happening with LLMs and chess
Are they good or bad?
2839
Something weird is happening with LLMs and Chess
are they good or bad?
2840
Daisy, an AI granny wasting scammers' time
O2 has today unveiled the newest member of its fraud prevention team, 'Daisy'. As ‘Head of Scammer Relations’, this state-of-the-art AI Granny's mission is to talk with fraudsters and waste as much of their time as possible with human-like rambling chat to keep them away from real people, while highlighting the need…
2841
AI makes tech debt more expensive
AI increases the penalty for low quality code. Gauge is solving the monolith/microservices dilemma. We’re building tools to untangle codebases through incremental modularization. Our open-source toolkit supports defining and enforcing rules for interfaces and dependencies. By focusing on high cohesion and loose…
2842
2843
Interview with gwern
Legacy & Anonymity in the Age of AGI
2844
Francois Chollet is leaving Google
Today, we're announcing that Francois Chollet, the creator of Keras and a leading figure in the AI world, is embarking on a new chapter in his career outside of Google.
2845
A Student's Guide to Writing with ChatGPT
Discover how students can use ChatGPT for writing, research, studying, and editing. Learn practical tips for using AI responsibly in school and beyond.
2846
The Beginner's Guide to Visual Prompt Injections (2023)
Learn about visual prompt injections, their appearance, and top defense strategies against these attacks.
2847
Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac
There’s a whole lot of buzz around the new Qwen2.5-Coder Series of open source (Apache 2.0 licensed) LLM releases from Alibaba’s Qwen research team. On first impression it looks like …
2848
Waymo One is now open to all in Los Angeles
Roll out the red carpet. Starting today, anyone in Los Angeles can take fully autonomous rides 24/7 with Waymo One – rolling through Santa Monica, Hollywood Boulevard, USC, and everything in between.
2849
ML in Go with a Python Sidecar
Machine learning models are rapidly becoming more capable; how can we make use of these powerful new tools in our Go applications?
2850
Everything I've learned so far about running local LLMs
Over the past month I’ve been exploring the rapidly evolving world of Large Language Models (LLM). It’s now accessible enough to run a LLM on a Raspberry Pi smarter than the original ChatGPT (November 2022). A modest desktop or laptop supports even smarter AI. It’s also private, offline, unlimited, and…