481
Converting Codebases with LLMs
Leverage LLMs with context like code structure, libraries, and screenshots to streamline code conversion tasks and accelerate development.
Topics /
AI & Machine Learning
The most popular blog posts about ai & machine learning on Hacker News. 673 posts.
482
Cerebras Inference now 3x faster: Llama3.1-70B breaks 2,100 tokens/s
Cerebras powers the world's fastest AI inference on the biggest wafer chip. Cerebras CS-4 delivers up to 30x faster inference than GPUs.
483
Researchers run high-performing LLM on the energy needed to power a lightbulb
UC Santa Cruz researchers show that it is possible to eliminate the most computationally expensive element of running large language models, called matrix multiplication, while maintaining performance.
484
Everything I've learned so far about running local LLMs
Over the past month I’ve been exploring the rapidly evolving world of Large Language Models (LLM). It’s now accessible enough to run a LLM on a Raspberry Pi smarter than the original ChatGPT (November 2022). A modest desktop or laptop supports even smarter AI. It’s also private, offline, unlimited, and…
485
Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
Introducing Hermes 3 in partnership with Nous Research, the first fine-tune of Meta Llama 3.1 405B model. Train, fine-tune or serve Hermes 3 with Lambda
486
Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformers
Our commitment to developing cutting-edge open models in multiple modalities necessitates a compute solution capable of handling diverse tasks with efficiency. To this end, we conducted a performance analysis, training two of our models, including the highly anticipated Stable Diffusion 3.
487
Trying Kolmogorov-Arnold Networks in Practice
There's been a fair bit of buzz about Kolmogorov-Arnold networks online lately. Some research papers were posted around claiming that they offer better accuracy or faster training compared to traditional neural networks/MLPs for the same parameter count.
488
Claude is now available in Europe
Claude, Anthropic's trusted AI assistant, is now available for people and businesses across Europe.
489
YOLOv5 on FPGA with Hailo-8 and 4 Pi Cameras
Running multi-camera YOLOv5 on Zynq UltraScale+ using a Hailo-8 AI accelerator via FPGA Drive FMC
490
491
Knowledge Graphs in RAG: Hype vs. Ragas Analysis
A deep dive on Microsoft's GraphRAG paper found questionable metrics with vaguely defined lift, so I analyzed knowledge graphs in RAG overall using Neo4j vs FAISS
492
493
LLMs don't do formal reasoning
Important new study from Apple
494
495
Breaking up is hard to do: Chunking in RAG applications
A look at some of the current thinking around chunking data for retrieval-augmented generation (RAG) systems.
496
Dragonfly: A large vision-language model with multi-resolution zoom
Dragonfly is a vision-language architecture with multi-resolution zoom for fine-grained image understanding, including a medical model beating Med-Gemini.
497
Wonder Animation – Video to 3D Animation
Wonder Dynamics (Autodesk company), launches Wonder Animation, groundbreaking video-to-3D scene technology that accelerates animated film production by turning any video sequence into a 3D-animated scene.
498
TPU transformation: A look back at 10 years of our AI-specialized chips
Google has been a leader on AI development for more than a decade by also being a leader in chip development for more than a decade.
499
We created the first open source implementation of Meta's TestGen–LLM
Most LLMs that are competent at generating code, such as ChatGPT, Gemini, and Code Llama, are capable of generating tests.
500
Show me the prompt
Quickly understand inscrutable LLM frameworks by intercepting API calls.
501
Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention
This article will teach you about self-attention mechanisms used in transformer architectures and large language models (LLMs) such as GPT-4 and Llama.
502
Language models on the command line
I gave a talk about accessing Large Language Models from the command-line last week as part of the Mastering LLMs: A Conference For Developers & Data Scientists six week long …
503
504
Waymo and Hyundai enter multi-year, strategic partnership
Today, Waymo and Hyundai Motor Company announced they have entered into a multi-year, strategic partnership.
505
Something weird is happening with LLMs and Chess
are they good or bad?
506
In the land of LLMs, can we do better mock data generation?
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
507
Field experimental evidence of AI on knowledge worker productivity and quality
I think we have an answer on whether AIs will reshape work....
508
Prover-Verifier Games improve legibility of language model outputs
Discover how prover-verifier games improve the legibility of language model outputs, making AI solutions clearer, easier to verify, and more trustworthy for both humans and machines.
509
Large language model data pipelines and Common Crawl
This article provides a short introduction to the pipeline used to create the data to train large language models (LLMs) such as LLaMA using Common Crawl (CC).
510
How to think about creating a dataset for LLM fine-tuning evaluation
I summarise the kinds of evaluations that are needed for a structured data generation task.