3091
Large language model data pipelines and Common Crawl
This article provides a short introduction to the pipeline used to create the data to train large language models (LLMs) such as LLaMA using Common Crawl (CC).
New
The latest blog posts to take off on Hacker News. 6,334 posts.
3092
3D Gaussian Splatting as Markov Chain Monte Carlo
Novel view reconstructions for (right) our method and (left) conventional 3D Gaussian Splatting with random initializations. Our method, even with random initialization, faithfully reconstructs the scene (e.g.. buildings at the back and the ground texture) providing much higher quality renderings.
3093
Sharing new research, models, and datasets from Meta FAIR
Meta FAIR is releasing several new research artifacts. Our hope is that the research community can use them to innovate, explore, and discover new ways to apply AI at scale.
3094
Satellites Spotting Ships
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
3095
Every Way to Get Structured Output from LLMs
A survey of every framework for extracting structured output from LLMs, and how they compare.
3096
Getting 50% (SoTA) on Arc-AGI with GPT-4o
You can just draw more samples
3097
LLM that can call multiple tool APIs with one request
Learn about Cohere models' ability to perform multi-step tasks, enhancing productivity and efficiency.
3098
Maintaining large-scale AI capacity at Meta
Meta is currently operating many data centers with GPU training clusters across the world. Our data centers are the backbone of our operations, meticulously designed to support the scaling demands …
3099
AI for math resources, and erdosproblems.com
This post contains two unrelated announcements. Firstly, I would like to promote a useful list of resources for AI in Mathematics, that was initiated by Talia Ringer (with the crowdsourced assistan…
3100
Perplexity AI is lying about their user agent
Perplexity AI claims it sends a user agent and respects robots.txt but it absolutely does not
3101
Tesla's FSD – A Useless Technology Demo
In the past months, Tesla has been offering a free, one-month trial of their full self-driving (FSD) system to all current owners. It looks like they are rolling this out in stages, because I only got mine only a few days ago.
3102
Making my local LLM voice assistant faster and more scalable with RAG
If you read my previous blog post, you probably already know that I like my smart home open-source and very local, and that certainly includes any voice assistant I may have. If you watched the video demo, you have probably also found out that it’s… slow. Trust me, I did too. Prefix caching helps, but it feels like…
3103
Microsoft's Recall AI feature is now indefinitely delayed
Update Oct. 31, 2024: We are committed to delivering a secure and trusted experience with Recall. We recently shared updates to the security and privacy architecture for Recall in a
3104
Turning the Tables on AI
How about using it not to think less but *more*?
3105
Nemotron-4-340B
Nemotron-4 340B, a family of models optimized for NVIDIA NeMo and NVIDIA TensorRT-LLM, includes cutting-edge instruct and reward models, and a dataset for generative AI training.
3106
Cost of self hosting Llama-3 8B-Instruct
Blog posts from the lytix team
3107
A look at Apple's technical approach to AI including core model performance etc.
Apple Intelligence makes a lot of sense when you get out of the AI bubble. Plus, the cool technical details Apple shared about their language models "thinking different."
3108
3109
New algorithm discovers language just by watching videos
Mark Hamilton, an MIT PhD student in electrical engineering and computer science and affiliate of MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), wants to use machines to understand how animals communicate. To do that, he set out first to create a system that can learn human language “from…
3110
AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
There has been much anticipation around AMD's flagship MI300X accelerator. With unmatched raw specs, the pressing question remains: Can it outperform NVIDIA's Hopper architecture in real-world AI workloads? We have some exciting early results to share. For the past month, TensorWave and MK1 have worked closely to…
3111
How Meta trains large language models at scale
As we continue to focus our AI research and development on solving increasingly complex problems, one of the most significant and challenging shifts we’ve experienced is the sheer scale of co…
3112
How Alexa dropped the ball on being the top conversational system
I discuss why Alexa missed the opportunity to take the lead and become the dominant player in the conversational AI market.
3113
Mistral AI raises $640M at $6B valuation
Today, we are excited to triple down on our partnership with Mistral AI by co-leading their €600M Series B round.
3114
ARC Prize – a $1M+ competition towards open AGI progress
Announcing ARC Prize - a $1M+ competition towards open AGI progress
3115
Pgvector Is Now Faster Than Pinecone at 75% Less Cost
Meet pgvectorscale, an open-source PostgreSQL extension that supercharges pgvector’s vector search performance for large-scale vector workloads.
3116
Private Cloud Compute: A new frontier for AI privacy in the cloud
Secure and private AI processing in the cloud poses a formidable new challenge. To support advanced features of Apple Intelligence with larger foundation models, we created Private Cloud Compute (PCC), a groundbreaking cloud intelligence system designed specifically for private AI processing. Built with custom Apple…
3117
Apple's On-Device and Server Foundation Models
At the 2024 Worldwide Developers Conference, we introduced Apple Intelligence, a personal intelligence system integrated deeply into iOS 18…
3118
OpenAI and Apple Announce Partnership
OpenAI and Apple announce partnership to integrate ChatGPT into Apple experiences.
3119
Apple Intelligence for iPhone, iPad, and Mac
Apple today introduced Apple Intelligence, the personal intelligence system for iPhone, iPad, and Mac.
3120
A ChatGPT mistake cost us $10k
Edit: I want to preface this by saying yes the practices here are very bad and embarrassing (and we've since added robust unit/integration tests and alerting...