541
What are transformer models and how do they work?
Explore the fundamentals of transformer models, which have revolutionized natural language processing.
New
The latest blog posts to take off on Hacker News. 789 posts.
542
543
Prompt injection: what’s the worst that can happen?
Activity around building sophisticated applications on top of LLMs (Large Language Models) such as GPT-3/4/ChatGPT/etc is growing like wildfire right now. Many of these applications are potentially vulnerable to prompt …
544
Beyond automatic differentiation
Posted by Matthew Streeter, Software Engineer, Google Research Derivatives play a central role in optimization and machine learning. By locally app...
545
Temporal quality degradation in AI models
A recent study from MIT, Harvard, The University of Monterrey, and other top institutions showed an experiment where 91% of their ML models degrade over time . This study is one of the first of its kind, where researchers focus on studying machine learning models' behavior after deployment and how their performance…
546
Building LLM Applications for Production
[Hacker News discussion, LinkedIn discussion, Twitter thread]
547
548
Sorting waste and recyclables with a fleet of robots
Posted by Sergey Levine, Research Scientist, and Alexander Herzog, Staff Research Software Engineer, Google Research, Brain Team Reinforcement lear...
549
Amazon CodeWhisperer, Free for Individual Use, Is Now Generally Available
Today, Amazon CodeWhisperer, a real-time AI coding companion, is generally available and also includes a CodeWhisperer Individual tier that’s free to use for all developers. Originally launched in preview last year, CodeWhisperer keeps developers in the zone and productive, helping them write code quickly and securely…
550
Do you need a vector database?
Spoiler alert: the answer is maybe! Although, my inclusion of the word “actually” betrays my bias. Vector databases are having their day right now. Three different vector DB companies have raised money on valuations up to $700 million (paywall link). Surprisingly, their rise in popularity is not for their “original”…
551
Scaffolded LLMs as natural language computers
Recently, LLM-based agents have been all the rage – with projects like AutoGPT showing how easy it is to wrap an LLM in a simple agentic loop and prompt it to achieve real-world tasks. More generally, we can think about the class of ‘scaffolded’ 1 LLM systems – which wrap...
552
Experimenting with LLMs to Research, Reflect, and Plan
Also, shortcomings in document retrieval and how to overcome them with search & recsys techniques.
553
Replacing my best friends with an LLM trained on 500k group chat messages
An exploration into customizing LLMs for personal use
554
Free Dolly: First truly open instruction-tuned LLM
Introducing Dolly, the first open-source, commercially viable instruction-tuned LLM, enabling accessible and cost-effective AI solutions.
555
GPT-4 gets a B on my quantum computing final exam
Update (April 14): On the suggestion of my TA Justin Yirka, I gave GPT-4 problem 2 from the final exam, along with its own answers and my and Justin’s grading comments, and asked it whether i…
556
557
558
Maximizing the Potential of LLMs: A Guide to Prompt Engineering
Language models have rapidly improved in recent years, with large language models (LLMs) such as GPT-3 and GPT-4 taking center stage. These models have…
559
Twitter showed us its algorithm – what does it tell us?
On March 31, Twitter open-sourced its recommendation algorithm. It turns out to be a standard engagement prediction algorithm of the kind most major platforms use; I explained how these algorithms work in a recent essay . The source code release makes for an interesting case study of social media transparency. Let’s…
560
Emergent abilities of large language models
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.
561
Teaching ChatGPT to speak my son’s invented language
Becoming fluent in my son’s invented language was too difficult for me, so I decided to see how would AI do.
562
Why is GPT-3 15.77x more expensive for certain languages?
How large language models process multilingual data differently
563
From deep to long learning?
For the last two years , a line of work in our lab has been to increase sequence length. We thought longer sequences would enable a new era of machine learning foundation models: they could learn from longer contexts, multiple media sources, complex demonstrations, and more. All data ready and waiting to be learned…
564
I wish GPT4 had never happened
Made in Notion, the connected workspace where AI agents and teams organize docs, projects and knowledge together.
565
566
We need to tell people ChatGPT will lie to them, not debate linguistics
ChatGPT lies to people. This is a serious bug that has so far resisted all attempts at a fix. We need to prioritize helping people understand this, not debating the …
567
4000x Speedup in Reinforcement Learning with Jax
Web publication for "PureJaxRL"
568
What it feels like to work in AI right now
Fear, FOMO, and the scientific exodus driven by ChatGPT
569
Defamed by ChatGPT
Yesterday, President Joe Biden declared that “it remains to be seen” whether Artificial Intelligence (AI) is “dangerous.” I would beg to differ. I have been writing about th…
570
Simply explained: How does GPT work?
By now, you have probably heard of OpenAI’s ChatGPT, or any of the alternatives GPT-3, GPT-4, Microsoft’s Bing Chat, Facebook’s LLaMa or even Google’s Bard. They are artificial intelligence programs that can participate in a conversation. Impressively smart, they can easily be mistaken for humans, and are skilled in a…