1891
Attention Is Off By One
Let’s fix these pesky Transformer outliers using Softmax One and QuietAttention.
New
The latest blog posts to take off on Hacker News. 3,091 posts.
1892
1893
A framework to securely use LLMs in companies – Part 1: Overview of Risks
Part 1 of a multi-part series on using LLMs securely within your organisation. This post provides a framework to categorize risks based on different use cases and deployment type.
1894
Accessing Llama 2 from the command-line with the LLM-replicate plugin
The big news today is Llama 2, the new openly licensed Large Language Model from Meta AI. It’s a really big deal: Llama 2 is available for free for research …
1895
Generative AI space and the mental imagery of alien minds
AI and the ruliad in the Wolfram Physics Project provide a new way to consider how alien minds might perceive the world. Stephen Wolfram explains how this artificial neuroscience experiment works.
1896
Bad numbers in the “gzip beats BERT” paper?
The recent paper, “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors by Jiang et al. [ link ] recently received a lot of attention on twitter.
1897
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
1898
The Problem with LangChain
LangChain is complicated, so it must be better. Right?
1899
Demystifying Text Data with the Unstructured Python Library
In the world of data, textual data stands out as being particularly complex. It doesn’t fall into neat rows and columns like numerical data does. As a side project, I’m in the process of developing my own personal AI assistant. The objective is to use the data within my notes and documents to answer my questions. The…
1900
The many ways that digital minds can know – A better way to think about LLMs
LLMs do all the things people say they do at once, even if those people vociferously disagree, and they’re all useful.
1901
AI and the Automation of Work
ChatGPT and generative AI will change how we work, but how different is this to all the other waves of automation of the last 200 years? What does it mean for employment? Disruption? Coal consumption?
1902
LLM tech comes to Wolfram Language
Wolfram's Version 13.3 includes a subsystem around LLMs plus new functionality in integrals, special functions, finite fields, computational geometry, live highlighting in visualizations, AR & VR deployment. See examples for those and dozens of other enhancements.
1903
Building Boba AI: Lessons learnt in building an LLM-powered application
A series of patterns for building an AI co-pilot application.
1904
1905
The idea maze for AI startups (2015)
programming, philosophy, history, internet, startups
1906
Natural language is an unnatural interface
How can we use familiar design patterns to constrain the unwieldy state space of large language models?
1907
LLM Powered Autonomous Agents
Building agents with LLM (large language model) as its core controller is a cool concept. Several proof-of-concepts demos, such as AutoGPT, GPT-Engineer and BabyAGI, serve as inspiring examples. The potentiality of LLM extends beyond generating well-written copies, stories, essays and programs; it can be framed as a…
1908
What are embeddings?
A deep-dive into machine learning embeddings.
1909
Using GPT-4 to measure the passage of time in fiction
Large language models are valuable research assistants, especially when they refuse to follow instructions.
1910
How RLHF Works
Why RLHF may still win out and why we haven't seen it yet in open-source.
1911
The Neural Net Tank Urban Legend
AI folklore tells a story about a neural network trained to detect tanks which instead learned to detect time of day; investigating, this probably never happened.
1912
Comparing Adobe Firefly, Dalle-2, and OpenJourney
“🔄 Update: after posting this on HN, some commenters provided Stable Diffusion and Midjourney results as well which are now included.” In the recent Photoshop Betas, users are now able...
1913
AI has poisoned its own well
What will happen to GPT-{n} once LLMs contribute much of the language found online? We find that use of model-generated content in training causes irreversible defects in the resulting models, where tails of the original content distribution disappear. We refer to this effect as Model Collapse and show that it can…
1914
Hello, Perceptron: An introduction to artificial neural networks
Generative AI tools like ChatGPT and Midjournery are able to replicate (and often exceed) human-like performance on tasks like taking exams, generating text and making art.
1915
Native JSON Output from GPT-4
When integrating LLMs in your products, you often want to generate structured data, like JSONs. With the help of function calling (released June 13th 2023), this process has become much simpler! In this post I will explore the new API. Thanks for reading Simon’s Substack! Subscribe for free to receive new posts and…
1916
Reddit is OpenAI’s moat
Interpreting Reddit's API changes in light of how it serves OpenAI.
1917
Obsidian-Copilot: A Prototype Assistant for Writing and Thinking
Writing drafts via retrieval-augmented generation. Also reflecting on the week's journal entries.
1918
1919
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
1920
LLMs are good at playing you
Large language models seem just like humans, but some of this is in our heads.