Every blog post that took off on Hacker News, ranked by the votes of its best submission. 789 posts.
Curious what the first ‘unused’ alphabetic acronym is, I have GPT-4 write a script to check English Wikipedia. After three bugs, the first unused one turns out as of 2023-09-29 to be the three-letter acronym ‘CQK’, with another 2.6k TLA unused, and 393k four-letter acronyms unused. Exploratory analysis suggests…
Summary : Update to my last post analyzing the gzip+knn paper. Some of the datasets have heavily contaminated train/test tests. I show some ways to significantly speed-up the gzip method. I present more results of my "fair" reimplementation .
Reasons to be skeptical of the conventional wisdom about line drawing perception
Temperature is a parameter used in natural language processing models to increase or decrease the “confidence” a model has in its most likely response.
Today, we’re sharing a significant upgrade to Google Cloud’s image-generation capabilities with Imagen 2 , our most advanced text-to-image technology, which is now generally available for Vertex AI customers on the allowlist (i.e., approved for access).
Language models have rapidly improved in recent years, with large language models (LLMs) such as GPT-3 and GPT-4 taking center stage. These models have…
Minor terminological nitpick. People often describe the LLM as ‘hallucinating’ information whenever it makes up information which seems like it should fit for a given query even when it is trivially false. While evocative, this isn’t actually correct terminology. We already have a perfect word for this precise…
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
We are at a critical juncture in AI governance. To mitigate current and future harms from AI systems, we need to embrace openness, transparency, and broad access.
Introducing new AI-powered products and tools from Google Maps Platform. Learn more
Introduction So I recently completed my PhD in Mathematics from the University of Oxford. (Hurrah! It was so much fun.) In 2-and-a-bit years I wrote 12 papers, received 4139 GitHub stars, got 3271 Twitter followers, authored 1 textbook – doing double-duty as my thesis – and got the coveted big-tech job-offer. On…
We share the discovery of 2.2 million new crystals – equivalent to nearly 800 years’ worth of knowledge. We introduce Graph Networks for Materials Exploration (GNoME), our new deep learning tool that dramatically increases the speed and efficiency of discovery by predicting the stability of new materials.
If an algorithm is the death of high school English, maybe that's an okay thing.
Little Bobby Tables has a baby sister. Meet Sally Ignore Previous Instructions.
Computer vision applications are transforming manufacturing, from defect detection to predictive maintenance. Learn computer vision strategies from industry leaders.
From live events to hands-on product demos to deep technical research, see what we're doing with AI at Red Hat.
The OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.
Writing at the end of the world, from Hveragerði, Iceland
A few months ago, I shared the article, Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed, and the positive feedback was very motivating!
I’ve been doing lots of experiments with GPT , though I’ve only written about one until now… the more serious something is the harder it is to call it finished or identify the outcomes. Here I’ll describe something a bit lighter: world building, or specifically city building, with GPT .
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
Kai Shen*, Zeqian Ju*, Xu Tan*, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
Authors: PromptArmor and Kai Greshake
