Build a search engine, not a vector DB
Don’t confuse embeddings with memory. To build effective RAG, start with a search engine, not just a vector database.
The latest blog posts to take off on Hacker News. 21,820 posts.
Don’t confuse embeddings with memory. To build effective RAG, start with a search engine, not just a vector database.
In April 2021, the Vulkan® Working Group at Khronos® released a set of provisional extensions, collectively referred to as ‘Vulkan Video’ which provide seamless encoding and decoding of video streams using a variety of video coding standards. The December 2022 release of Vulkan 1.3.238 saw the finalization of the…
A simple, whitespace theme for academics. Based on [*folio](https://github.com/bogoli/-folio) design.
Fire is an interesting graphics problem. Past approaches generally faked it. For example, Lord of the Rings used sprites with lots and lots of smoke (the fluid sim was too expensive at the time, even for movies). Real-time applications like video games have pretty much exclusively used non-physical approaches.
Right after getting my degree, I was lucky to be hired into a small but decent R&D department as an embedded software engineer. My first task was to create a Unit Test project and have it run in our build pipeline after compilation. I was not particularly excited about this task, it seemed like busywork to me. I…
As adding more code to a product will slow down development, we should view all code as technical debt.
.NET 8 includes significant improvements to the Hardware Intrinsics feature.
Software companies come in many sizes. There are small startups, medium-sized companies, and huge enterprises. As you might expect, startups are usually lean and fast. Big companies that develop large applications move much more slowly. Those might be systems developed for many years or decades by hundreds of…
Suppose that the logic of your program depends on time. That is, you need to keep track of when something in the past happened, and what tim...
The Qt Quick Compiler has learned a few new tricks recently that can make your QML code run a lot faster.
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays…
Emacs incremental search (isearch) has an embarrassingly rich feature set. That said, I rarely use isearch beyond its basics for the twofold reasons: There are many isearch commands that are...
Introduction In this blog, we'll be going over some more advanced topics new in Postgres 16. Having some experience with Linux, Postgres, and SQL is necessary as we'll not only be going over these new features but also how to implement them. This blog was written using PostgreSQL 16 (Development Version) running on…
This year, the YJIT team has been working hard to improve and optimize YJIT. We’re proud to say that the version of YJIT to be included with Ruby 3.3 is leaps and bounds ahead of Ruby 3.2’s. It provides better performance across the board, while also warming up faster and using less memory. The 3.3 release is also…
Introducing Fly Kubernetes: If you want K8s on Fly.io, we built something for you.
From pure Python to AVX-512 assembly, optimizing cosine similarity reveals a 2,500x speedup through SIMD, FP16, and VNNI instructions on modern Intel CPUs.
Figuring out how much parallelism your program can use is surprisingly tricky.
Zig is a new, independently developed low-level programming language. It’s a modern reimagining of C that attempts to retain C’s performance while embracing improvements from the last 30 years of tooling and language design. Zig makes calling into C code easier than any other language I’ve used. Zig also treats unit…
Static vs dynamic typing debates often flounder because the debators see from two different perspectives without knowing it. Learning to identify the two perspectives can calm the discussion. The tension between the two perspectives has led to Gradual Typing and other technologies.
Like Jupyter notebooks, but for any language.
As regular readers of this blog will now, JDK Flight Recorder (JFR) is one of my favorite tools of the Java platform. This low-overhead event recording engine built into the JVM is invaluable for …
Users of mature C libraries conventionally get to choose how memory is allocated — that is, when it cannot be avoided entirely . The C standard never laid down a convention — perhaps for the better — so each library re-invents an allocator interface. Not all are created equal, and most repeat a few fundamental…
What options are there other than GitHub?
I recently wrote a small 16-bit Forth for 8086 PCs running DOS. I built the basic one-liner loop words that can trivially be built with j...
Knock knock? Who’s there? It’s me, Oskar, the end is near, did you know that? Ah, you know it but don’t know how to proceed? Let’s talk about the end of the CRUD world…
Posted by Phitchaya Mangpo Phothilimthana, Staff Research Scientist, Google DeepMind, and Bryan Perozzi, Senior Staff Research Scientist, Google Re...
Update: We have published a new blog post describing an additional Zulip plan for self-hosting without commercial support. Zulip is a 100% open-source team chat application designed for efficient communication. Zulip is available as a cloud service or a self-hosted solution. Organizations that self-host …
Finding that 70% of attention heads and 20% of feed-forward networks can be excised with minimal effect on in-context learning suggests that large language models are undertrained.
The fundamental problems a database engineer thinks about in the shower