151
Protecting customers with generative AI indemnification
Google Cloud assumes responsibility for potential legal risks of using our generative AI, offering indemnities for training data and generated output.
Most cited
Posts that commenters keep linking to, ranked by how many different people have cited them in Hacker News comments. 155 posts.
152
Continuous batching to increase LLM inference throughput and reduce p50 latency
In this blog, we discuss continuous batching, a critical systems-level optimization that improves both throughput and latency under load for LLMs.
153
154
20x faster than pgvector: HNSW index in Postgres with pg_embedding
We’re excited to announce the release of our pg_embedding extension for Postgres and LangChain! The new pg_embedding extension brings 20x the speed for 99% accuracy to graph-based approximate nearest neighbor search to your Postgres databases. While the pgvector extension with IVFFlat indexing has been a popular…
155
OverflowAI
Let’s highlight the new features and products we announced today from the stage of WeAreDevelopers.