691
RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 2,337 posts.
692
IBM scientists demonstrate 10x faster large-scale machine learning using GPUs
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.
693
PostgreSQL 12 Beta 1 Released
The PostgreSQL Global Development Group announces that the first beta release of PostgreSQL 12 is now available for download. This …
694
695
We built our customer data warehouse all on Postgres
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
696
10M events a month, free
Discover why Amplitude Behavioral Analytics is the future of Product Intelligence that will provide the 'a-ha" moment needed for the success of any product.
697
Which color scale to use when visualizing data
This is part 1 of a series on “Which color scale to use when visualizing data” (Part …
698
Scientists make huge dataset of nearby stars available to public
Members of the public can search a newly released database of 1,600 stars to find signs of undiscovered exoplanets. The dataset, taken over two decades by the W.M. Keck Observatory in Hawaii, comes with an open-source software package and an online tutorial.
699
PlanetScale Offering $5 Databases
Introducing the $5 PlanetScale plan.
700
Predicting Stock Performance with Natural Language Deep Learning
We developed an NLP deep learning model using a one-dimensional convolutional neural network to predict future stock market performance of companies using Azure ML Workbench and Keras with open source for you to replicate.
701
GitLab is working on a tool just for data teams
Meltano is an open source tool for the entire data science lifecycle, and we want your contributions and feature requests!
702
Multi-tenant queues in Postgres
How we implemented fair queueing strategies for Postgres-backed task queues to ensure fair execution time across tenants.
703
AWS, Azure, and GCP respond to cloud report
Key learnings about how to get the best performance from GCP, AWS, and Azure based on original research and conversations with the big three.
704
When did Postgres become cool?
Craig takes a look at the history of Postgres. From the origins of the project through some of the key production features that make Postgres what it is today.
705
There are very few suitable use cases for DynamoDB
Edit: This article is firmly out of date now. I have not gone back to try dynamoDB but I have heard they have changed how throughput is…
706
Postgres transactions are a distributed systems superpower
Keeping workflow state and application data in the same Postgres database lets one transaction update both, simplifying idempotency and atomicity.
707
708
Turning the database inside-out with Apache Samza
Confluent is building the foundational platform for data in motion so any organization can innovate and win in a digital-first world.
709
Practical advice for analysis of large, complex data sets
By PATRICK RILEY For a number of years, I led the data science team for Google Search logs. We were often asked to make sense of confusin...
710
Excel will allow certain auto data conversions to be turned off
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
711
What happens if we remove 50 percent of Llama?
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
712
Jepsen: MongoDB 3.6.4
MongoDB is a long-time user of Jepsen . Over the past three years, Jepsen has performed several analyses for MongoDB, and MongoDB has integrated an expansive Jepsen test suite into their CI system. In March, MongoDB requested Jepsen perform an analysis on a previously untested configuration: sharded clusters. We also…
713
Caching Beyond RAM: The Case for NVMe
memcached
714
715
Which table format do LLMs understand best?
We benchmarked 11 data formats, including markdown tables, JSON, CSV, YAML, XML, and more, to see which LLMs understand best. We found surprising accuracy and token cost trade-offs.
716
Tin: full-text search for Postgres
TIN is a fast, full-featured, full-text search index for Postgres
717
Deno KV internals: building a database for the modern web
How we built a performant, scalable, ACID-compliant, JavaScript-native database on FoundationDB.
718
719
720
Every System is a Log: Avoiding coordination in distributed applications
Distributed coordination makes application complex and brittle. Because all systems eventually build on logs, we can use a shared-log approach to eliminate most coordination. We discuss this conceptually and show how this is practically implemented in the open source project Restate.