RedPajama v2 Open Dataset with 30T Tokens for Training LLMs
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 2,337 posts.
RedPajama-Data-v2 is a 30 trillion token open dataset from 84 CommonCrawl dumps across five languages, with over 40 precomputed quality annotations.
The IBM Research blog is the home for stories told by the researchers, scientists, and engineers inventing What’s Next in science and technology.
The PostgreSQL Global Development Group announces that the first beta release of PostgreSQL 12 is now available for download. This …
Engineering deep-dives, product updates, and company news from Tembo — the platform for running coding agents across your stack.
Discover why Amplitude Behavioral Analytics is the future of Product Intelligence that will provide the 'a-ha" moment needed for the success of any product.
This is part 1 of a series on “Which color scale to use when visualizing data” (Part …
Members of the public can search a newly released database of 1,600 stars to find signs of undiscovered exoplanets. The dataset, taken over two decades by the W.M. Keck Observatory in Hawaii, comes with an open-source software package and an online tutorial.
Introducing the $5 PlanetScale plan.
We developed an NLP deep learning model using a one-dimensional convolutional neural network to predict future stock market performance of companies using Azure ML Workbench and Keras with open source for you to replicate.
Meltano is an open source tool for the entire data science lifecycle, and we want your contributions and feature requests!
How we implemented fair queueing strategies for Postgres-backed task queues to ensure fair execution time across tenants.
Key learnings about how to get the best performance from GCP, AWS, and Azure based on original research and conversations with the big three.
Craig takes a look at the history of Postgres. From the origins of the project through some of the key production features that make Postgres what it is today.
Edit: This article is firmly out of date now. I have not gone back to try dynamoDB but I have heard they have changed how throughput is…
Keeping workflow state and application data in the same Postgres database lets one transaction update both, simplifying idempotency and atomicity.
Confluent is building the foundational platform for data in motion so any organization can innovate and win in a digital-first world.
By PATRICK RILEY For a number of years, I led the data science team for Google Search logs. We were often asked to make sense of confusin...
Based on your feedback, we've improved the Automatic Data Conversion settings, and made them also available in Excel for Mac.
Discover Sparse Llama: A 50% pruned, GPU-optimized Llama 3.1 model with 2:4 sparsity, enabling faster, cost-effective inference without sacrificing accuracy.
MongoDB is a long-time user of Jepsen . Over the past three years, Jepsen has performed several analyses for MongoDB, and MongoDB has integrated an expansive Jepsen test suite into their CI system. In March, MongoDB requested Jepsen perform an analysis on a previously untested configuration: sharded clusters. We also…
memcached
We benchmarked 11 data formats, including markdown tables, JSON, CSV, YAML, XML, and more, to see which LLMs understand best. We found surprising accuracy and token cost trade-offs.
TIN is a fast, full-featured, full-text search index for Postgres
How we built a performant, scalable, ACID-compliant, JavaScript-native database on FoundationDB.
Distributed coordination makes application complex and brittle. Because all systems eventually build on logs, we can use a shared-log approach to eliminate most coordination. We discuss this conceptually and show how this is practically implemented in the open source project Restate.