91
Searching 20 GB/sec: Systems Engineering Before Algorithms (2014)
SentinelOne unifies AI-powered endpoint, cloud, identity, and data protection—enhanced by our Security Data Lake for seamless and efficient cybersecurity.
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 198 posts.
92
Web Scraping to Create Open Data
Web Scraping to Create Open Data - Embrace the power of web scraping in generating open data. Contribute to the open data movement.
93
94
PostgreSQL 9.6 Beta 1 Released
The PostgreSQL Global Development Group announces today that the first beta release of PostgreSQL 9.6 is available for download. This …
95
Recreating Our Galaxy in a Supercomputer
A new simulation of our Milky Way galaxy has solved a decades-old mystery.
96
Sorry ARIMA, but I’m Going Bayesian
When people think of “data science” they probably think of algorithms that scan large datasets to predict a customer’s next move or interpret unstructured te...
97
Billions of Messages a Day – Yelp's Real-Time Data Pipeline
Billions of Messages a Day - Yelp's Real-time Data Pipeline Justin C., Software Engineer Jul 14, 2016 This post is part of a series covering Yelp's real-time streaming data infrastructure....
98
Apache Arrow: A new open source in-memory columnar data format
Open source Big Data in-memory columnar layer accelerates analytical processing and interchange by more than 100x. Forest Hill, MD –17 Feb 2016– The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache…
99
Debunking Misleading Benchmarks Of Redshift vs BigQuery
Publishing misleading performance benchmarks is a classic old guard marketing tactic. It’s not surprising to see old guard companies (like Oracle) doing this, but we were kind of surprised to see Google take this approach, too. So, when Google presented their BigQuery vs. Amazon Redshift benchmark results at a private…
100
Introducing the Open Images Dataset
Posted by Ivan Krasin and Tom Duerig, Software EngineersIn the last few years, advances in machine learning have enabled Computer Vision to progres...
101
Amazon S3 Transfer Acceleration
Several AWS teams are focused on simplifying and accelerating the process of moving on-premises data to the cloud. We started out with the very basic PUT operation and multipart upload in the early days. Along the way we gave you the ability to send us a disk, and made that process even easier by launching […]
102
103
104
105
Developer Preview: RethinkDB Now Available for Windows
We’re pleased to announce today that RethinkDB is now available for Windows . You can download a Developer Preview of our Windows build, which runs natively on Microsoft’s operating system.
106
Python Versions Used in Commercial Projects, 2016 Edition
Is it Python 2 or 3 that gets the job done? We crunched the data to find out.
107
Unstructured Datatypes in Postgres – Hstore vs. JSON vs. JSONB
All about when to use unstructured data types in Postgres, such as Hstore, JSON, and JSONB. The tl;dr is that the right data type depends on your use case. Here we dig deep into the benefits, and why JSONB became so popular since it first got real and proper support in Postgres 9.4. The B in JSONB stands for better.
108
109
110
RethinkDB 2.1.5 performance and scalability
This report describes a recent effort that the RethinkDB team took to measure our database product, RethinkDB, under different workloads and in different clustering configurations. We seek to provide a general overview of RethinkDB’s performance metrics for a variety of workloads and potential use cases. In this…
111
IPv6 Support for Amazon S3
Update October 1, 2021 – This post has been edited to remove outdated S3 buckets. As you probably know, every server and device that is connected to the Internet must have a unique IP address. Way back in 1981, RFC 791 (“Internet Protocol”) defined an IP address as a 32-bit entity, with three distinct network […]
112
Postgres Count Performance
Everybody counts, but not always quickly. This post looks into how the PostgreSQL database optimizes counting. In Postgres, there are ways to count orders of magnitude faster. We’ll look at exact counts (distinct counts) as well as estimated counts, using approximation algorithms such as HyperLogLog (HLL) in Postgres.
113
InfluxDB v0.10 GA with hundreds of thousands writes/sec, 98% better compression
The team at InfluxData is excited to announce the stable version of InfluxDB 0.10! Read about it here and see what are the new changes!
114
115
116
117
Dragon: A distributed graph query engine
Visit the post for more.
118
119
120
Datomic Update: Client API, Unlimited Peers, Enterprise Edition, and More
The free database designed for immutable values and a time-aware information model.