781
Topics /
Databases & Data
The most popular blog posts about databases & data on Hacker News. 1,888 posts.
782
Getting the Most Out of Sqlite3 with Python
Simplex Sigillum Veri
783
784
785
Maxar's Open Satellite Feed
Benchmarks & Tips for Big Data, Hadoop, AWS, Google Cloud, PostgreSQL, Spark, Python & More...
786
The secret ingredients of word2vec (2016)
Word2vec is a pervasive tool for learning word embeddings. Its success, however, is mostly due to particular architecture choices. Transferring these choices to traditional distributional methods makes them competitive with popular word embedding methods.
787
788
What category theory teaches us about dataframes
Every dataframe library ships with hundreds of operations. pandas alone has over 200 methods on a DataFrame. Is pivot different from melt? Is apply different from map? What about transform, agg, applymap, pipe? Some of these seem like the same operation wearing different hats. Others seem genuinely distinct. Without a…
789
Prolog for data science
I demonstrate a widely applicable pattern which integrates Prolog as a critical component in a data science analysis. Analytic methods are used to generate properties about the data under study and Prolog is used to reason about the data via the generated properties. The post includes some examples of piece-wise…
790
791
You cannot have exactly-once delivery (2015)
I’m often surprised that people continually have fundamental misconceptions about how distributed systems behave. I myself shared many of these misconceptions, so I try not to demean or dismiss but rather educate and enlighten, hopefully while sounding less preachy than that just did. I continue to learn only by…
792
The Most Gender-Switched Names in the U.S.
We use some names mostly for boys and some mostly for girls, but then there is a small percentage that, over time, switched from one gender to another. Which names made the biggest switch?
793
The Universal Data Structure
Whether you write compilers, web services or Django admin panels, you probably use hash maps more than all other data structures combined. In fact, you may not remember the last time you used anything else. This is not a coincidence: any conceivable data structure can be implemented with a hash map; therefore, there…
794
Timestamps and Time Zones in PostgreSQL (2016)
The nuance between timestamp with and without time zone
795
One Year as a Data Scientist at Stack Overflow
One day in January 2013 I found myself wasting time on the internet.
796
Playing with 80M Amazon Product Review Ratings Using Apache Spark
Manipulating actually-big-data is just as easy as performing an analysis on a dataset with only a few records.
797
Using python and k-means to find dominant colors in images
I'm working on a little photography website for my Dad and thought it would be neat to extract color information from photographs. I tried a couple of different approaches before finding one that works pretty well. This approach uses k-means clustering to cluster the pixels in groups based on their color. The center…
798
799
Reasons to love SQLAlchemy
I've seen some bashing of ORMs of late, which I think is totally undeserved. I'm a big fan of SQLAlchemy ; I use it in most of my projects, and have contributed code to the library. I'm going to explain 10 good reasons you should love SQLAlchemy too! In fairness, there are a number of good ORMs around, and most of…
800
Copy-on-write B-tree finally beaten.
Copy-on-write B-tree finally beaten by Andy Twigg, Andrew Byde, Grzegorz Mi?o´s, Tim Moreton, John Wilkesy and Tom Wilkie.
801
The 600+ Companies PayPal Shares Your Data With
One of the effects of GDPR—the new EU General Data Protection Regulation—is that we’re all going to be learning a lot more about who collects our data and what they do with it. Consider PayPal, that just released a list of over 600 companies they share customer data with. Here’s a good visualization of that data. Is…
802
A Critique of SQL, 40 Years Later
Homepage of Carlin Eng
803
13% of my website visitors block Google Analytics
There’s widespread use of adblockers on the web but users are increasingly blocking cookies and other tracking scripts too. Browsers such as Safari, Firefox and Brave are privacy-focused.
804
The many faces of DISTINCT in Postgres (2017)
3 interesting uses of DISTINCT in PostgreSQL
805
PostgreSQL Encryption: The Available Options
On an episode of Postgres FM , the hosts had a (very brief) discussion of data encryption in PostgreSQL. While Postgres FM is a podcast well worth a subscribe, the hosts aren’t data security experts, and so as someone who builds a queryable database encryption system , I found the coverage to be somewhat… lacking. I…
806
A Primer on Database Replication (2017)
A Primer on Database Replication
807
No general method to detect fraud
The parts of a convincing deception
808
Your File System Is Already A Graph Database
Karpathy recently posted about using LLMs to build personal knowledge bases — collecting raw sources into a directory, having an LLM “compile” them into a wiki of interlinked markdown …
809
In-memory key-value store in C, Go and Python
"Coder's paternity leave turns into polyglot key-value store adventure"
810
Breakdown of data on homeless populations across the U.S.
Many people see a homelessness crisis, but what does the data say? We examine different locations, rates of change, types of homelessness, and mental health and substance abuse issues.