Skip to content

csvbase Blog company blog

You can't just assume UTF-8

by Cal Paterson csvbase.com published 2024-04-297 min read

How to infer character encodings with statistics

Read on csvbase.com → Discuss on HN (471) Archived copy

Points: 195
HN comments: 471
Submissions: 1
Cited by: 0 commenters

Software Engineering Databases & Data 2024

On Hacker News

Submitted	Title on HN	Points	Comments
Apr 29, 2024	You can't just assume UTF-8 by calpaterson	195	471

More from csvbase Blog

All 8 posts →

My favourite API is a zipfile on the European Central Bank's website

20231,024 points265 comments Databases & Data details

The semantic web is now widely adopted

2024455 points259 comments Web & Frontend details

Parquet: An efficient, binary file format for table data

2023283 points186 comments Databases & Data details

How does it know I want CSV? – An HTTP trick

2023220 points103 comments Web & Frontend details

Client libraries are better when they have no API?

2024159 points100 comments Software Engineering details

Caching secrets of the HTTP elders, part 1

2024142 points35 comments Web & Frontend details

Related posts from the same era

Reverse engineering Ticketmaster's rotating barcodes

conduition20242,305 points714 comments details

Uv is the best thing to happen to the Python ecosystem in a decade

Dr. Emily L. Hunt20252,214 points1,324 comments details

Anthropic acquires Bun

Bun Blog20252,192 points1,072 commentscited by 7 details

Anyone can access deleted and private repository data on GitHub

Truffle Security Blog20241,983 points374 commentscited by 8 details

ChatGPT Plugins

OpenAI Blog20231,875 points1,106 commentscited by 14 details

A 10x Faster TypeScript

Microsoft Developer Blogs20251,827 points907 commentscited by 14 details