Deep Learning from Scratch to GPU: CUDA and OpenCL
We generalize the network code and run it on the GPU. On an Nvidia GPU with CUDA, and on an AMD GPU with OpenCL. Even more - we mix both CUDA and OpenCL, jus...
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 49,289 posts.
We generalize the network code and run it on the GPU. On an Nvidia GPU with CUDA, and on an AMD GPU with OpenCL. Even more - we mix both CUDA and OpenCL, jus...
In this post, I’ll explain how I compiled an OCaml program to run on a TI-84+ CE calculator. 🐪
Mathematical research traditionally involves a small number of professional mathematicians working closely on difficult problems. However, I have long believed that there is a complementary way to …
Below is the first draft list of papers I plan to discuss in my distributed systems seminar in the Spring semester. If you have some suggest...
Sparse Autoencoders (SAEs) have recently become popular for interpretability of machine learning models (although sparse dictionary learning has been around since 1997). Machine learning models and LLMs are becoming more powerful and useful, but they are still black boxes, and we don’t understand how they do the…
Parallel sequential scan is the first parallel access method in PostgreSQL and is introduced in version 9.6. The committer of this featu...
[The Python version described in this article is 3.x, more specifically - the 3.3 alpha release of CPython.]
Personal preference is an interesting thing. People can have a particular preference for something until they are able to experience something else. As we gain experience, our personal preference gets more finely tuned.
Some speculative hypotheses
Famous Birthdays has been described as a “ Wikipedia for Gen-Z ”. It’s an insight into popularity across the internet of influencers, not just from traditional stage and screen but also social media channels such as TikTok and Instagram.
You're probably reading this page because you've attempted to access some part of my blog (Wandering Thoughts) or CSpace , the wiki thing it's part of. Unfortunately you're using a browser version that my anti-crawler precautions consider suspicious, most often because it's too old (most often this applies to versions…
Buying a new monitor is stressful because there's so many things to understand. After reading this article, you will know what to look for.
Create beautiful emails, automate campaigns, and track performance. Try it now and see how our tools can drive your business.
Combining standard stories of biologists, astronomers, physicists, and social scientists would lead us to expect a much smaller filter than we observe. Thus one of these stories must be wrong. To find out who is wrong, and to inform our choices, we should study and reconsider all these areas. For example, we should…
AI is now able to decompile games and software in a matter of days. That's scary... but kind of exciting.
Executives love AI while ICs stay skeptical. The divide comes down to non-determinism: who is evaluated on judgment versus deterministic execution.
I have just recently discovered that my previous post about Commodore BASIC went modestly viral, not only featuring on Hacknernews but getting its own story on Hackaday . Gosh. This in itself has provoked some discussion. Its also resulted in a lot of people telling me that NO COMMODORE WAS…
The Linux kernel has a feature where you can tune the behavior of memory allocations: the vm.overcommit_memory sysctl. When overcommit is enabled (sadly, this is the default), the kernel will typically return a mapping when brk(2) or mmap(2) is called to increase a program’s heap size, regardless of whether or not…
“The emotionally intelligent person knows that they will only ever be mentally healthy in a few areas and at certain moments, but is committed to fathoming their inadequacies and warning othe…
Around half of all software engineers are self-taught, One way to approximate this number is via the Stack Overflow developer survey . Another rough approximation comes from the fact that over the last decade, typically only 40-60K students graduated each year with a CS major from a US university, whereas the total…
The new age of social-enabled apps