Basic math related to computation and memory usage for transformers
We present basic math related to computation and memory usage for transformers
The latest blog posts to take off on Hacker News. 460 posts.
We present basic math related to computation and memory usage for transformers
Posted by Matthew Streeter, Software Engineer, Google Research Derivatives play a central role in optimization and machine learning. By locally app...
Let's review the most important math topics used by game devs, reflect about math education, and discuss techniques that can be used to improve the way we learn new math topics.
What is PageRank algorithm? How can it be used in various graph database use cases? How to use it in Memgraph? If these questions are keeping you up at night, here is a blog post that will finally put your mind at ease.
Note: These pages make extensive use of the latest XHTML and CSS Standards . They ought to look great in any standards-compliant modern browser. Unfortunately, they will probably look horrible in older browsers, like Netscape 4.x and IE 4.x. Moreover, many posts use MathML, which is, currently only supported in…
Posted by Joshua Bloch, Software EngineerI remember vividly Jon Bentley's first Algorithms lecture at CMU, where he asked all of us incoming Ph.D. ...
One of the problems with developing games with large game worlds is that objects start to jitter and teleport around as you move away from the world origin. This post is about how we overcame one challenge in particular and what we did.
In our paper, published today in Nature, we introduce AlphaTensor, the first artificial intelligence (AI) system for discovering novel, efficient, and provably correct algorithms for fundamental tasks such as matrix multiplication. This sheds light on a 50-year-old open question in mathematics about finding the…
The Latest News from Research at Kudelski Security
[Thanks to Jacob Falkovich, Eric Neyman, and my LessWrong reviewer, among others, for their feedback on earlier drafts.] …
AnyLeaf Articles: Quaternions: A practical guide
I put together a list and explained why they are important.
Amazon ICML paper proposes information-theoretic measurement of quantitative causal contribution.
https://thetab.com/uk/2020/05/20/this-is-how-the-nobel-prize-winning-hinge-algorithm-actually-works-157740
You can now use LaTeX style syntax to render math expressions within Markdown inline (using $ delimiters) or in blocks (using $$ delimiters). Writing expressions as blocks To add math…
These algorithms aren't magic – but combined they can save over 90% of storage costs and speed up queries. Here’s how 5 common ones work.
All their wonders in one table
The Kalman Filter. Helping Chickens Cross the Road. David Austin Grand Valley State University I was running some errands recently when I spied the Chicken Robot ambling down the sidewalk, then vee…
Meet Amazon Science’s newest research area.
Most elementary school children probably already know that three apples plus two apples add up to five apples. However, what happens in the brain during such calculations is still largely unknown. The current study by the Universities of Bonn and Tübingen now sheds light on this issue.
Note : I keep getting questions that cause me to realize I should explain something else, or that I explained something poorly. Click here for a list of recent changes. Last modified 2015 Mar 05 16:00 UTC. Here's the original story about this object .
Another code golfing adventure.
Columbia professor Johan de Jong has spent the last 15 years gathering the foundational theorems of algebraic geometry in one place. His creation, the Stacks Project, offers a new model for organizing and visualizing mathematical information.
Our office chair, the air we breathe, the stars in the night sky: they are all made of atoms, which in turn are composed of electrons, protons and neutrons. Electrons are negatively charged; according to current knowledge, they have no expansion, but are point-like. The positively charged protons are different …
We built a neural theorem prover for Lean that learned to solve a variety of challenging high-school olympiad problems, including problems from the AMC12 and AIME competitions, as well as two problems adapted from the IMO.
You have heard your grandmother tell you many times: parallel programming is hard. In 2022, does it still have to be? Back in grandma’s heyday, they knew a cool and breezy way to do paralleli…
Materials from our SIGGRAPH '20 paper.