Aman Madaan

madaan.github.io

I did my PhD at LTI , CMU with Yiming Yang , on feedback-driven generation and inference-time compute ( thesis slides ). Before that I was a Principal Member of Technical Staff at Oracle, working with Jagdish Chand , and did my Master's at IIT Bombay with Sunita Sarawagi , Mausam , and Ganesh Ramakrishnan .

Popular posts: 1
Total points: 117
HN comments: 18
Rank: #19,187 personal

Visit madaan.github.io → RSS feedOn Hacker News May 2019 – May 2019

Math & Algorithms 1 AI & Machine Learning 1

Most points Most discussed Most cited Newest

Notes on Weight Initialization for Deep Neural Networks

2019117 points18 comments AI & Machine Learning details

Neural networks involve long sequence of multiplications, usually between a matrix and a vector, say \(a*x\). The result of this sequence of multiplications will either have a huge magnitude or be reduced to 0. We can divide \(a\) by a number ( scaling_factor ) to scale down its magnitude to the right level. Proper…