Are polynomial features the root of all evil? (2024)
High-degree polynomial features aren’t inherently unstable: the power basis and unscaled inputs are. This post shows how regularization and Bernstein polynomials make polynomial regression behave.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 6,326 posts.
High-degree polynomial features aren’t inherently unstable: the power basis and unscaled inputs are. This post shows how regularization and Bernstein polynomials make polynomial regression behave.
Posted by Haşim Sak, Andrew Senior, Kanishka Rao, Françoise Beaufays and Johan Schalkwyk – Google Speech TeamBack in 2012, we announced that Google...
Update: An updated version of this blogpost was published as a (peer-reviewed) Letter to the Editor at Bioinformatics, sans the “sociology” commentary. I just came back from CASP13, the…
Dash knows your context, your team, and your work, so your team can stay organized, easily find and share knowledge, and keep projects secure, all from one place.
Neural networks have shown great success in everything from playing Go and Atari games to image recognition and language translation. But often overlooked is that the success of a neural network at a particular application is often determined by a series of choices made at the start of the research, including what…
Project website for WonderWorld
The AI boom is more likely a marker of the end of the 50-year digital boom than the start of a new wave of innovation.
In 1970, Marvin Minsky, recipient of the Turing Award (“the Nobel Prize of Computing”), predicted that within “three to eight years we will have a machine with the general intelligence of an average human being.”
Google I/O 2023 makes AI ubiquitous across products. What SGE and generative search mean for SEOs and content marketers.
This research demonstrates a model-free approach to optimize the energy produced by a dual-axis solar panel using reinforcement learning. Specifically, a softmax actor-critic agent optimizes energy production in a simulated, dynamic lighting environment which is generated from real power data. All s
こんにちは(Konnichiwa) and hello, Japan! We're thrilled to announce that Waymo, in partnership with Nihon Kotsu and GO, will bring our autonomous vehicles to Tokyo for our first international road trip. There, our Driver will learn and adapt to left-hand traffic and new driving nuances associated with operating in one of…
How far are the o1 preview and mini models from AGI?
These LLMs are shockingly good at deobfuscation, transpilation and structure to structure conversions. I discovered this back around Christmas where I asked an LLM to make me an Haskell audio library by transpiling a rust implementation. An “oh fuck” moment in timeOver the Christmas break I’ve been critically looking
For Claude to learn from experience, it has to decide what’s worth remembering before it knows what’s next. Here’s how “dreaming” helps it organize memory and correct mistakes.
ERNIE 5.5 Flash Base: a 280B-A14B hybrid-attention MoE pretrained on 33.5T tokens. An open, efficient pretraining base.
How I used AI to investigate millions of historical records and surfaced a forgotten meteorite report, three lost rhinos, and unrecorded volcano eruptions.
Bard gets its most capable model yet, along with new and expanded features.
On November 6, 2023, OpenAI announced Custom GPTs. Since then, over 3 million GPTs have been created, with over 200.000 of them made publicly available.
A short story on how my website lost all indexed pages in Bing, affecting my presence in DuckDuckGo, secret blacklisting and classification as a splog by Bing AI
In the world of AI agents, the ability to understand and analyze structured data is a game-changer. While large language models excel at understanding natural...
The University of Surrey unveils NitroFusion, an open-source AI model for near-instant image generation on a single consumer-grade GPU.
Apple started using deep learning for face detection in iOS 10. With the release of the Vision framework, developers can now use this…
Our lab investigated whether frontier models can write optimized GPU kernels for Apple devices to speed up inference. We found that they can: our AI-generated Metal kernels were 1.24x faster across KernelBench v0.1 problems, and 1.87x faster across KernelBench v0 problems.
For Data Scientists: Machine Learning vs Deep Learning discussion, Deep Learning vs Machine Learning, and what is difference between machine learning, pattern recognition, computer vision, robotics, and artificial intelligence.
So, my latest post went viral. And with virality, you get a ton of comments that you must reply to. I don't want to reply in HN/Reddit/Whatever to prev...
The NVIDIA Inception startup projects that space-based data centers will offer 10x lower energy costs and reduce the need for energy consumption on Earth.
[This is a guest post by Karthik C. S., Amit Sahai, and Jie Xue. This blog post was initially written in a different file format and converted using AI. — T.] This is a good time for mathemat…
I’ve been surprised by - and enjoy - one aspect of using large language models more than any other. They often put into words things I have long understood, but could not write down clearly. When that happens, it feels less like learning something new and more like recognition. A kind of “ok, yeah" moment.…