Breaking News
Peter Schiff: This Is a Sequel to 2008 and Like All Sequels It Will Be Worse Than the Original
The Fake 'Food as Medicine' Agenda
The Best Way to Protect US Troops in Syria by Ron Paul
How to Create a Food Forest in Your Backyard
Top Tech News
Masterplan Part 3 is Teslabot
Musk expects Tesla Bot to be a much bigger business than its cars
Autoflight breaks Joby's world record for the longest eVTOL flight
How does Starlink Satellite Internet Work?
SpaceX Starlink Version 2 Mini Will Have 4X Version 1.5 Capacity
Blue Origin Making Solar Cells from Lunar Regolith
Preparing to keep people alive on medical equipment when SHTF hits. Try to solve this problem.
Phones using VOIP Only - Understanding Limitations + Q&A
Water Pump with Brown Gas
The Energy Machine of Joseph Newman
Tesla Dojo, Supercomputers and AI
There does not seem to be a limit for neural nets to utilize more resources to get better and faster results.
Tesla is motivated to develop bigger, faster computers that are precisely suited to their needs.
The Google TPU architecture has not evolved as much over the last 5 years. The Google TPU chip is designed for the problems that Google runs. They are not optimized for training AI.
Tesla has rethought the problem of AI training and designed the Dojo AI supercomputer to optimally solve their problems.
If Tesla commercializes the AI supercomputer that will help to get to lower costs and greater power with more economies of scale.
One of the reasons that TSMC overtook Intel was that TSMC was making most of the ARM chips for cellphones. TSMC having more volume let them learn faster and drive down costs and accelerate technology.
99% of what neural network nodes do are 8 by 8 matrix multiply and 1% that is more like a general computer. Tesla created a superscalar GPU to optimize for this compute load.