Breaking News
Shortages And Rationing Loom As Global Oil Reserves Fall At Fastest Rate In History
DEMS KNEW ABOUT MACHINES YEARS AGO! Selection Code Cip
Immigrant Hordes Set Paris Ablaze Because Their Soccer Team Won
Is A New Iron Curtain Inevitable?
Top Tech News
Elon and SpaceX Have Made AI Training 10 Times Faster
Oklo COO Says Nuclear Waste Could Power America For 150 Years
SpaceX Announces LARGEST Starship Mission Ever! They've never done this before!
Cars Are Fast Becoming Dystopian Prison Pods...
Our Emergency Water Plan Wasn't Good Enough - So We Built This
Sodium Ion Batteries Can Reach 100 Gigawatt Per Hour Per Year Scale in 2027
Juiced Bikes proves capable electric motorcycles don't have to cost a lot
Headlight projectors turn your car into a drive-in theater
US To Develop Small Modular Nuclear Reactors For Commercial Shipping
New York Mandates Kill Switch and Surveillance Software in Your 3D Printer ...
Tesla Dojo, Supercomputers and AI
There does not seem to be a limit for neural nets to utilize more resources to get better and faster results.
Tesla is motivated to develop bigger, faster computers that are precisely suited to their needs.
The Google TPU architecture has not evolved as much over the last 5 years. The Google TPU chip is designed for the problems that Google runs. They are not optimized for training AI.
Tesla has rethought the problem of AI training and designed the Dojo AI supercomputer to optimally solve their problems.
If Tesla commercializes the AI supercomputer that will help to get to lower costs and greater power with more economies of scale.
One of the reasons that TSMC overtook Intel was that TSMC was making most of the ARM chips for cellphones. TSMC having more volume let them learn faster and drive down costs and accelerate technology.
99% of what neural network nodes do are 8 by 8 matrix multiply and 1% that is more like a general computer. Tesla created a superscalar GPU to optimize for this compute load.