Nvidia sold half a million H100 AI GPUs in Q3 thanks to Meta, Facebook — lead times stretch up to 52 weeks
Having earned $14.5 billion on datacenter hardware in the third quarter of fiscal 2024, Nvidia clearly sold a boatload of its H100 GPUs...
top of page
Search
shaukat shamim
Sep 1516 min
On AI, the GPU Shortage, and the Potential of Decentralised Inference and Training Networks
Training large language models requires powerful GPU microchips, particularly A100s and H100s produced by Nvidia. Due to various supply...
5 views0 comments
shaukat shamim
Sep 158 min
How To Make More Money Renting A GPU Than Nvidia Makes Selling It
It is not a coincidence that the companies that got the most “Hopper” H100 allocations from Nvidia in 2023 were also the hyperscalers and...
1 view0 comments
shaukat shamim
Sep 49 min
A guide to building a Retrieval Augmented Generation (RAG) application from scratch
Retrieval Augmented Generation, or RAG, is all the rage these days because it introduces some serious capabilities to large language...
5 views0 comments
shaukat shamim
Sep 23 min
Unleashing the Future with Serverless AI: A Game-Changer for Open-Source AI Development
In a world driven by relentless innovation and cutting-edge technology, the convergence of serverless architecture and artificial...
2 views0 comments
shaukat shamim
Sep 15 min
The Moat for Enterprise AI is RAG + Fine Tuning – Here’s Why
The hype around LLMs is unprecedented, but it’s warranted. From AI-generated images of the Pope in head-to-toe Balenciaga to customer...
4 views0 comments
shaukat shamim
Sep 13 min
Unraveling AI Training Costs: The Hidden Factors
Artificial Intelligence (AI) training costs have always been a topic shrouded in mystery. When diving into the world of AI development,...
3 views0 comments
shaukat shamim
Aug 251 min
Why DePIN Is Taking Off Now
DePIN has existed for a few market cycles, with early successes in digital infrastructure networks like Helium and Golem. Now, half a...
4 views0 comments
shaukat shamim
Aug 251 min
Trends in the Dollar Training Cost of Machine Learning Systems
Using a dataset of 124 machine learning (ML) systems published between 2009 and 2022, 1 I estimate that the cost of compute in US...
1 view0 comments
shaukat shamim
Aug 251 min
How Much Does It Cost to Train Frontier AI Models?
The costs of training frontier AI models have grown dramatically in recent years, but there is limited public data on the magnitude and...
13 views0 comments
bottom of page