Energy News
CHIP TECH
AI chip crunch: startups vie for Nvidia's vital component
AI chip crunch: startups vie for Nvidia's vital component
By Alex PIGMAN with Julie JAMMOT in San Francisco
Washington (AFP) Sept 28, 2023

The artificial intelligence revolution is fully underway, but soaring demand for its most crucial component has startups scratching their heads on how they can deliver on AI's promise.

Generative AI's lifeblood is a book-sized semiconductor known as the graphics processing unit (GPU) -- built by one company, Nvidia.

Nvidia's CEO and founder Jensen Huang made a wild bet years ago that the world would soon clamor for a powerful chip usually used for making video games, but that could build AI as well.

No company working with the generative AI models that fuel today's frenzy can get off the ground without Nvidia's singular product: the latest model is the H100 and its accompanying software.

That painful reality is one that Amazon, Intel, AMD and others are scrambling to fix with their own alternatives, but those attempts could take years.

- 'Not a lot of GPUs' -

And with the biggest tech companies throwing all their financial might into generative AI, the smaller fish must go on the hunt to secure Nvidia's holy grail.

"Around the world, it is becoming very hard to get thousands of GPUs because all these big companies are putting in billions of dollars, stockpiling GPUs," said Fangbo Tao, co-founder of Mindverse.AI, a Singapore-based startup.

"There's not a lot of GPUs around," he said.

Tao spoke to AFP at the TechCrunch Disrupt conference in San Francisco, where AI startups jostled to make their pitches to Silicon Valley's venture capitalists (VC).

ChatGPT took the world by storm just as Silicon Valley was caught in a nasty hangover from the pandemic when investors threw money at startups, convinced that life had gone irreversibly online.

That turned out to be far-fetched, and the US tech scene entered a downturn with rounds of layoffs and VC money dried up.

Thanks to AI, some of the old mojo is back, and anyone with those two letters on their resume will likely see a red carpet rolled out on the legendary Sand Hill Road, home to Silicon Valley's most storied investors.

But as the startups walk away with their VC cash, the money in their pockets will be quickly forked out to Nvidia for GPUs either directly or through providers to bring their AI dreams to execution.

"We call on a lot of the big cloud providers (Microsoft, AWS and Google) ), and they all tell us even they are having trouble getting supplies," said Laurent Daudet, CEO of AI startup LightOn.

The problem is most acute for companies involved in training generative AI models, which requires that power hungry GPUs work at peak capacity to process troves of data ingested from the internet.

The computing needs are so massive that only a few companies can stump up the cash to build one of these state-of-the-art large language models.

- 'Sucking the oxygen' -

The ten billion dollars investment by Microsoft into OpenAI is widely understood to be paid out as credits to access purpose-built data centers humming with Nvidia GPUs.

Google has built its own models and now Amazon on Monday said it was pumping four billion dollars into Anthropic AI, another company that trains AI.

Training on that mountain of data "is sucking out almost all the oxygen from the GPU market right now," said Said Ouissal, CEO of Zededa, a company that works on making AI less power hungry.

"You're looking at mid-next year, maybe late next year before you're actually going to get delivery on new orders. The shortage doesn't seem to be letting up," added Wes Cummins, CEO Applied Digital, a company that supplies AI infrastructure.

Companies on the AI frontlines also point out that Nvidia's primordial role makes it the de-facto kingmaker on where the technology is going.

The market is "almost entirely driven by the big players -- Googles, Amazons, Metas" that have the "enormous amounts of data and enormous amounts of capital," former Nvidia engineer Jacopo Pantaleoni told The Information.

"This was not the world I wanted to help build," he said.

Some veterans of Silicon Valley said that the frenzied days of Nvidia GPUs will not last forever and that other options will inevitably emerge.

Or the cost of entry will prove too high, even for the giants, bringing the current boom down to earth.

Related Links
Computer Chip Architecture, Technology and Manufacture
Nano Technology News From SpaceMart.com

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
CHIP TECH
System combines light and electrons to unlock faster, greener computing
Boston MA (SPX) Sep 26, 2023
Computing is at an inflection point. Moore's Law, which predicts that the number of transistors on an electronic chip will double each year, is slowing down due to the physical limits of fitting more transistors on affordable microchips. These increases in computer power are slowing down as the demand grows for high-performance computers that can support increasingly complex artificial intelligence models. This inconvenience has led engineers to explore new methods for expanding the computational capabi ... read more

CHIP TECH
Vietnam confirms arrest of energy think tank chief

Eurozone firms fret over stricter climate standards: survey

Decarbonising shipping to cost over $100 bn per year: UN

Macron promises heat pump boost in French climate plan

CHIP TECH
France taps nuclear know-how to recycle electric car batteries

New approach may help extract more heat from geothermal reservoirs

Warming up! 30 years of fusion-energy research at EPFL

Golden future for thermoelectrics

CHIP TECH
Harvesting wind energy in small countries with low wind speed and limited

How wind turbines react to turbulence

Work starts on key German wind power energy line

No offshore wind in latest UK green energy auction

CHIP TECH
Toward high-efficiency thin crystalline silicon solar cells

Flexible solar cell achieves major power conversion efficiency gains

Solar panels go into service near North Pole

The tricky path to tripling renewable energy capacity

CHIP TECH
China fosters new-generation nuclear power reactors

Framatome awarded DoE contract to advance Digital Twin-based Diagnostics

Poland signs deal with Westinghouse for first nuclear power plant

Toshiba says $14 bn offer to go private set to succeed

CHIP TECH
Aston University research pioneers making renewable hydrogen and propane fuel gases from glycerol

Making aviation fuel from biomass

Chevron, partners develop a transportation fuel using animal waste as a feedstock

Illinois research leading to cleaner propane production method

CHIP TECH
Quake-hit locals relieved Europe's biggest gas plant to close

Netherlands halts extraction from Europe's biggest gas field

IEA, ECB urge Europe to move faster on energy transition

DLR acquires flying hydrogen laboratory and demonstrates whole-system solutions

CHIP TECH
Drought drains Brazilian Amazon residents reliant on waterways

Youth bring climate case to Europe rights court

Charles wraps up France trip with cheering crowds in Bordeaux

King Charles's France trip closing with climate focus

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.