Edge AI: the wait is (almost) over

Leo Charlton, Technology Analyst at IDTechEx, further discusses.

The Edge of the network, where users have immediate interaction with devices that do not necessarily rely on the Cloud for computation, has been touted as something of the promised land for AI, where inclusion of accurate and somewhat autonomous AI – where devices are linked via Wi-Fi connectivity – would enable a true Internet of Things. This has been the expectation for the best part of the decade, with the great Edge AI takeover still forthcoming. Instead, AI has slowly trickled into certain household devices and consumer electronics goods, with other applications yet to realise the full impact that AI has promised.

In a recently released IDTechEx report, AI Chips for Edge Applications 2024-2034: Artificial Intelligence at the Edge, IDTechEx notes that the production rollout of technology being developed by a number of AI chip startups targeting Edge applications will see AI at the edge continue to grow substantially over the next ten years…albeit not with the type of exponential growth that a ‘boom’ would suggest.

Revenue growth of AI chips used for edge applications does not progress at a constant rate, due to the competing maturation of certain markets (such as for smartphones) against the adoption of AI in others (such as automotive). Source: IDTechEx

The reasons behind the unconventional growth are multiple, but they boil down to falling under two categories: the first being the saturation and stop-start nature of certain markets that have already employed AI architectures in their incumbent chipsets, and the second being where rigorous testing is necessary prior to high volume rollout of AI hardware. Under the first category, a key example is the smartphone market, which has already begun to saturate. However, premiumisation of smartphones continues (where the percentage share of total smartphones sold given over to premium smartphones is, year-on-year, increasing), where AI revenue increases as more premium smartphones are sold given that these smartphones incorporate AI coprocessing in their chipsets, it is expected that this will itself begin to saturate over the next ten years.

Under the second category, flagship automotive-grade System-on-Chips (SoCs) for Advanced Driver-Assistance Systems (ADAS) from the likes of Renesas, Qualcomm, and Mobileye are all planned to hit automotive manufacturers’ 2024/25 production lines. These systems allow for a minimum driving automation level (officially known as SAE level) 3, allowing for situational automation where driver input is not necessary in certain situations. Further scaling of technology after rigorous testing will allow for further checkpoints in driving automation to be reached, with the adoption of increasing automation to occur in stages.

The SAE levels of driving automation. Source: IDTechEx

Only a matter of time now

Though the types of models that are employed at the Edge will be, in the main, much simpler than those handled within data centres, due to the power constraints of Edge devices, it is only a matter of time before even the simplest of AI functions – such as hands-free activation and actioning – comes as an added feature to a range of devices, particularly within the home. IDTechEx have identified the smart home as one of the main beneficiaries of AI technology, with the potential to transform how we live and interact with our immediate surroundings.

IDTechEx report coverage

IDTechEx forecasts that the global AI chips market for Edge devices will grow to $22.0 billion by 2034. IDTechEx’s report gives analysis pertaining to the key drivers for revenue growth in Edge AI chips over the forecast period, with deployment within the key industry verticals – consumer electronics, industrial automation, and automotive – reviewed. More generally, the report covers the global AI chips market across eight industry verticals, with 10-year granular forecasts in six different categories (such as by geography, by chip architecture, and by application).

IDTechEx’s brand new report, AI Chips for Edge Applications 2024-2034: Artificial Intelligence at the Edge, answers the major questions, challenges and opportunities faced by the Edge AI chip value chain. The report offers an understanding of the markets, players, technologies, opportunities, and challenges.