Kneron launches new Edge AI chip at COMPUTEX 2024

The KNEO 330, Kneron’s latest and second private Edge GPT server, follows its first unit, the KNEO 300, launched in 2023. The KNEO 300 already has enterprise customers in manufacturing, financial services, and universities, including Stanford and UCLA. The KNEO 330 offers 48 TOPs of AI computing power, up to eight concurrent connections, and supports LLMs and stable diffusion. Its RAG accuracy is comparable to Cloud solutions under much lower hardware conditions. The KNEO 330 reduced the overall cost of AI for small enterprises by 30%-40%.

Compared to most Cloud solutions, the KNEO 330 enables easier integration and hierarchical permission management, significantly improving privacy and security. Its comprehensive capabilities include offline versions of multimodal GPT.

“AI has seen a recent boom and powerful AI models are advancing more rapidly than many experts thought possible. Balancing ethical AI with profit-driven AI is a real challenge. Concerns such as the required power and data for training the AI models and the potential for AI hallucinations are real problems. We believe our products are key to solving the current GPT ESG & power consumption issues,” says Albert Liu, CEO and Founder of Kneron.

In addition to the KNEO 330, Kneron released its AI-embedded PC featuring its 3rd generation NPU chip, the KL830. The AI PC era is here, with sales set to grow from 50 million units in 2024 to over 167 million by 2027, accounting for over 60% of the overall PC market, according to an IDC report. Meanwhile, Gartner predicted the global shipments of AI PCs and AI smartphones would reach 295 million units in 2024, more than ten times the figure of 29 million for 2023.

The power and cost of the KL830 allows for a lower-cost AI PC that will enable major accessibility and adoption from a broader market of consumers. The KL830 provides consolidated calculation power (CCP) up to 10eTOPS@8bit with a peak power consumption of 2W. The NPU makes personalised GPT possible.

Demonstrating the power and efficiency of the NPU, when combined with a leading GPU, it saved 30% on energy use and extended product lifetime. This showcases its future in high-powered but accessible gaming PCs.

This chip is ready to be used in AIoT devices. The KL830 chip allows the fixed point to remain consistent with floating point accuracy. The KL830 is also available via a USB dongle that enables any device, whether a broadband router, IoT camera, or classic PC, to become Edge AI-enabled. It provided 10eTOPS@8bit and supports many large language models with lower parameters.

Designed for developers, the KNEO platform is an easy-to-use open marketplace for Edge GPTs. Kneron enables user-friendly AI-generated content model deployment through Kneron’s compiler with a ‘Hugging Face’ link. Users can switch Edge GPTs as required.

Comprised of the developer platform, management platform, and Edge GPT warehouse, Kneron’s Edge GPT as a Service (EGaaS) enables devices to process data locally, allowing real-time decision-making without relying on the Internet or Cloud servers. This approach boosts speed, supports multi-modal capability, and enhances privacy and security. Kneron’s comprehensive enterprise-Edge GPT solutions can be customised to meet each enterprise's needs by training and deploying large language models (LLMs) for various scenarios.

During its keynote at the Computex event in Taipei, Kneron will highlight:

• The KNEO 330, its latest and second private Edge GPT server, delivers a 30-40% cost reduction for small enterprises while prioritising privacy and security
• The KL830, its Edge GPT AI chip, which is fully operational in AI PCs, a USB dongle, and in the Edge server, and its NPU can decrease energy consumption by 30% when paired with a leading GPU
• Additionally, Kneron will discuss its 4th generation of NPU, which can be used in both Edge and cloud AI applications, the KL1140, will be launched in 2025

Kneron raised nearly $200million from Horizons Ventures, Qualcomm, Sequoia, Foxconn, Delta, Vivotek, and more. Kneron provides end-to-end integrated hardware and software solutions that enable on-device Edge AI inferencing. Qualcomm, Toyota, Kenwood, Garmin, Panasonic, Quanta, Compal, Unimicro, MiTAC, Hanwha, Spark, Naver, TUL, and Gree adopted Kneron solutions.