MediaTek Dimensity 9300 with On-device Generative AI
In a significant stride towards enhancing user experience and data privacy, leading chip manufacturers MediaTek and Qualcomm have both announced plans to integrate on-device generative AI capabilities into their flagship smartphones. This development comes as a response to the growing demand for local processing of Generative AI tasks, minimizing reliance on cloud computing and safeguarding user data.
Last month, Qualcomm unveiled its collaboration with Meta’s Llama 2 Large Language Model (LLM) to enable on-device generative AI on their flagship phones, set to debut in 2024. Taking a similar stride, MediaTek has now confirmed its commitment to providing on-device generative AI capabilities. Presently, most Generative AI processing relies on cloud computing, but the use of Llama 2 models by MediaTek opens the door to executing generative AI applications directly on devices.
The advantages of on-device Generative AI are manifold. Developers and users alike stand to benefit from seamless performance, heightened privacy, improved security, lower latency, and the ability to function in low-connectivity environments. Additionally, this approach presents cost savings, reducing the need for extensive cloud infrastructure.
For effective implementation of on-device Generative AI, edge device manufacturers must adopt high-computing, low-power AI processors and establish faster, more reliable connectivity. MediaTek, a prominent player in the semiconductor industry, is actively working to support Llama 2 LLM on phones powered by their upcoming flagship processor, expected to be the Dimensity 9300.
MediaTek’s forthcoming flagship chipset, scheduled to launch later this year, is poised to feature a specially optimized software stack to run Llama 2. The chipset will also incorporate an upgraded AI Processing Unit (APU) equipped with Transformer backbone acceleration. This strategic design aims to improve LLM and AIGC (AI Graphics Computing) performance while optimizing resources such as memory and bandwidth usage.
Anticipating the release of Llama 2-enabled generative AI applications, MediaTek envisions phones powered by their next-generation chipset to be available by the end of 2023. This development aligns with MediaTek’s commitment to delivering cutting-edge technology to users on time.
The collaboration between MediaTek and Meta represents a positive trend in the technology industry, addressing concerns over data privacy and emphasizing the importance of processing AI tasks locally. By reducing the need to send user data to external servers for inference, on-device Generative AI marks a pivotal step toward safeguarding user privacy and data integrity.
As the market anticipates the arrival of MediaTek’s Dimensity 9300 chipset, rumors surrounding its aggressive design have fueled excitement. With the incorporation of Arm’s Cortex-X4 and A720 CPU cores and the Immortalis-G720 GPU, this chipset is expected to debut in the Vivo X100 Series, offering users a compelling blend of processing power and efficiency.
