Qualcomm, Microsoft Align Efforts to Scale On-Device AI at Build
May 26, 2023 | Qualcomm Technologies, Inc.Estimated reading time: 1 minute
During Microsoft Build 2023, Qualcomm Technologies, Inc. displayed its latest innovations in on-device AI, including showing generative AI running on Snapdragon® compute platforms, as well as new pathways for developers building applications for Windows 11 PCs powered by Snapdragon.
"For generative AI to become truly mainstream, much of the inferencing will need to be executed on edge devices," said Ziad Asghar, senior vice president of product management, Qualcomm Technologies, Inc. "Our best-in-class AI hardware and software empowers developers to make full use of our powerful AI capabilities, delivering incredible new user experiences on laptops, phones and other devices powered by Snapdragon."
The future of AI needs to include both on-device and cloud AI. Running AI applications on device improves cost effectiveness, privacy, personalization, and latency. Snapdragon platforms include a dedicated Qualcomm® AI Engine to process AI workloads more efficiently than when processed purely on CPU or GPU, making on-device AI possible even in small, thin, and light devices.
At Microsoft Build, Qualcomm Technologies will show demos and offer tools to help develop generative AI on the next generation of Windows 11 PCs. Stable Diffusion, a text-to-image generative AI model with more than 1 billion parameters, now runs entirely on the device, and the Company says it sees a clear path to running models with up to 10 billion parameters on devices in the coming months, including large language models (LLMs). To enhance the Qualcomm® AI Stack and help developers create the next generation of on-device AI experiences, the Qualcomm AI Engine Direct SDK will be made available to the public for the first time at Build. With the ONNX Runtime and Qualcomm AI Stack, you can run your AI workloads today on the Snapdragon 8cx Gen 3 AI Engine on both the Surface Pro 9 5G and Lenovo ThinkPad x13s.
“Both cloud and device processing are needed to extend AI across the vast universe of devices and applications,” said Pavan Davuluri, Corporate VP, Windows Silicon and System Integration at Microsoft. “By bringing together Microsoft’s cloud AI leadership and the capabilities of the Windows platform with Qualcomm Technologies’ on-device AI expertise, we will accelerate the opportunities for generative AI experiences.”
Qualcomm Technologies will also show at Build the dramatic performance improvements available when popular applications are compiled natively for Snapdragon, as well as debut a new developer portal which collects critical tools, resources and support for Windows on Snapdragon development in one easy-to-use location.
Suggested Items
TTM Celebrates the Grand Opening of Its First Manufacturing Facility in Penang
04/25/2024 | TTM Technologies, Inc.TTM Technologies, Inc., a leading global manufacturer of technology solutions including mission systems, radio frequency (RF) components and RF microwave/microelectronic assemblies, and quick-turn and technologically advanced printed circuit boards (PCBs), officially opened its first manufacturing plant in Penang, Malaysia with an investment of USD200 million (approximately RM958 million).
Saab Launches New Initiative to Shape the Future of Defense and Security
04/24/2024 | SaabSaab announces the launch of Skapa by Saab, a new initiative to accelerate the development and deployment of cutting-edge technologies and solutions.
IDTechEx Report Unveils 3D Electronics Status and Opportunities
04/22/2024 | PRNewswire3D electronics is an emerging manufacturing approach that enables electronics to be integrated within or onto the surface of objects. 3D electronic manufacturing techniques empower new features, including mass customizability, greater integration, and improved sustainability in the electronics industry.
Microsoft, Google Join as Sponsors for First-Ever AI Expo for National Competitiveness
04/19/2024 | SCSPThe Special Competitive Studies Project (SCSP), a non-partisan, non-profit project dedicated to strengthening America’s long-term competitiveness in artificial intelligence (AI), announced today two additional sponsors of the AI Expo for National Competitiveness.
Scape Technologies Introduces SCAPE CoCreator at Hannover Messe 2024
04/18/2024 | Scape TechnologiesToday's industrial robotics, 3D Vision, and AI are often confined by costs, complexity, and limited accessibility and usability. Scape Technologies is revolutionizing this field by broadening the horizons of what is possible.