Send us a text

Discover the cutting-edge world of TinyML and Edge AI with our special guest, Eldar Sido from Renesas. As a key figure in the AI Center of Excellence, Eldar unveils the fascinating challenges and breakthroughs in embedding AI into compact devices like microcontrollers and sensors that are rapidly spreading across the globe. This episode promises an exploration into the dynamic realm of TinyML, focusing on its three foundational pillars: real-time analytics, voice, and vision. Eldar discusses the anticipated double-digit growth of this sector over the next decade, making it a pivotal listen for tech enthusiasts and those curious about the future trajectory of AI technology.

Eldar also shares how Renesas, through its acquisition of Reality AI, is enhancing its prowess in real-time analytics and tackling high-frequency sampling rates. With a focus on consultancy, data selection, and sensor placement, Eldar illustrates how only a sliver of the TinyML process is devoted to model development. By integrating Reality AI with the E-Square Studio IDE, Renesas is streamlining workflows to maximize the potential of TinyML. Tune in to understand how TinyML is reshaping industries and what lies ahead for Edge AI applications. This episode is packed with insights and strategies for anyone looking to leverage the power of TinyML in their projects.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Discover how the fusion of cutting-edge technology and human interaction is revolutionizing education and healthcare with Professor Stella Kuei-An Nguyen from National Yangming Chow Tung University. Join us as we explore her innovative work in Human-AI Interaction using Inertial Measurement Units (IMU), and witness the transition of Raboni IMU devices into the transformative Bony AI. Collaborating with giants like TSMC, MIT, and leading hospitals, Professor Nguyen showcases how these advancements are not only elevating coding education but also offering groundbreaking solutions for medical conditions such as Parkinson’s and dementia. These innovations are powered by tiny machine learning algorithms, seamlessly blending sensors and AI processors into user-friendly interfaces that redefine efficiency in educational and healthcare diagnostics.

Delve into the world of advanced motion monitoring technology as we delve into the integration of Rabonit, IMU, and the YSI2 AI processor, designed to intelligently track movements. This sophisticated system promises to revolutionize the way we assess physical activity, especially for children in intermediate playing stages. With a specially designed app that extracts and analyzes movement curves, this technology offers invaluable insights that could enhance both educational environments and healthcare sectors. Join us for an insightful journey into how these tools are set to make a broader impact, aiming to enrich lives by providing effective and efficient information.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

What do rising pedestrian fatalities and the challenges of implementing intelligent transportation systems have in common? In this episode, we’re joined by Davis Sawyer from NXP and Mike "Witt" Whitaker from the City of Lakewood, Colorado, to unpack the complexities of applying edge AI to enhance urban safety. As Witt recounts his pioneering work with autonomous vehicles since the 1990s, we explore the fast-paced evolution of AI technology and its critical role in addressing real-world problems, such as the increasing need for pedestrian safety and efficient traffic management.

We take a hard look at the perplexing trend of fatal crashes involving impaired drivers despite a drop in overall traffic incidents. The conversation intensifies as we discuss the doubling of pedestrian fatalities, particularly at night, and the significant challenges posed by underreported impairment and the rise of fentanyl use. Our guests share insights into how collaborations with the police department and meticulous data analysis can reveal hidden patterns, driving the development of more effective municipal safety strategies.

Our exploration doesn’t stop there. We also discuss the advancements in detection technologies and the iterative process of refining systems like LiDAR and video to predict pedestrian movements more accurately. This episode offers a deep dive into the complexities and costs of deploying AI models in urban environments, including the importance of ML Ops, the challenge of model retraining, and the role of existing infrastructure in supporting intelligent systems. Join us as we navigate the intricate world of smart city solutions, focusing on the shared goal of safer streets for everyone.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Discover the cutting-edge world of AI deployment on edge devices with insights from top experts, including Dr. KC Liu. This episode promises to unravel the complexities of optimizing AI models for devices where memory and computing power are limited. We explore the critical role of model compilers and the innovative strides being made in AIoT sensors, as Matteo Maravita from STMicroelectronics offers an exciting glimpse into the future of machine learning integration into MEMS sensors.

Join us as we tackle the pressing need for standardization in the fragmented IoT development landscape. Our esteemed panel delves into the challenges developers face with diverse proprietary technologies from giants like STM, NXP, and Renesas. Hear about potential convergence through model zoos and frameworks, and the unique role of MLPerf Tiny ML in benchmarking AI applications specifically designed for edge devices. Our conversation shines a light on the balance between utilizing common tools and proprietary compilers for optimized performance on specific hardware.

Lastly, explore the promising avenues of AI in the realm of robotics and the innovative strategies shaping the future of AI systems. Learn about the layered architecture approach dividing AI systems into sensor network, edge AI, and cloud computing layers, and the potential for a sustainable AI ecosystem through collaboration. With a focus on benchmarking advancements and MPU design strategies, discover how AI integration with numerous sensors could redefine possibilities in the robotics field. This episode is a compelling journey through the landscape of AI technologies, emphasizing collaboration and innovation for next-generation AI products.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Unlock the secrets of energy-efficient AI as we explore the groundbreaking fusion of Edge AI and generative AI in our latest episode. With expert insights from Victor Jung, a trailblazer in the field, discover how foundational models can be deployed on tiny and embedded systems to revolutionize devices like AR glasses and nanodrones. Listen as we unravel the complexities of deploying neural networks on microcontrollers, with a focus on powerful techniques like quantization, graph lowering, and innovative memory management strategies.

Victor guides us through the nuanced process of deploying neural networks, highlighting critical stages like graph lowering and memory allocation. Traverse the intricate front-end and mid-end stages where neural network graphs are optimized, ensuring peak performance on specific hardware platforms. We'll illustrate the importance of efficient memory usage through a fascinating example involving a tiny language model on the Syracuse platform, showcasing the role of quantization and memory management tailored for hardware constraints.

Dive into the future of AI deployment on edge devices with a focus on quantization and hardware support. From exploring the potential of foundation models like DenoV2 to discussing the emerging micro scaling format, we uncover the technologies that are making AI more energy-efficient and versatile. Our conversation underscores the importance of viewing memory as a compute asset and the need for ongoing research to enhance system efficiency for generative AI at the edge. Join us for an enlightening episode that highlights the vital steps needed to optimize memory and computing resources for meaningful applications on small platforms.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Join us for an insightful conversation with Dr. Vijay Janapa Reddi from Harvard, who takes us on a journey through the evolving world of edge computing and machine learning education. Discover how his family's affinity for East Coast seasons inspired his academic path, and learn about his groundbreaking open-source book on machine learning systems. This episode celebrates the rebranding of the tinyML Foundation to the Edge AI Foundation, reflecting an expanded focus that transcends embedded devices. We tackle the complexities of machine learning education, where excitement often masks the real challenges of developing robust AI systems.

Dr. Janapa Reddi’s vision for his work-in-progress book draws from his teaching experiences at Harvard, aiming to universalize machine learning system principles akin to core concepts in operating systems. We explore the challenge of crafting educational materials that cater to both beginners and seasoned professionals, providing a roadmap to guide diverse audiences. The discussion highlights the importance of hands-on learning, especially in data collection and lab work, with contributions from notable figures like Marcelo Rovai in the tinyML space, emphasizing practical applications for edge AI systems.

In a fascinating discussion on data science versus data engineering, Dr. Janapa Reddi elucidates the foundational role of data engineering in successful machine learning projects. We also delve into microcontroller programmability and the integration of frameworks like TensorFlow and PyTorch into curriculums. As we explore the role of AI tools like ChatGPT in programming, the conversation shifts to the exciting potential of AI-powered educational assistants, transforming the future of learning through interactive and personalized experiences. Whether you're a student, educator, or industry professional, this episode offers a wealth of insights into the intersection of AI, education, and the future of edge technologies.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Get ready for the recap of the Beyond Chatbots - The Journey of Generative AI to the Edge - exploring the frontier of Generative AI and edge technology with Davis Sawyer, Danilo Pau and Pete Bernard as they discuss the dynamic innovations transforming these fields. We uncover the fascinating shift from cloud-based proof-of-concepts to the compelling reality of edge solutions. This conversation dives into the ever-evolving landscape of generative AI, particularly in edge environments where cost and power efficiency reign supreme. From automotive breakthroughs to advanced memory optimization techniques, discover how these innovations are redefining the role of AI in our world.

Listen in as we dissect the gravitational pull towards edge solutions with insights from recent industry research and captivating discussions. Dave shares intriguing observations on AI as crucial infrastructure, likening it to essential utilities that promise lasting impacts across sectors. As we look ahead, the conversation turns to the future of AI in manufacturing and the exciting potential for AGI-capable equipment. With Foundation partners like STMicroelectronics and NXP at the helm, the potential for edge AI advancements is limitless. Join us for an engaging exploration of the trends shaping the future of AI and edge computing.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Send us a text

Unlock the secrets of neural style transfer on microcontrollers with our special guest, Alberto Ancilotto of FBK, as he explores a groundbreaking approach to image generation on low-power devices. Discover how this innovative technique allows us to combine the content of one image with the artistic style of another, transforming simple visuals into unique masterpieces—like turning a regular cat photo into a Van Gogh-inspired work of art. Alberto introduces Xinet, a cutting-edge convolutional neural network designed to perform these creative tasks efficiently on embedded platforms. Gain insight into the process of optimizing performance by evaluating CNN operators for energy efficiency and adapting networks for a variety of devices, from the smallest microcontrollers to advanced TPUs and accelerators.

We dive deep into the collaboration between Clip and style transfer networks, enhancing the precision of semantic representation in generated images. Witness the impressive capabilities of this technology through real-world examples, such as generating images in just 60 milliseconds on the STM32N6 microcontroller. Experience the advanced applications in video anonymization, where style transfer provides a superior alternative to traditional blurring methods, altering appearances while maintaining action consistency. Alberto also addresses the broader implications of anonymization technology in public spaces, including privacy protection and GDPR compliance, while maintaining artistic integrity. Join us as we tackle audience questions about model parameters, deployment flexibility, and the exciting potential of this technology across various sectors.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org