• The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

  • Written by: Sam Charrington
  • Podcast

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Written by: Sam Charrington
Listen for free

  • Summary

  • Machine learning and artificial intelligence are dramatically changing the way businesses operate and people live. The TWIML AI Podcast brings the top minds and ideas from the world of ML and AI to a broad and influential community of ML/AI researchers, data scientists, engineers and tech-savvy business and IT leaders. Hosted by Sam Charrington, a sought after industry analyst, speaker, commentator and thought leader. Technologies covered include machine learning, artificial intelligence, deep learning, natural language processing, neural networks, analytics, computer science, data science and more.
    All rights reserved
    Show more Show less
Politics & Government Science
Show more Show less
Episodes
  • Speculative Decoding and Efficient LLM Inference with Chris Lott - #717

    Speculative Decoding and Efficient LLM Inference with Chris Lott - #717
    Feb 4 2025
    Today, we're joined by Chris Lott, senior director of engineering at Qualcomm AI Research to discuss accelerating large language model inference. We explore the challenges presented by the LLM encoding and decoding (aka generation) and how these interact with various hardware constraints such as FLOPS, memory footprint and memory bandwidth to limit key inference metrics such as time-to-first-token, tokens per second, and tokens per joule. We then dig into a variety of techniques that can be used to accelerate inference such as KV compression, quantization, pruning, speculative decoding, and leveraging small language models (SLMs). We also discuss future directions for enabling on-device agentic experiences such as parallel generation and software tools like Qualcomm AI Orchestrator. The complete show notes for this episode can be found at https://twimlai.com/go/717.
    Show more Show less
    1 hr and 17 mins
  • Ensuring Privacy for Any LLM with Patricia Thaine - #716

    Ensuring Privacy for Any LLM with Patricia Thaine - #716
    Jan 28 2025
    Today, we're joined by Patricia Thaine, co-founder and CEO of Private AI to discuss techniques for ensuring privacy, data minimization, and compliance when using 3rd-party large language models (LLMs) and other AI services. We explore the risks of data leakage from LLMs and embeddings, the complexities of identifying and redacting personal information across various data flows, and the approach Private AI has taken to mitigate these risks. We also dig into the challenges of entity recognition in multimodal systems including OCR files, documents, images, and audio, and the importance of data quality and model accuracy. Additionally, Patricia shares insights on the limitations of data anonymization, the benefits of balancing real-world and synthetic data in model training and development, and the relationship between privacy and bias in AI. Finally, we touch on the evolving landscape of AI regulations like GDPR, CPRA, and the EU AI Act, and the future of privacy in artificial intelligence. The complete show notes for this episode can be found at https://twimlai.com/go/716.
    Show more Show less
    52 mins
  • AI Engineering Pitfalls with Chip Huyen - #715

    AI Engineering Pitfalls with Chip Huyen - #715
    Jan 21 2025
    Today, we're joined by Chip Huyen, independent researcher and writer to discuss her new book, “AI Engineering.” We dig into the definition of AI engineering, its key differences from traditional machine learning engineering, the common pitfalls encountered in engineering AI systems, and strategies to overcome them. We also explore how Chip defines AI agents, their current limitations and capabilities, and the critical role of effective planning and tool utilization in these systems. Additionally, Chip shares insights on the importance of evaluation in AI systems, highlighting the need for systematic processes, human oversight, and rigorous metrics and benchmarks. Finally, we touch on the impact of open-source models, the potential of synthetic data, and Chip’s predictions for the year ahead. The complete show notes for this episode can be found at https://twimlai.com/go/715.
    Show more Show less
    58 mins

What listeners say about The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.ca reviews

Amazon Reviews
No reviews are available