• How scaling changes model behavior

  • Oct 9 2024
  • Length: 12 mins
  • Podcast

How scaling changes model behavior

Listen for free

View show details

  • Summary

  • How scaling changes model behavior

    Some trends are reasonable to extrapolate, some are not. Even for the trends we are succeeding at extrapolating, it is not clear how that signal translates into different AI behaviors.

    Read it here: https://www.interconnects.ai/p/how-scaling-changes-model-behavior

    [00:00] How scaling changes model behavior

    [05:03] Metaphors for what scaling may solve

    [08:45] Short-term scaling is already de-risked

    Fig. 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/openai-predictions.webp

    Fig. 2: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/scaling-laws.webp

    Fig. 3: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/situational-awareness.webp



    Get full access to Interconnects at www.interconnects.ai/subscribe
    Show more Show less
Show more Show less
activate_Holiday_promo_in_buybox_DT_T2

What listeners say about How scaling changes model behavior

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.ca reviews

Amazon Reviews
No reviews are available