We discuss Sony AI's accomplishment of creating a novel AI agent that can beat professional racers in Gran Turismo. Some topics include: - The crafting of rewards to make the agent behave nicely - What is QR-SAC? - How to deal with "rare" experiences in the replay buffer
Link to paper: https://www.nature.com/articles/s41586-021-04357-7