WT: Giving Powerful Topology 4
The episode is largely a discussion of ChatGPT/GPT-4 and how the hosts are using it in practice. Brian describes a hands-on experience role-playing as Blaine the Mono in GPT-4 and being impressed by how well it stayed in character, while Andrew explains the progression from GPT to GPT-2, GPT-3.5, ChatGPT, and GPT-4, emphasizing reinforcement learning with human feedback, instruction following, and stronger contextual understanding (L53-L61, L67-L69, L83-L85, L107-L118). The conversation also covers
en-US