PODCAST

Seventy3

任雨山

73播客，名字取材于Sheldon最喜欢的数字，内容由NotebookLM生成，每天跟随AI读AI业界论文。

technology

All Episodes

00:06:50

【第13期】n-gram解读

Seventy3 ·

2024/10/13

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Enriching Word Vectors with Subword InformationSource: Bojanowski, Piotr, et al. "Enriching Word Vectors with Subword Information." arXiv preprint arXiv:1607.04606 (2016).Main Theme: This paper introduces a novel method for improving continuous word representations by incorporating subword information, specifically character n-grams, into the skip-gram model. This approach proves particularly beneficial for morphologically rich languages and in

zh-cn

00:08:33

【第12期】GloVe解读

Seventy3 ·

2024/10/12

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：GloVe: Global Vectors for Word RepresentationThis briefing document reviews the main themes and key findings of the paper "GloVe: Global Vectors for Word Representation" by Pennington, Socher, and Manning. The paper introduces GloVe, a novel model for learning word embeddings that combines the strengths of global matrix factorization and local context window methods.Key Themes: Limitations of Existing Methods: The authors highlight the drawbacks of

zh-cn

00:08:58

【第11期】CBOW解读

Seventy3 ·

2024/10/11

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Efficient Estimation of Word Representations in Vector SpaceSource: Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv preprint arXiv:1301.3781v3.Main Themes: This paper introduces novel, computationally efficient model architectures for learning high-quality word embeddings from large text datasets. The authors propose two models: Continuous Bag-of-Words (CBOW) and

zh-cn

00:15:22

加餐005-ROSA

Seventy3 ·

2024/10/10

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Enabling Novel Mission Operations and Interactionswith ROSA: The Robot Operating System AgentIntroductionROSA (Robot Operating System Agent) is a groundbreaking AI-powered agent designed to revolutionize human-robot interaction (HRI) by enabling natural language communication with robotic systems. This briefing doc reviews the main themes and key features of ROSA based on the provided source document.Key Features: Natural Language Interface: ROSA

zh-cn

00:10:15

【第10期】Skip-gram解读

Seventy3 ·

2024/10/10

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Distributed Representations of Words and Phrases and their CompositionalityThis document summarizes the key themes, ideas, and facts presented in the research paper "Distributed Representations of Words and Phrases and their Compositionality" by Tomas Mikolov et al. (2013). The paper details advancements in learning high-quality word and phrase vector representations using the Skip-gram model, focusing on improving training speed and accuracy.Main

zh-cn

00:10:56

加餐004-MLP-KAN解读

Seventy3 ·

2024/10/09

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：MLP-KAN: Unifying Deep Representation and Function LearningSource: He, Y., Xie, Y., Yuan, Z., & Sun, L. (2024). MLP-KAN: Unifying Deep Representation and Function Learning. arXiv preprint arXiv:2410.03027.Authors: Yunhong He, Yifeng Xie, Zhengqing Yuan, Lichao SunKey Insight: This paper proposes MLP-KAN, a novel framework combining Multi-Layer Perceptrons (MLPs) for representation learning and Kolmogorov-Arnold Networks (KANs) for function learning

zh-cn

00:07:01

【第九期】Seq2seq解读

Seventy3 ·

2024/10/09

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Sequence to Sequence Learning with Neural NetworksSource: Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. Advances in Neural Information Processing Systems, 27.Main Theme: This paper introduces a novel approach to sequence-to-sequence learning using Long Short-Term Memory (LSTM) neural networks for machine translation tasks. The authors demonstrate the effectiveness of their method on

zh-cn

00:13:38

加餐003-FAN (Fourier Analysis Network)

Seventy3 ·

2024/10/09

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：FAN: Fourier Analysis NetworksThis briefing document reviews the key themes and findings from the research paper "FAN: Fourier Analysis Networks". The paper tackles the challenge of modeling periodicity in neural networks, a crucial aspect often overlooked by popular architectures like MLPs and Transformers.Key Problem: Existing neural networks excel at interpolation within the training data domain but struggle with extrapolation, especially when

zh-cn

00:11:23

加餐002-Differential Transformer

Seventy3 ·

2024/10/09

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Differential TransformerSource: Ye, Tianzhu, et al. "Differential Transformer." arXiv preprint arXiv:2410.05258 (2024).Main Theme: The paper introduces DIFF Transformer, a novel Transformer architecture designed to enhance the attention mechanism in Large Language Models (LLMs) by mitigating the issue of over-attention to irrelevant context.Key Ideas & Facts: Problem: Transformers often struggle to accurately retrieve key information from long

zh-cn

00:12:41

【第八期】RNN Encoder-Decoder解读

Seventy3 ·

2024/10/08

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine TranslationSource: Cho et al. "Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation"Main Themes: This paper introduces a novel neural network architecture called RNN Encoder-Decoder for improving phrase-based Statistical Machine Translation (SMT). The model utilizes two Recurrent Neural Networks (RNNs): an encoder to map

zh-cn

00:11:53

【第七期】GRU original解读

Seventy3 ·

2024/10/07

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Empirical Evaluation of Gated Recurrent Neural Networks on Sequence ModelingSource: "Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling" by Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio.Main Focus: This paper compares the performance of different recurrent neural network (RNN) units, specifically focusing on gated units: Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), against the traditional

zh-cn

00:11:27

【第六期】GRU-RNN解读

Seventy3 ·

2024/10/06

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：On the Properties of Neural Machine Translation: Encoder–DecoderApproachesSource: Cho et al. "On the Properties of Neural Machine Translation: Encoder–Decoder Approaches" (2014)Main Themes: Neural Machine Translation (NMT): This paper analyzes a relatively new approach to statistical machine translation based entirely on neural networks, specifically focusing on the encoder-decoder architecture. Properties and Limitations: The authors investigate the

zh-cn

00:06:00

加餐001-Were RNNs All We Needed?

Seventy3 ·

2024/10/06

Seventy3: 用NotebookLM将论文生成播客，让大家跟着AI一起进步。今天的主题是：Were RNNs All We Needed?Main Theme:This research paper revisits traditional recurrent neural networks (RNNs) like LSTMs and GRUs, proposing simplified versions – minLSTM and minGRU – that address the scalability limitations of their predecessors while achieving comparable performance to modern sequence models.Key Ideas and Facts: Limitations of Traditional RNNs and Transformers: Traditional RNNs, while effective for short sequences, are

zh-cn

00:08:49

【第五期】Movie Gen

Seventy3 ·

2024/10/05

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Movie Gen: A Cast of Media Foundation ModelsThis briefing document reviews the key themes and findings presented in the research paper "movie-gen-research-paper.pdf", focusing on the development and capabilities of Meta's MovieGen AI system.MovieGen is a suite of AI models designed for high-quality video and audio generation and manipulation. The system comprises several specialized models, including: MovieGen Video: A foundational 30B parameter

zh-cn

00:11:57

【第四期】LSTM original解读

Seventy3 ·

2024/10/04

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Long Short-Term Memory (LSTM)Source: Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735–1780.Main Theme: This paper introduces Long Short-Term Memory (LSTM), a novel recurrent neural network (RNN) architecture designed to address the vanishing gradient problem that plagues traditional RNNs when learning long-term dependencies.Most Important Ideas/Facts: Vanishing Gradient Problem: Traditional RNNs

zh-cn

00:16:02

【第三期】LSTM解读

Seventy3 ·

2024/10/03

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Long Short-Term Memory-Networks for Machine ReadingSource: Cheng, J., Dong, L., & Lapata, M. (2016). Long short-term memory-networks for machine reading. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (pp. 2094-2103).Main Theme: This paper introduces the Long Short-Term Memory-Network (LSTMN), a novel neural network architecture that enhances the ability of recurrent neural networks (RNNs) to handle

zh-cn

00:09:56

【第二期】Transformer: Attention is All you Need

Seventy3 ·

2024/10/02

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：Attention Is All You NeedSource: Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.Main Theme: This paper introduces the Transformer, a novel neural network architecture for sequence transduction tasks like machine translation. The key innovation is the exclusive reliance on attention mechanisms, eliminating the

zh-cn

00:12:05

【第一期】NeRF解读

Seventy3 ·

2024/10/02

Seventy3: 用NotebookML将论文生成播客，让大家跟着AI一起进步。今天的主题是：NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis - A Detailed BriefingThis briefing document reviews the key themes and findings presented in the paper "NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis" by Ben Mildenhall et al.Core Idea: The paper introduces NeRF, a novel approach for synthesizing novel views of complex scenes. NeRF utilizes a fully connected neural network to represent a scene as a

zh-cn

578 results

Seventy3

All Episodes

Similar Podcasts

Lead With AI

Tamara Nall

Linux in the Ham Shack

Black Sparrow Media

Data Engineering Podcast

Tobias Macey

Eye On A.I.

Craig S. Smith

Reflections

Livewire Labs