CS224U

Lessons learned about benchmarking, adversarial testing, the dangers of over- and under-claiming, and AI alignment. Transcript: https://web.stanford.edu/class/cs224u/podcast/bowman/ Sam's websiteSam on TwitterNYU LinguisticsNYU Data ScienceNYU Computer ScienceAnthropicA large annotated corpus for learning natural language inferenceSNLI leaderboardFraCaSSICKA SICK cure for the evaluation of compositional distributional semantic modelsSemEval-2014 Task 1: Evaluation of Compositional...

AI and social science, the causal revolution in economics, predictions about the impact of AI, teaching MBAs, productizing AI, and a journey from Tel Aviv to Princeton to Stanford. Transcript: https://web.stanford.edu/class/cs224u/podcast/goldberg/ Amir's websiteAmir on TwitterComputational Culture LabChatGPTLaura NelsonBart BonikowskiChris WinshipBernie KochTreebanksBIG-benchGuido ImbensEndogeneitySusan AtheyCambridge AnalyticaPrediction MachinesSpeech and Language ProcessingDALL-E...

Leaving Ohio, being back in Belgium, organizing NAACL 2022, reviewing at NLP-scale, universal dependencies, and doing NLU before it was cool. Transcript: https://web.stanford.edu/class/cs224u/podcast/demarneffe/ Marie's websiteGenerating Typed Dependency Parses from Phrase Structure ParsesUniversal Dependencies projectOSU LinguisticsNAACL 2022Dan JurafskyDan RothChris ManningARRPriscilla RasmussenTransactions of the ACLFinding Contradictions in TextNot a simple yes or no: Uncertainty in...

Coding puzzles, practices, and education, structured prediction, the culture of Hugging Face, large models, and the energy of New York. Transcript: https://web.stanford.edu/class/cs224u/podcast/rush/ Sasha's websiteSasha on TwitterSasha on the Humans of AI podcastSasha on The Thesis Review Podcast with Sean WelleckSasha on the Talking Machines PodcastSasha interviewed by Sayak PaulHugging FacePyTorchThe Annotated TransformerThe Annotated AliceThe Annotated S4Sasha and Dan Oneață's...

Moving to Stanford, linguistic and social variation, interventional studies, and shared stories and lessons learned from an ACL Young Rising Star. Transcript: https://web.stanford.edu/class/cs224u/podcast/yang/ Diyi's websiteDiyi on TwitterDan JurafskyThe Stanford NLP GroupBuford Highway in AtlantaSweet teaVALUE paperAAEGLUENegative concordExploring the role of grammar and word choice in bias toward African American English (AAE) in hate speech classification Inducing positive perspectives...

Birth narratives, stable static representations, NLP for everyone, AI2 and Semantic Scholar, the mission of Ukrainian Catholic University, and books books books. Transcript: https://web.stanford.edu/class/cs224u/podcast/antoniak/ Maria's websiteMaria on TwitterSemantic ScholarElliott AshETH Zurich Center for Law and EconomicsText As Data (TADA) 2022David MimnoA computational reading of a birth stories communityr/BabyBumpsRoger ShankNate ChambersICWSM 2022 workshop: BERT for Social Sciences...

Realizing that Foundation Models are a big deal, scaling, why Percy founded CRFM, Stanford's position in the field, benchmarking, privacy, and CRFM's first and next 30 years. Transcript: https://web.stanford.edu/class/cs224u/podcast/liang/ Percy's websitePercy on TwitterCRFMOn the opportunities and risks of foundation modelsDeep contextualized word representationsBERT: Pre-training of deep bidirectional Transformers for language understandingSam BowmanGPT-2Adversarial examples for...

From genes to memes, evidence in linguistics, central questions of computational psycholinguistics, academic publishing woes, and the benefits of urban density. Transcript: https://web.stanford.edu/class/cs224u/podcast/levy/ Roger's websiteRoger on TwitterRoger's coursesThe Selfish GeneJoan BresnanJohn RickfordChris ManningNoah GoodmanThomas ClarkTed GibsonEthan WilcoxCritical periodYevgeni BerzakHeritage languageHow many words do kids hear each year? See footnote 10.W.E.I.R.DKristina...

Giving a TED talk, linguistic diversity, code switching and large language models, the Indian NLP scene, empowering women with language consultation work, Wordle, and "once a linguist, always a linguist". Transcript: https://web.stanford.edu/class/cs224u/podcast/bali/ Kalika's websiteKalika on TwitterKalika's TED talkMicrosoft Research IndiaHALIndicBERTAI4BharatmBERTHindiBanglaEnglishGondiAdivasi radioOriyaKarya crowdsourcing platformSandy ChungLanguage processing experiments in the...

Coast-to-coast professional journeys, multilingual NLP, teaching in a fast-changing field, the history of hate speech detection in NLP, ethics review of NLP research, research on sensitive topics, mentoring researchers, and optimizing for your own passions. Transcript: https://web.stanford.edu/class/cs224u/podcast/tsvetkov/ Yulia's websiteTsvetShopShuly WintnerJust when I thought I was out ...Algorithms for NLPHMMsKneser–Ney smoothingNoah SmithDemoting racial bias in hate speech...

Grounding through pure language modeling objectives, the origins or probing, the nature of understanding, the future of system assessment, signs of meaningful progress in the field, and having faith in yourself. Transcript: https://web.stanford.edu/class/cs224u/podcast/pavlick/ Ellie's websiteThe LUNAR LabMIT Scientist Captures 90,000 Hours of Video of His Son’s First Words, Graphs ItMichael FrankSpot robotsDylan EbertIan TenneyWhat do you learn from context? Probing for sentence structure...

The early days of the rise of deep learning in NLP, conviction, the importance of applied work in the current moment, start-up risks, the state of Web search, paramotoring, and over-looked gems in the U.S. National Park system. Transcript: https://web.stanford.edu/class/cs224u/podcast/socher/ Richard's websiteRichard's TwitterRichard's paramotoringSalesforce Researchyou.com@YouSearchEngineNate ChambersTensor Product Variable Binding and the Representation of Symbolic Structures in...

Pronouncing "ColBERT", the origins of ColBERT, doing NLP from an IR perspective, how getting "scooped" can be productive, OpenQA and related tasks, PhD journeys, why even retrieval plus attention is not all you need, multilingual knowledge-intensive NLP, and aiming high in research projects. Transcript: https://web.stanford.edu/class/cs224u/podcast/khattab/ Omar's websiteMatei ZahariaKeshav SanthanamSteven Colbert thowing paper with ObamaThe ColBERT paperthe ColBERTv2 paperLearning passage...

Neuroscience and neural networks, being a linguist in the world of NLP, evaluation methods, fine-grained NLI questions, the pace of research, and the vexing fact that, on the internet, people = men. Transcript: https://web.stanford.edu/class/cs224u/podcast/williams/ Adina's websiteAdina on TwitterBased on billions of words on the internet, people = menApril BaileyAndrei CimpianAndrocentrismGloVefastTextPreregistrationP-hackingRishi BommasaniInterpreting pretrained contextualized...

Hugging Face, multimodality, data and model auditing, ethics review, adversarial testing, attention as more and less than you ever needed, neural information retrieval, philosophy of mind and consciousness, augmenting human creativity, openness in science, and a defininitive guide to pronouncing Douwe. Transcript: https://web.stanford.edu/class/cs224u/podcast/kiela/ Douwe's websiteHugging FaceGrounding semantics in olfactory perceptionModel Cards for Model reportingDatasheets for...

Deriving static representations from contextual ones, interdisciplinary research, training large models, the Foundation Models paper and CRFM, being an academic on Twitter, and progress in NLP. Transcript: https://web.stanford.edu/class/cs224u/podcast/bommasani/ Rishi's websiteRishi on TwitterBommasani et al 2020On the opportunities and risks of foundation modelsReflections on foundation modelsEleutherAIChinchillahttp://www.isattentionallyouneed.comRishi on The Gradient podcast