Advanced Topics in Computer Science: Embodied Language Understanding

Recent advances in machine learning have ushered in exciting developments in natural language processing (NLP) but comprehending language requires an understanding of contextual signals beyond just reading text, such as visual stimuli, interactive signals from an agent's environment, or even the mental state of other agents. This seminar studies the latest research in the area of embodied language understanding, to develop artificial agents that can understand and generate natural language in the context of extra-linguistic signals. The course revolves around papers assigned for reading, and students complete a project.