Course Preview

Deep Learning for Natural Language Processing
Instructor: Phil Blunsom, Chris Dyer, Edward Grefenstette, Karl Moritz Hermann, Andrew Senior
Department: Computer Science
Institution: University of Oxford
Platform: Independent
Year: 2017
Price: Free
Textbook:
Ian Goodfellow and Yoshua Bengio and Aaron Courville. Deep Learning. 2016.
Description:
This is an advanced course on natural language processing. Automatically processing natural language inputs and producing language outputs is a key component of Artificial General Intelligence. The ambiguities and noise inherent in human communication render traditional symbolic AI techniques ineffective for representing and analysing language data. Recently statistical techniques based on neural networks have achieved a number of remarkable successes in natural language processing leading to a great deal of commercial and academic interest in the field This will be an applied course focussing on recent advances in analysing and generating speech and text using recurrent neural networks. We will introduce the mathematical definitions of the relevant machine learning models and derive their associated optimisation algorithms. The course will cover a range of applications of neural networks in NLP including analysing latent dimensions in text, transcribing speech to text, translating between languages, and answering questions. These topics will be organised into three high level themes forming a progression from understanding the use of neural networks for sequential language modelling, to understanding their use as conditional language models for transduction tasks, and finally to approaches employing these techniques in combination with other mechanisms for advanced applications. Throughout the course the practical implementation of such models on CPU and GPU hardware will also be discussed. This course will be lead by Phil Blunsom and delivered in partnership with the DeepMind Natural Language Research Group. Example lecturers include: 1. Phil Blunsom (Oxford University and DeepMind) 2. Chris Dyer (Carnegie Mellon University and DeepMind) 3. Edward Grefenstette (DeepMind) 4. Karl Moritz Hermann (DeepMind) 5. Andrew Senior (DeepMind) 6. Wang Ling (DeepMind) 7. Jeremy Appleyard (NVIDIA)