+0
Daily
15,847
stars
3,530
forks
1,198
watchers
6
prs
18
issues
0
releases
README
Preamble This repository contains the lecture slides and course description for the Deep Natural Language Processing course offered in Hilary Term 2017 at the University of Oxford. This is an advanced course on natural language processing. Automatically processing natural language inputs and producing language outputs is a key component of Artificial General Intelligence. The ambiguities and noise inherent in human communication render traditional symbolic AI techniques ineffective for representing and analysing language data. Recently statistical techniques based on neural networks have achieved a number of remarkable successes in natural language processing leading to a great deal of commercial and academic interest in the field This is an applied course focussing on recent advances in analysing and generating speech and text using recurrent neural networks. We introduce the mathematical definitions of the relevant machine learning models and derive their associated optimisation algorithms. The course covers a range of applications of neural networks in NLP including analysing latent dimensions in text, transcribing speech to text, translating between languages, and answering questions. These topics are organised into three high level themes forming a progression from understanding the use of neural networks for sequential language modelling, to understanding their use as conditional language models for transduction tasks, and finally to approaches employing these techniques in combination with other mechanisms for advanced applications. Throughout the course the practical implementation of such models on CPU and GPU hardware is also discussed. This course is organised by Phil Blunsom and delivered in partnership with the DeepMind Natural Language Research Group. Lecturers Phil Blunsom (Oxford University and DeepMind) Chris Dyer (Carnegie Mellon University and DeepMind) Edward Grefenstette (DeepMind) Karl Moritz Hermann (DeepMind) Andrew Senior (DeepMind) Wang Ling (DeepMind) Jeremy Appleyard (NVIDIA) TAs Yannis Assael Yishu Miao Brendan Shillingford Jan Buys Timetable Practicals Group 1 - Monday, 9:00-11:00 (Weeks 2-8), 60.05 Thom Building Group 2 - Friday, 16:00-18:00 (Weeks 2-8), Room 379 1. Practical 1: word2vec 2. Practical 2: text classification 3. Practical 3: recurrent neural networks for text classification and language modelling 4. Practical 4: open practical Lectures Public Lectures are held in Lecture Theatre 1 of the Maths Institute, on Tuesdays and Thursdays (except week 8), 16:00-18:00 (Hilary Term Weeks 1,3-8). Lecture Materials 1. Lecture 1a - Introduction [Phil Blunsom] This lecture introduces the course and motivates why it is interesting to study language processing using Deep Learning techniques. [[slides]](Lecture%201a%20-%20Introduction.pdf) [[video]](http://media.podcasts.ox.ac.uk/comlab/deep_learning_NLP/2017-01_deep_NLP_1a_intro.mp4) 2. Lecture 1b - Deep Neural Networks Are Our Frien
Top issues
#18Lecture 9 - Speech Recognition.pdf broken after a few pages1 comments · 2017-08-07#11What is the text classification's high limit of classes number?1 comments · 2017-03-09#10Would you mind explaining an issue about gradient descent in lecture 1b1 comments · 2017-03-02#23practical solutions for self-examination0 comments · 2020-06-02#22Which kind of model is better for keyword-set classification?0 comments · 2019-12-26#20NLP0 comments · 2018-01-20#19Lecture 1b Errors0 comments · 2018-01-02#17Just waiting for the next lecture0 comments · 2017-04-27