Knowledge Base Construction
In this class, we will take an overview of Information Extraction for Knowledge Base Construction. This is the process of deriving structured information (such as alive(Elvis)) from digital text (such as the sentence "Elvis is alive"). We will first see applications of information extraction, notably in question answering systems, chatbots, and personal assistants. Then, we will cover the technical steps of knowledge base construction: natural language processing, named entity recognition, entity disambiguation, instance extraction, fact extraction, and knowledge cleaning.
The course is graded by 6 labs and a final exam.
- Final grade: 50% labs + 50% exam
- Final grade at re-take: 50% original labs + 50% reexam
- It is not allowed to use code from other sources (students, Web, libraries, etc.) that was designed to solve the problem of the lab. Example: If the task is POS-tagging, it is not allowed to use a library or a piece of code from the Web for POS-tagging for this lab.
- Discussing assignments together is allowed, but each student must write their own solution.
No sharing of code!
- Plagiarism entails a grade of 0 for the lab/exam.
The course takes place on Monday afternoon, 13:30-16:30.
The course is hybrid:
- in presence at Telecom Paris
- virtual here
- 2021-09-13: Introduction (Amphi 5)
Please install Python 3.6 (or later) on your machine for the labs!
See here for help.
- Information Extraction: What is it?
- Information Extraction: Why do we want to do it?
- Information Extraction: Who does it?
- Information Extraction: How does it work?
- Knowledge Representation (until Slide 38, “schema”)
Then please update PIP by running
python3 -m pip install --upgrade pip
- 2021-09-20: Background refresher (Room 1A222)
- Feed-forward neural networks
- Word embeddings (only “word2vec”)
- Architectures (only “RNNs”)
- Transformers (not done, optional material)
- Lab: Classification. Deadline: midnight of
September 26th October 3rd.
- 2021-09-27: Named Entity Recognition and Classification (Room 1A222)
- Named Entity Recognition and Classification (without Deep Learning Methods)
- Lab: NERC. Deadline: Midnight of October 3rd (= the night before the next lecture).
- 2021-10-04: Typing and Disambiguation (Room 1A222)
- Extractive Entity Typing (without “Taxonomy Induction”)
- Entity Disambiguation
- Lab: Disambiguation. Deadline: Midnight of October 17th (= the night before the next lecture).
- 2021-10-11: No course
- This session does not take place. Use the time to prepare for the exam.
- 2021-10-18: Fact extraction (Room 1A222)
- Fact Extraction
- Regular expressions (recap)
- POS Tagging (without Viterbi Algorithm)
- Lab: Instance Extraction. Deadline: midnight before the next lecture.
- 2021-10-25: Fact Extraction by Reasoning (Room 1A222)
- Information Extraction by Reasoning (60)
- Lab: Max Sat. Deadline: midnight before the next lecture.
- 2021-11-08: Rule Mining (Room 1A222)
- Rule Mining (without “bottom-up rule mining”)
- Lab: Fact prediction. Deadline: midnight evening of November 28th (2 weeks after the exam).
- 2021-11-15: Exam (13:30-15:00)
- at Télécom Paris (in presence)
The exam is closed-book (no materials are allowed except for a pen).