lunduniversity.lu.se

Computer Science

Faculty of Engineering, LTH

Denna sida på svenska This page in English

Lectures

Lectures

This page is provisional. It will be updated in due time.

Contents

^Chapter 1: An overview of language processing (02/09/2024) [Springer Link]

  • Contents: Presentation of language processing, applications, disciplines of linguistics
  • Lecture slides: [ pdf].

^Chapter 2: A tour of Python (self-study) [Springer Link]

  • Programs: The programs of this chapter [1]

^Chapter 3: Corpus processing tools (02 and 05/09/2024) [Springer Link]

^Chapter 4: Encoding and annotation schemes (05/09/2024) [Springer Link]

^Chapter 5: Python for numerical computation (self-study) [Springer Link]

  • Programs: The programs of this chapter [1]

^Chapter 6: Topics in information theory and machine learning (12/09/2024) [Springer Link]

  • Contents:
    • Topics in information theory
    • Using scikit learn, a popular machine learning toolkit
  • Lecture slides: [ pdf].
  • Resources:
    • Machine-learning software:

^Chapter 9: Counting and indexing words (09/09/2024) [Springer Link]

  • Contents:
    • Tokenization
    • Counting words
  • Lecture slides: [pdf]
  • Python programs:
    • Programs: The programs of this chapter [1]
  • Software and resources:
    • Reuters corpus [1]

^Chapter 10: Word sequences (09 and 12/09/2024) [Springer Link]

  • Contents:
    • N-grams
    • Counting N-grams
  • Lecture slides: [pdf]
  • Python programs:
    • Programs: The programs of this chapter [1]
  • Demonstrations:
    • A collocation demo from from the Corpus Linguistics group at FAU Erlangen-Nürnberg.
  • Software and resources:

^Chapter 6: Words, parts of speech, and morphology (8 and 15/09/2022) [pdf] [first ed. pdf]

^Chapter 7: Part-of-speech tagging using rules (not taught in 2022) [pdf] [first ed. pdf]

  • Contents:
    • Part-of-speech tagging with symbolic rules
    • Annotation standards for parts of speech (tagsets)
  • Lecture slides: [pdf].
  • Annotation manuals and corpora:
    • The universal dependencies: Multilingual annotated corpora
    • BNC, the British national corpus, an annotated corpus in English following the text encoding initiative (TEI).
    • SUC, the Stockholm-Umeå corpus, an annotated corpus in Swedish
    • Negra, an annotated corpus in German
    • An inventory of available corpora compiled by a group at Stanford.
  • Software:

^Chapter 8: Part-of-speech tagging using machine-learning techniques (15/09/2022) [pdf] [first ed. pdf]

^Chapter 9: Phrase-structure grammars in Prolog (not taught in 2022) [pdf] [first ed. pdf]

  • Contents:
    • Constituents, trees
    • Using Prolog to do natural language analysis, DCG rules, variables
    • Getting the syntactic structure
    • Compositional analysis to get the semantic structure
  • Lecture slides: [pdf]
  • Prolog programs:
    • Two small DCG grammars [1] [2]
    • A tokenizer using Prolog clauses [3] and another one using DCG rules [ 4].
    • A small interpreter of regular expressions in Prolog by Robert Cameron [5].
  • Application examples:
    • The grammar checker in MS Word whose parser uses phrase-structure rules.
    • The natural language group at Microsoft Research.

^Chapter 10: Techniques for sequence predictions (22/09/2022) [pdf] [first ed. pdf]

  • Contents:
    • ELIZA: word spotting and pattern matching
    • Multiwords and named entities
    • Noun groups and verb groups
    • Partial parsing: statistical techniques
    • Information extraction
    • Precision, recall, and F-measure (harmonic mean)
  • Lecture slides: [pdf]
  • Prolog programs:
    • Prolog predicates to write local DCG grammars with simple noun group and verb group rules [1].
  • Documents:
    • Many interesting papers on partial parsing by Steven Abney;
    • An application example of information extraction: the FASTUS system from SRI.
    • Carsim, a system to generate animated 3D scenes from text that uses information extraction techniques.
  • Annotated corpora and evaluation resources:
  • Demonstrations:
    • CiceroLite, a system to extract named entities
    • AlchemyAPI, a system to identify people, organizations, locations, and categorize text
    • Calais, an information extraction system
    • Visualizing and monitoring events and disasters on a map at EMM labs, part of the Europe media monitor. The information extraction part of the event detector. A key to the symbols used is available from this page. See also their name explorer.
  • Software:
  • Annotation resources:
    • The MUC site;
    • PEAS, a group annotation scheme for French
    • TüPP-D/Z, Tübingen Partially Parsed Corpus of Written German

^Chapter 11: Syntactic formalisms (not taught in 2022) [pdf] [first ed. pdf]

  • Contents:
    • Constituency and dependency
    • Phrase categories
    • Unification-based grammars
    • Dependency grammars
    • Valence and subcategorization frames
    • Functions
  • Lecture slides: [pdf]
  • Prolog programs:
    • Some simple DCG rules for German noun phrases [1]
    • The generalized unification [2].
    • Detection of nonprojective links in a dependency tree [ 3] and examples of graphs [4].
    • A program to convert the CONLL-X file format into a Prolog clause [ 5]. Useful with the nonprojectivity detection.
  • Corpus and programming resources:
    • More than 60 annotated corpora in multiple languages from the Universal dependencies site.
    • Four freely available annotated dependency corpora, Danish, Dutch, Portuguese, and Swedish, and links to seven others from the CONLL-X shared task.
    • The Susanne corpus, a free treebank for English.
    • A French treebank from Université Paris VII (Available with a license).
    • Tables lexique-grammaire , subcategorization frames in French available from Université de Marne-la-Vallée.
    • The LTH converter to convert constituent trees using the Penn Treebank annotation into dependency graphs.
  • Lexical and grammar resources:
  • Annotation resources:

^Chapter 12: Transformers (22/09/2022) [pdf] [first ed. pdf]

  • Contents:
    • Contextual embeddings
    • Attention
    • Masked language models
  • Lecture slides: [pdf]

^Chapter 13: Dependency parsing (22 and 29/09/2022) [pdf] [first ed. pdf]

  • Contents:
    • Dependency parsing
    • Nivre's parser
  • Lecture slides: [pdf]
  • Prolog programs:
    • Joakim Nivre's dependency parser [3].
    • Updates to the book:
      • Nivre's parser to parse an annotated corpus (gold standard parsing) [ 4] and an improved version of Nivre's parser [5].
      • Utilities to parse a CoNLL 2006 or 2007 corpus [ 6] [ 7] [ 8].
      • The Swedish corpus used in CoNLL 2006 and formatted as a Prolog clause. Training set [ 9] and test set [ 10].
  • Corpus resources:
    • More than 60 annotated corpora in multiple languages from the Universal dependencies site.
    • Four freely available annotated dependency corpora, Danish, Dutch, Portuguese, and Swedish, and links to 7 others from the CoNLL-X shared task. Seven other corpora with the same annotation, Basque, Catalan, Chinese, Greek, Hungarian, Italian, and Turkish, from the CoNLL 2007 shared task.
  • Parsers resources:
  • On-line parsers:

^Chapter 14: Semantics and predicate logic (29/09/2022) [pdf] [first ed. pdf]

^Chapter 15: Lexical semantics (6/10/2022) [pdf] [first ed. pdf]

  • Contents:
    • Words and meaning
    • Lexical semantics
    • Lexical networks
    • Word sense disambiguation
    • Case grammars
    • Frame semantics and semantic roles
    • Semantic grammars
  • Lecture slides: [pdf]. Anders Björkelund's presentation of his thesis on semantic role labeling [pdf].
  • Resources:
    • Lexical databases:
    • Sense identification:
      • SemCor, the Brown corpus tagged with Wordnet senses. This was originally done at Princeton with WordNet 1.6. In the meantime, WordNet people reorganized the sense nomenclature. The different corpora are mappings according to WordNet sense versions
    • Semantic role labeling:
    • Semantic role labeling software:

^Chapter 16: Discourse (6/10/2022) [pdf] [first ed. pdf]

  • Contents:
    • Discourse definition,
    • Discourse entities
    • Reference and anaphora
    • Rhetorical structure theory (RST)
    • Parsing a text
    • Machine learning to discover RST relations
    • TimeML
  • Lecture slides: [pdf]
  • Annotation and evaluation resources:
    • The coreference annotation manual used in MUC-7 by Hirschman and Chinchor.
    • A paper on coreference evaluation by Vilain et al. (1995).
    • An annotation manual for Rhetorical structure theory from the University of Southern California's Information Sciences Institute.
    • Another annotation manual for the Penn Discourse Treebank.
    • TimeML, markup language for temporal and event expressions.
  • Corpus resources:
  • Demonstrations:

^Chapter 17: Dialogue (13/10/2022) [pdf] [first ed. pdf]

  • Contents:
    • Dialogue automata
    • Pairs
    • Speech acts
    • Speech act recognition
  • Lecture slides: [pdf]
  • Resources:
    • DAMSL, Dialogue markup scheme from the University of Rochester.
    • Dialogue acts in Verbmobil and Verbmobil-2 [1] [2].
    • The TRAINS corpus and annotated files from the University of Rochester.
  • VoiceXML, a markup framework to develop dialogue applications:
  • Application examples:
    • TRAINS, TRIPS.
    • A train information system in Swedish from SJ. Call 0046 771-75-75-75.
    • A paper by Johan Boye, Mats Wirén, Manny Rayner, Ian Lewin, David Carter, and Ralph Becket, "Language-Processing Strategies and Mixed-Initiative Dialogues", IJCAI-99 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, July 1999.
Page Manager: