Ruprecht-Karls-Universität Heidelberg
Institut für Computerlinguistik

Bilder vom Neuenheimer Feld, Heidelberg und der Universität Heidelberg

Diachronic Language Models

Kursbeschreibung

Studiengang Modulkürzel Leistungs-
bewertung
BA-2010 AS-CL 8 LP
BA-2010[100%|75%] CS-CL 6 LP
BA-2010[50%] BS-CL 6 LP
BA-2010[25%] BS-CL 4 LP
Master SS-CL, SS-TAC 8 LP
Dozenten/-innen Wei Zhao
Veranstaltungsart Proseminar/Hauptseminar
Sprache English
Erster Termin 17.10.2023
Zeit und Ort Dienstags, 15:15-16:45, INF 325 / SR 24
Commitment-Frist tbd.

Teilnahmevoraussetzungen

  • Introduction to Computational Linguistics or similar introductory courses
  • Introduction to Neural Networks and Sequence-To-Sequence Learning (or equal)
  • Completion of Programming I

Leistungsnachweis

  • Active Participation
  • Presentation
  • Term Paper Writing

Inhalt

The rise of large language models such as ChatGPT marks a moment that seems to blur the boundary between artificial and human intelligence. Such language models excel at comprehending human language, and provide assistance to individuals in many text works. In this seminar, we will delve into the domain of large language models, with a particular focus given to diachronic models. These models require the ability to understand the development of human language, including both the past and the present, as well as the changes that occur over time. To commence this exploration, we will first look into the development of human language, namely language change and variation over time. After that, we will explore the machine learning methodologies employed to develop diachronic language models. Lastly, we will examine the implications of these models across research fields, including historical linguistics, natural language generation and social sciences.

Course resources are available at https://github.com/andyweizhao/diaclms.

» weitere Kursmaterialien

zum Seitenanfang