FREDERICK RIEMENSCHNEIDER

Frederick Riemenschneider

Contact

+49 6221 54-3085
Email (click to copy)
Institut für Computerlinguistik
Im Neuenheimer Feld 325
D-69120 Heidelberg
Germany

About me / Research Statement:

Since September 2022, I am a Doctoral Student under the supervision of Prof. Dr. Anette Frank at the Department of Computational Linguistics at Heidelberg University. My research focuses on understanding the inner workings of language models, an area known as mechanistic interpretability. I am particularly interested in investigating how language is represented within these models and how different languages are organized and structured.
In addition to my work on multilingual language model interpretability, I am passionate about ancient languages. I aim to apply computational linguistics methods to this domain, exploring how modern NLP techniques can be effectively leveraged for literary studies and linguistic analysis of historical texts.

NEWS

🗣️ Invited Talk at ISTI‑CNR

19th September 2025

The talk "From Classics to Circuits" discusses language models for Ancient Greek and Latin—linked to our semantic retrieval work in Pisa—before turning to my current research on mechanistic interpretability in multilingual language models. Details here.

☕️ Featured on AI Coffee Break at ACL 2025

15th September

I joined the one and only AI Coffee Break at ACL 2025 for a short interview about my research. Watch the interview here.

🏆 My Master’s Thesis Wins the GSCL Best Student Thesis Award

12th October 2025

At KONVENS 2025, I will present my master’s thesis "Investigating Language Models for Classical Philology: Aspects of Morphology, Syntax, and Knowledge from a Multilingual Perspective," which has been selected as the 2025 winner of the Best Student Thesis Award. More information is available here.

Research Stay at the CNR in Pisa

1st September 2025

I've been invited as a visiting researcher for the entire month of September. We will be working on SPhilBERTa and retrieval systems for Classics.

🗣️ Invited Talk at the 2024 Edition of the Computational Approaches to Ancient Greek and Latin Workshop

29th November 2024

The talk "Ira ex machina: Multilingual Models and Emotion Analysis in Classical Texts" covered my insights into multilingual language models for Classics, as well as my current project on emotions in Ancient Greek and Latin texts. The abstract can be viewed here.

🗣️ Invited Talk at IIT Indore: "Digital Humanities and Infrastructures"

18th September 2024

I presented "It’s All Greek (and Latin) to Me: Multilingual Language Models and the Challenges of Digital Classics", as part of the seminar and panel discussion "Digital Humanities and Infrastructures: Tools, Archives, and Theory", co‑organized by the India offices of Freie Universität Berlin and Heidelberg University with IIT Indore. More information here.

PUBLICATIONS

2025
+ -

An Annotated Dataset of Errors in Premodern Greek and Baselines for Detecting Them

Brooks, C., Haubold, J., Cowen-Breen, C., White, J., DeVaul, D., Riemenschneider, F., Narasimhan, K., Graziosi, B. (2025)

Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico.

Beyond Base Predictors: Using LLMs to Resolve Ambiguities in Akkadian Lemmatization

Riemenschneider, F. (2025)

Proceedings of the Second Workshop on Ancient Language Processing, The Albuquerque Convention Center, Laguna.

Cross-Lingual Generalization and Compression: From Language-Specific to Shared Neurons

Riemenschneider, F., Frank, A. (2025)

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL'25), Vienna, Austria.
2024
+ -

Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformers

Riemenschneider, F., Krahn, K. (2024)

Proceedings of the 6th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, St. Julian's, Malta.
2023
+ -

Exploring Large Language Models for Classical Philology

Riemenschneider, F., Frank, A. (2023)

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), Toronto, Canada.

Graecia capta ferum victorem cepit. Detecting Latin Allusions to Ancient Greek Literature

Riemenschneider, F., Frank, A. (2023)

Proceedings of the Ancient Language Processing Workshop, Varna, Bulgaria.

TEACHING

WS 24/25
+ -

Mechanistic Interpretability

SS 24
+ -

Programming II

When Theory and Practice COLIde

WS 23/24
+ -

Multilingual Language Models

SS 23
+ -

Programming II

Software Project

WS 22/23
+ -

When Theory and Practice COLIde

CURRICULUM VITAE

Employment

2022 - today

Academic Employee

Department of Computational Linguistics (ICL), Heidelberg University

2022

Tutor Programming II (Python) Course

Tutoring the Programming II (Python) course at Heidelberg University

Tutor Formal Syntax Course

Tutoring the Formal Syntax course at Heidelberg University

Tutor Language Course Ancient Greek

Tutoring language course Ancient Greek at Heidelberg University

2021

Tutor Statistical Methods for Computational Linguistics Course

Tutoring the Statistical Methods course at Heidelberg University

Tutor Formal Semantics Course

Tutoring the Formal Semantics course at Heidelberg University

Tutor Programming II (Java) Course

Tutoring the Programming II course at Heidelberg University

2019

Tutor Introduction to Computational Linguistics Course

Tutoring the Introduction to Computational Linguistics course at Heidelberg University

2019 - 2021

HiWi at Marburg University

Software programming and digitalization for Biblical Hebrew at Marburg University

Education

2021 - 2023

M.A. Computational Linguistics

Neuphilologische Fakultät, Heidelberg University, Germany

2018 - 2021

B.A. Computational Linguistics and Classical Philology (Greek)

Neuphilologische Fakultät, Heidelberg University, Germany
Philosophische Fakultät, Heidelberg University, Germany

German Academic Scholarship Holder

2018

Highschool Graduation

Friedrich-Wilhelm-Gymnasium Trier, Germany