NLP HD logo

Welcome to the Heidelberg Natural Language Processing Group

We aim to make machines understand language

Read more about our research
NLP HD logo

NEWS

news-card-image

Researchers of the NLP group win best paper award in the 8th ArgMining Workshop @EMNLP 2021

for their paper Explainable Unsupervised Argument Similarity Rating with Abstract Meaning Representation and Conclusion Generation.

news-card-image

New publications in TACL and ArgMining @ EMNLP

on
Novel AMR Graph Metrics and an AMR Graph Similarity Benchmark
and
Explainable Argument Similarity Rating for better Argument Conclusion Generation.

news-card-image

Best paper award at DeeLIO 2021

Best Paper Award for Maria Becker, Siting Liang and Anette Frank in the DeeLIO Workshop @ NAACL 2021

for their paper:
Reconstructing Implicit Knowledge with Language Models

news-card-image

Eight new publications by the Heidelberg NLP group, collaborating researchers and CL students

We are delighted to announce eight papers on interpretation and reasoning in NLU and NLG using Commonsense Knowledge, on Multilingual AMR Parsing, and on Image and Language processsing. Congratulations to all authors!

Nov 21 Anette Frank gives a panelist talk in the ArgMining Workhop 2021.
Nov 21 On Nov 16, Juri Opitz will give a talk at InFoDiTex on Exploring the Regesta Imperii for testing Large-Scale Pattern-based Analysis of Medieval Entities and Times.
Oct 21 Anette Frank gives an invited talk in CLAR 2021, 4th Int. Conference on Logic and Argumentation.
Sep 21 Letitia Parcalabescu giving a talk in the Hamburg PyData meetup on Multimodal Transformers.
Aug 21 Anette Frank becoming Action Editor for TACL.

RESEARCH TEAM

TEAM

Group Leader

Anette Frank

Anette Frank

Prof. Dr.
Chair of Computational Linguistics
Email (click to copy)
Semantic NLP for advanced & situated Natural Language Understanding

Researchers

Xiyan Fu

Xiyan Fu

MSc Computer Science PhD Student Computational Linguistics
Email (click to copy)
Event-based Reasoning
Natural Language Generation
Structured Meaning Representation
Juri Opitz

Juri Opitz

MA Computational Linguistics PhD Student Computational Linguistics
Email (click to copy)
Meaning representations
Explainability
Argument Mining
Letitia Parcalabescu

Letitia Parcalabescu

MSc Physics PhD Student Computational Linguistics
Email (click to copy)
Multimodal Learning
Vision and Language
Multimodal Understanding
Debjit Paul

Debjit Paul

MSc Computer Science PhD Student Computational Linguistics
Email (click to copy)
Commonsense Reasoning
Knowledge-based Reasoning
Interpretable & Explainable Machine Learning
Philipp Wiesenbach

Philipp Wiesenbach

MA Computational Linguistics PhD Student Computational Linguistics
Email (click to copy)
Computational Argumentation
Neural Machine Translation
Combining NLP and Computer Vision

Associated Researchers

Éva Mújdricza-Maydt

MA Computational Linguistics PhD Student Computational Linguistics
Email (click to copy)
Semantic Role Labeling for German

Phillip Richter-Pechanski

BA Computational Linguistics PhD Student Computational Linguistics
Email (click to copy)
Information Extraction from Medical Texts

Student Assistants

Nadia Arslan

Student research assistant
in the ACCEPT project
Email (click to copy)
Heidelberg University

Mingyang He

Student research assistant
in the ACCEPT project
Email (click to copy)
Heidelberg University

“WE AIM
TO MAKE MACHINES
UNDERSTAND LANGUAGE.”

The main purpose of language is to encode and communicate information of all sorts.

Our research focuses on semantics — the study of meaning — and how a machine can assign meaning to utterances: words, sentences and texts, as humans can do. Our work is linguistically informed and applies advanced machine learning techniques.

Understanding of language requires knowledge of language and the world, the ability to perform reasoning, and situational context.
We study how to interface language with knowledge and how to ground language in the visual world. We investigate what can be left implicit in texts, given that language and knowledge interact, allowing humans to read between the lines.

For all this, humans and machines need knowledge:

about language, the world, people, social norms and the visual world.

“How do humans acquire and exchange knowledge?”
  • KNOWLEDGE-BASED LANGUAGE PROCESSING
  • MACHINE READING COMPREHENSION
  • COMMONSENSE INFERENCE IN SOCIAL SITUATIONS
  • COMPUTATIONAL ARGUMENTATION
“And how to express thoughts in language — accurately and naturally?”
  • NATURAL LANGUAGE GENERATION
  • MEANING-BASED NLG EVALUATION METRICS
  • RECONSTRUCTING IMPLICIT KNOWLEDGE IN TEXT
“How to represent the meaning of a discourse?”
  • STRUCTURED MEANING REPRESENTATIONS
  • REPRESENTING EVENTS AND THEIR PARTICIPANTS
  • RESOLVING ANAPHORA
“How do humans communicate in a visual situation?”
  • MULTIMODAL LANGUAGE PROCESSING
  • GROUNDING LANGUAGE IN IMAGES

PUBLICATIONS

PAPER

2021
+ -

COCO-EX: A Tool for Linking Concepts from Texts to ConceptNet

Becker, M., Korfhage, K., Frank, A. (2021)

Proceedings of the Software Demonstrations of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), 119-126

Reconstructing Implicit Knowledge with Language Models

Becker, M., Liang, S., Frank, A. (2021)

Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures at NAACL 2021, 11-24

CO-NNECT: A Framework for Revealing Commonsense Knowledge Paths as Explicitations of Implicit Knowledge in Texts

Becker, M., Korfhage, K., Paul, D., Frank, A. (2021)

Proceedings of the 14th International Workshop on Computational Semantics (IWCS), Groningen, The Netherlands (Online), 21-32

Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning

Erdem, E., Kuyu, M., Yagcioglu, S., Frank, A., Parcalabescu, L., Plank, B., Babii, A., Turuta, O., Erdem , A., Calixto, I., Lloret, E., Apostol, E., Truica, C., Sandrih, B., Gatt, A., Martincic-Ipsic, S., Berend, G., Korvel , G. (2021)

Journal of Artificial Intelligence Research (JAIR).

Weisfeiler-Leman in the BAMBOO: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity

Opitz, J., Daza, A., Frank, A. (2021)

Transactions of the Association for Computational Linguistics (TACL).

Explainable Unsupervised Argument Similarity Rating with Abstract Meaning Representation and Conclusion Generation

Opitz, J., Heinisch, P., Wiesenbach, P., Cimiano, P., Frank, A. (2021)

Proceedings of the Eighth Argument Mining Workshop, Punta Cana, Dominican Republic, 24-35

Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR

Opitz, J., Frank, A. (2021)

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), Online, 1504-1518

What is Multimodality?

Parcalabescu, L., Trost, N., Frank, A. (2021)

Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online), 1-10

Seeing Past Words: Testing the Cross-Modal Capabilities of Pretrained V&L Models

Parcalabescu, L., Gatt, A., Frank, A., Calixto, I. (2021)

Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online), 32-44

COINS: Dynamically Generating COntextualized Inference Rules for Narrative Story Completion

Paul, D., Frank, A. (2021)

Proceedings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021) , Online.

Generating Hypothetical Events for Abductive Inference

Paul, D., Frank, A. (2021)

Proceedings of The Tenth Joint Conference on Lexical and Computational Semantics (*SEM 2021), Online.

Grounding Plural Phrases: Countering Evaluation Biases by Individuation

Suter, J., Parcalabescu, L., Frank, A. (2021)

Proceedings of the 2nd Workshop on Advances in Language and Vision Research (ALVR 2021) at NAACL 2021, Online, 22-28

Translate, then Parse! A strong baseline for Cross-Lingual AMR Parsing

Uhrig, S., Garcia, Y., Opitz, J., Frank, A. (2021)

Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies (IWPT 2021), Online, 58-64
2020
+ -

Implicit Knowledge in Argumentative Texts: An Annotated Corpus

Becker, M., Korfhage, K., Frank, A. (2020)

Proceedings of the 12th Conference on Language Resources and Evaluation (LREC), Marseille, France, 2316-2324

Explaining Arguments with Background Knowledge -- Towards Knowledge-based Argumentation Analysis

Becker, M., Hulpus, I., Paul, D., Opitz, J., Kobbe, J., Stuckenschmidt, H., Frank, A. (2020)

Datenbank Spektrum (Special Issue: Argumentation Intelligence), 131-141

X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset

Daza, A., Frank, A. (2020)

The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), Online, 3904-3914

Neural Reranking for Dependency Parsing: An Evaluation

Do, B., Rehbein, I. (2020)

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), Online, 4123-4133

Parsers Know Best: German PP Attachment Revisited

Do, B., Rehbein, I. (2020)

Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), Barcelona, Spain (Online), 2049-2061

Herausforderungen Maschinellen Sprachverstehens. Algorithmus für Kreativität gesucht

Frank, A., Markert, K. (2020)

Ruperta Carola Forschungsmagazin, 86-95

AMR Quality Rating with a Lightweight CNN

Opitz, J. (2020)

Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, Suzhou, China, 235-247

AMR Similarity Metrics from Principles

Opitz, J., Parcalabescu, L., Frank, A. (2020)

Transactions of the Association for Computational Linguistics, 522-538

Exploring Phrase Grounding without Training: Contextualisation and Extension to Text-Based Image Retrieval

Parcalabescu, L., Frank, A. (2020)

Proceedings of the Workshop on Multimodal Learning (In conjunction with CVPR 2020), Seattle, WA, USA.

Argumentative Relation Classification with Background Knowledge.

Paul, D., Opitz, J., Becker, M., Kobbe, J., Hirst, G., Frank, A. (2020)

Proceedings of the 8th International Conference on Computational Models of Argument (COMMA 2020), 319-330

Social Commonsense Reasoning with Multi-Head Knowledge Attention

Paul, D., Frank, A. (2020)

In Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2969-2980
2019
+ -

Assessing the Difficulty of Classifying ConceptNet Relations in a Multi-Label Classification Setting

Becker, M., Staniek, M., Nastase, V., Frank, A. (2019)

RELATIONS - Workshop on meaning relations between phrases and sentences (co-located with IWCS).

Metaphors in Text Simplification: To change or not to change, that is the question

Clausen, Y., Nastase, V. (2019)

14th Workshop on Innovative Use of NLP for Building Educational Applications, Florence, Italy, 423-434

Translate and Label! An Encoder-Decoder Approach for Cross-lingual Semantic Role Labeling

Daza, A., Frank, A. (2019)

EMNLP-IJCNLP 2019 - Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing.

Towards Explaining Natural Language Arguments with Background Knowledge

Hulpus, I., Kobbe, J., Becker, M., Opitz, J., Hirst, G., Meilicke, C., Nastase, V., Stuckenschmidt, H., Frank, A. (2019)

1st Workshop on Semantic Explainability – co-located with the 18th International Semantic Web Conference (ISWC 2019) .

Exploiting Background Knowledge for Argumentative Relation Classification

Kobbe, J., Opitz, J., Becker, M., Hulpus, I., Stuckenschmidt, H., Frank, A. (2019)

2nd Conference on Language, Data and Knowledge (LDK 2019), 1-14

Anglicized Words and Misspelled Cognates in Native Language Identification

Markov, I., Nastase, V., Strapparava, C. (2019)

14th Workshop on Innovative Use of NLP for Building Educational Applications .

Discourse-Aware Semantic Self-Attention For Narrative Reading Comprehension

Mihaylov, T., Frank, A. (2019)

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, 2541-2552

Abstract Graphs and Abstract Paths for Knowledge Graph Completion

Nastase, V., Kotnis, B. (2019)

Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), Minneapolis, Minnesota, 147-157

Automatic Reconstruction of Emperor Itineraries from the Regesta Imperii

Opitz, J., Born, L., Nastase, V., Pultar, Y. (2019)

Proceedings of the 3rd Conference for Digital Access to Textual Cultural Heritage (DATeCH), Brussels, Belgium, 39-44

Automatic Accuracy Prediction for AMR Parsing

Opitz, J., Frank, A. (2019)

Proceedings of The Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), 212-223

An Argument-Marker Model for Syntax-Agnostic Proto-Role Labeling

Opitz, J., Frank, A. (2019)

Proceedings of The Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019), 224-234

Dissecting Content and Context in Argumentative Relation Analysis

Opitz, J., Frank, A. (2019)

Proceedings of the Sixth Workshop on Argument Mining, Florence, Italy, 25-34

Ranking and Selecting Multi-Hop Knowledge Paths to Better Predict Human Needs

Paul, D., Frank, A. (2019)

Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics , Minneapolis, Minnesota, USA, 3671-3681

Automatic Alignment and Annotation Projection for Literary Texts


Steinbach, U., Rehbein, I. (2019)

Proceedings of LaTeCH-CLfL, Minneapolis, Minnesota, 35-45

PROJECTS

2021
+ -
ACCEPT: Perspectivized Argument Knowledge Graphs for Deliberation Support (2021 – 2024)

ACCEPT: Perspectivized Argument Knowledge Graphs for Deliberation Support (2021 – 2024)

Joint project between Prof. Anette Frank (ICL, Heidelberg University) and Prof. Philipp Cimiano (University of Bielefeld) within the DFG priority program RATIO: Robust Argumentation Machines

2018
+ -
ExpLAIN: Between the Lines – Knowledge-based Analysis of Argumentation in a formal Argumentation
Inference System (2018 – 2021)

ExpLAIN: Between the Lines – Knowledge-based Analysis of Argumentation in a formal Argumentation Inference System (2018 – 2021)

Joint project between Prof. Anette Frank (ICL, Heidelberg University) and Prof. Heiner Stuckenschmidt (University of Mannheim) within the DFG priority program RATIO: Robust Argumentation Machines

The project will uncover missing explanatory links in argumentative texts, fill in automatically acquired knowledge that makes the structure of the argument explicit and establish and verify the knowledge-enhanced argumentation structure with a combination of formal reasoning and machine learning.

Go to project page
2015
+ -
DFG-Graduiertenkolleg AIPHES „Adaptive Informationsaufbereitung aus heterogenen Quellen“ (2015 – 2021)

DFG-Graduiertenkolleg AIPHES „Adaptive Informationsaufbereitung aus heterogenen Quellen“ (2015 – 2021)

The interdisciplinary research training group AIPHES was launched in April 2015. In a three-year program, 11 PhD candidates, as well as postdoctoral researchers and associated researchers will collaborate under the guiding theme of multi-document summarization of heterogeneous resources. Go to project page
Leibniz ScienceCampus "Empirical Linguistics and Computational Language Learning" (2015 – 2020)

Leibniz ScienceCampus "Empirical Linguistics and Computational Language Learning" (2015 – 2020)

The Leibniz ScienceCampus “Empirical Linguistics and Computational Language Modeling” aims to conduct innovative research to support the high-quality automatic annotation of large-scale corpus resources of German language through induction of domain-, genre- and variety-adaptive natural language processing models, to enable advanced empirical research in linguistics as well as innovative applications in the humanities and the social sciences. Go to project page

RELEASES

DATA

CODE

GitHub

Find our latest code on GitHub

You can find our latest code releases on our Heidelberg-NLP Github page!

Over 23 repositories containing code related to our recent publications.

NLP BLOG

View more Blog Posts