colab Potsdam | publications

(You can find recordings of talks & slides here.)

235 entries, as of April 2025.

2025

Sherzod Hakimov, Yerkezhan Abdullayeva, Kushal Koshti, Antonia Schmidt, Yan Weiser, Anne Beyer, and David Schlangen Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Models Proceedings of the 31st International Conference on Computational Linguistics 2025 [Abs] [PDF]
While the situation has improved for text-only models, it again seems to be the case currently that multimodal (text and image) models develop faster than ways to evaluate them. In this paper, we bring a recently developed evaluation paradigm from text models to multimodal models, namely evaluation through the goal-oriented game (self) play, complementing reference-based and preference-based evaluation. Specifically, we define games that challenge a model‘s capability to represent a situation from visual information and align such representations through dialogue. We find that the largest closed models perform rather well on the games that we define, while even the best open-weight models struggle with them. On further analysis, we find that the exceptional deep captioning capabilities of the largest models drive some of the performance. There is still room to grow for both kinds of models, ensuring the continued relevance of the benchmark.
BibTeX
```
@inproceedings{Hakimov-2025,
  title = {Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Models},
  author = {Hakimov, Sherzod and Abdullayeva, Yerkezhan and Koshti, Kushal and Schmidt, Antonia and Weiser, Yan and Beyer, Anne and Schlangen, David},
  editor = {Rambow, Owen and Wanner, Leo and Apidianaki, Marianna and Al-Khalifa, Hend and Eugenio, Barbara Di and Schockaert, Steven},
  booktitle = {Proceedings of the 31st International Conference on Computational Linguistics},
  month = jan,
  year = {2025},
  address = {Abu Dhabi, UAE},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2025.coling-main.381/},
  pages = {5686--5718}
}
```
Details
Nicola Horst, Davide Mazzaccara, Antonia Schmidt, Michael Sullivan, Filippo Momentè, Luca Franceschetti, Philipp Sadler, Sherzod Hakimov, Alberto Testoni, Raffaella Bernardi, Raquel Fernández, Alexander Koller, Oliver Lemon, David Schlangen, Mario Giulianelli, and Alessandro Suglia Playpen: An Environment for Exploring Learning Through Conversational Interaction 2025 [PDF]
BibTeX
```
@misc{Horst-2025,
  title = {Playpen: An Environment for Exploring Learning Through Conversational Interaction},
  author = {Horst, Nicola and Mazzaccara, Davide and Schmidt, Antonia and Sullivan, Michael and Momentè, Filippo and Franceschetti, Luca and Sadler, Philipp and Hakimov, Sherzod and Testoni, Alberto and Bernardi, Raffaella and Fernández, Raquel and Koller, Alexander and Lemon, Oliver and Schlangen, David and Giulianelli, Mario and Suglia, Alessandro},
  year = {2025},
  eprint = {2504.08590},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2504.08590}
}
```
Details
Filippo Momentè, Alessandro Suglia, Mario Giulianelli, Ambra Ferrari, Alexander Koller, Oliver Lemon, David Schlangen, Raquel Fernández, and Raffaella Bernardi Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests 2025 [PDF]
BibTeX
```
@misc{Momente-2025,
  title = {Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests},
  author = {Momentè, Filippo and Suglia, Alessandro and Giulianelli, Mario and Ferrari, Ambra and Koller, Alexander and Lemon, Oliver and Schlangen, David and Fernández, Raquel and Bernardi, Raffaella},
  year = {2025},
  eprint = {2502.14359},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2502.14359}
}
```
Details
Jonathan Jordan, Sherzod Hakimov, and David Schlangen Plant in Cupboard, Orange on Table, Book on Shelf. Benchmarking Practical Reasoning and Situation Modelling in a Text-Simulated Situated Environment 2025 [PDF]
BibTeX
```
@misc{Jordan-2025,
  title = {Plant in Cupboard, Orange on Table, Book on Shelf. Benchmarking Practical Reasoning and Situation Modelling in a Text-Simulated Situated Environment},
  author = {Jordan, Jonathan and Hakimov, Sherzod and Schlangen, David},
  year = {2025},
  eprint = {2502.11733},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2502.11733}
}
```
Details
Sherzod Hakimov, Lara Pfennigschmidt, and David Schlangen Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models 2025 [PDF]
BibTeX
```
@misc{Hakimov-2025-1,
  title = {Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models},
  author = {Hakimov, Sherzod and Pfennigschmidt, Lara and Schlangen, David},
  year = {2025},
  eprint = {2502.11707},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2502.11707}
}
```
Details

2024

Chalamalasetti Kranti, Sherzod Hakimov, and David Schlangen Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft Findings of the Association for Computational Linguistics: EMNLP 2024 2024 [Abs] [PDF]
In the Minecraft Collaborative Building Task, two players collaborate: an Architect (A) provides instructions to a Builder (B) to assemble a specified structure using 3D blocks. In this work, we investigate the use of large language models (LLMs) to predict the sequence of actions taken by the Builder. Leveraging LLMs’ in-context learning abilities, we use few-shot prompting techniques, that significantly improve performance over baseline methods. Additionally, we present a detailed analysis of the gaps in performance for future work.
BibTeX
```
@inproceedings{Chalamalasetti-2024,
  title = {Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on {M}inecraft},
  author = {Kranti, Chalamalasetti and Hakimov, Sherzod and Schlangen, David},
  editor = {Al-Onaizan, Yaser and Bansal, Mohit and Chen, Yun-Nung},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2024},
  month = nov,
  year = {2024},
  address = {Miami, Florida, USA},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.findings-emnlp.652/},
  doi = {10.18653/v1/2024.findings-emnlp.652},
  pages = {11159--11170}
}
```
Details

Chalamalasetti Kranti, Sherzod Hakimov, and David Schlangen Towards No-Code Programming of Cobots: Experiments with Code Synthesis by Large Code Models for Conversational Programming 2024 [PDF]

BibTeX

@article{Chalamalasetti-2024-1,
  author = {Kranti, Chalamalasetti and Hakimov, Sherzod and Schlangen, David},
  title = {Towards No-Code Programming of Cobots: Experiments with Code Synthesis
                    by Large Code Models for Conversational Programming},
  year = {2024},
  url = {https://doi.org/10.48550/arXiv.2409.11041},
  doi = {10.48550/ARXIV.2409.11041},
  eprinttype = {arXiv},
  eprint = {2409.11041},
  biburl = {https://dblp.org/rec/journals/corr/abs-2409-11041.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}

Details

Luka Borec, Philipp Sadler, and David Schlangen The Unreasonable Ineffectiveness of Nucleus Sampling on Mitigating Text Memorization Proceedings of the 17th International Natural Language Generation Conference 2024 [Abs] [PDF]
This work analyses the text memorization behavior of large language models (LLMs) when subjected to nucleus sampling. Stochastic decoding methods like nucleus sampling are typically applied to overcome issues such as monotonous and repetitive text generation, which are often observed with maximization-based decoding techniques. We hypothesize that nucleus sampling might also reduce the occurrence of memorization patterns, because it could lead to the selection of tokens outside the memorized sequence. To test this hypothesis we create a diagnostic dataset with a known distribution of duplicates that gives us some control over the likelihood of memorisation of certain parts of the training data. Our analysis of two GPT-Neo models fine-tuned on this dataset interestingly shows that (i) an increase of the nucleus size reduces memorization only modestly, and (ii) even when models do not engage in “hard” memorization – a verbatim reproduction of training samples – they may still display “soft” memorization whereby they generate outputs that echo the training data but without a complete one-by-one resemblance.
BibTeX
```
@inproceedings{Borec-2024,
  title = {The Unreasonable Ineffectiveness of Nucleus Sampling on Mitigating Text Memorization},
  author = {Borec, Luka and Sadler, Philipp and Schlangen, David},
  editor = {Mahamood, Saad and Minh, Nguyen Le and Ippolito, Daphne},
  booktitle = {Proceedings of the 17th International Natural Language Generation Conference},
  month = sep,
  year = {2024},
  address = {Tokyo, Japan},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.inlg-main.30},
  pages = {358--370}
}
```
Details
Brielen Madureira, and David Schlangen It Couldn’t Help but Overhear: On the Limits of Modelling Meta-Communicative Grounding Acts with Supervised Learning Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2024 [Abs] [PDF]
Active participation in a conversation is key to building common ground, since understanding is jointly tailored by producers and recipients. Overhearers are deprived of the privilege of performing grounding acts and can only conjecture about intended meanings. Still, data generation and annotation, modelling, training and evaluation of NLP dialogue models place reliance on the overhearing paradigm. How much of the underlying grounding processes are thereby forfeited? As we show, there is evidence pointing to the impossibility of properly modelling human meta-communicative acts with data-driven learning models. In this paper, we discuss this issue and provide a preliminary analysis on the variability of human decisions for requesting clarification. Most importantly, we wish to bring this topic back to the community’s table, encouraging discussion on the consequences of having models designed to only “listen in’”.
BibTeX
```
@inproceedings{Madureira-2024-2,
  title = {It Couldn{'}t Help but Overhear: On the Limits of Modelling Meta-Communicative Grounding Acts with Supervised Learning},
  author = {Madureira, Brielen and Schlangen, David},
  editor = {Kawahara, Tatsuya and Demberg, Vera and Ultes, Stefan and Inoue, Koji and Mehri, Shikib and Howcroft, David and Komatani, Kazunori},
  booktitle = {Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
  month = sep,
  year = {2024},
  address = {Kyoto, Japan},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.sigdial-1.13},
  doi = {10.18653/v1/2024.sigdial-1.13},
  pages = {149--158}
}
```
Details
Isidora Jeknic, David Schlangen, and Alexander Koller A Dialogue Game for Eliciting Balanced Collaboration Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2024 [Abs] [PDF]
Collaboration is an integral part of human dialogue. Typical task-oriented dialogue games assign asymmetric roles to the participants, which limits their ability to elicit naturalistic role-taking in collaboration and its negotiation. We present a novel and simple online setup that favors balanced collaboration: a two-player 2D object placement game in which the players must negotiate the goal state themselves. We show empirically that human players exhibit a variety of role distributions, and that balanced collaboration improves task performance. We also present an LLM-based baseline agent which demonstrates that automatic playing of our game is an interesting challenge for artificial systems.
BibTeX
```
@inproceedings{Jeknic-2024,
  title = {A Dialogue Game for Eliciting Balanced Collaboration},
  author = {Jeknic, Isidora and Schlangen, David and Koller, Alexander},
  editor = {Kawahara, Tatsuya and Demberg, Vera and Ultes, Stefan and Inoue, Koji and Mehri, Shikib and Howcroft, David and Komatani, Kazunori},
  booktitle = {Proceedings of the 25th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
  month = sep,
  year = {2024},
  address = {Kyoto, Japan},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.sigdial-1.41},
  doi = {10.18653/v1/2024.sigdial-1.41},
  pages = {477--489}
}
```
Details
Nidhir Bhavsar, Jonathan Jordan, Sherzod Hakimov, and David Schlangen How Many Parameters Does it Take to Change a Light Bulb? Evaluating Performance in Self-Play of Conversational Games as a Function of Model Characteristics 2024 [PDF]
BibTeX
```
@misc{Bhavsar-2024,
  title = {How Many Parameters Does it Take to Change a Light Bulb? Evaluating Performance in Self-Play of Conversational Games as a Function of Model Characteristics},
  author = {Bhavsar, Nidhir and Jordan, Jonathan and Hakimov, Sherzod and Schlangen, David},
  year = {2024},
  eprint = {2406.14051},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2406.14051}
}
```
Details

Sebastiano Gigliobianco, Dimosthenis Kontogiorgos, and David Schlangen Learning Task-Oriented Dialogues through Various Degrees of Interactivity Proceedings of the 28th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers 2024 [PDF]

BibTeX

@inproceedings{Gigliobianco-2024,
  title = {Learning Task-Oriented Dialogues through Various Degrees of Interactivity},
  author = {Gigliobianco, Sebastiano and Kontogiorgos, Dimosthenis and Schlangen, David},
  booktitle = {Proceedings of the 28th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers},
  month = sep,
  year = {2024},
  address = {Trento, Italy},
  publisher = {SEMDIAL},
  url = {http://semdial.org/anthology/Z24-Gigliobianco_semdial_0003.pdf}
}

Details

Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, André F. T. Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Surikuchi, Ece Takmaz, and Alberto Testoni LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks 2024 [PDF]
BibTeX
```
@misc{Bavaresco-2024,
  title = {LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks},
  author = {Bavaresco, Anna and Bernardi, Raffaella and Bertolazzi, Leonardo and Elliott, Desmond and Fernández, Raquel and Gatt, Albert and Ghaleb, Esam and Giulianelli, Mario and Hanna, Michael and Koller, Alexander and Martins, André F. T. and Mondorf, Philipp and Neplenbroek, Vera and Pezzelle, Sandro and Plank, Barbara and Schlangen, David and Suglia, Alessandro and Surikuchi, Aditya K and Takmaz, Ece and Testoni, Alberto},
  year = {2024},
  eprint = {2406.18403},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  url = {https://arxiv.org/abs/2406.18403}
}
```
Details

David Schlangen LLMs as Function Approximators: Terminology, Taxonomy, and Questions for Evaluation CoRR 2024 [PDF]

BibTeX

@article{Schlangen-2024,
  author = {Schlangen, David},
  title = {LLMs as Function Approximators: Terminology, Taxonomy, and Questions
                    for Evaluation},
  journal = {CoRR},
  volume = {abs/2407.13744},
  year = {2024},
  url = {https://doi.org/10.48550/arXiv.2407.13744},
  doi = {10.48550/ARXIV.2407.13744},
  eprinttype = {arXiv},
  eprint = {2407.13744},
  timestamp = {Thu, 22 Aug 2024 15:43:21 +0200},
  biburl = {https://dblp.org/rec/journals/corr/abs-2407-13744.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}

Details

Brielen Madureira, Patrick Kahardipraja, and David Schlangen When Only Time Will Tell: Interpreting How Transformers Process Local Ambiguities Through the Lens of Restart-Incrementality Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2024 [Abs] [PDF]
Incremental models that process sentences one token at a time will sometimes encounter points where more than one interpretation is possible. Causal models are forced to output one interpretation and continue, whereas models that can revise may edit their previous output as the ambiguity is resolved. In this work, we look at how restart-incremental Transformers build and update internal states, in an effort to shed light on what processes cause revisions not viable in autoregressive models. We propose an interpretable way to analyse the incremental states, showing that their sequential structure encodes information on the garden path effect and its resolution. Our method brings insights on various bidirectional encoders for contextualised meaning representation and dependency parsing, contributing to show their advantage over causal models when it comes to revisions.
BibTeX
```
@inproceedings{Madureira-2024-1,
  title = {When Only Time Will Tell: Interpreting How Transformers Process Local Ambiguities Through the Lens of Restart-Incrementality},
  author = {Madureira, Brielen and Kahardipraja, Patrick and Schlangen, David},
  editor = {Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek},
  booktitle = {Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  month = aug,
  year = {2024},
  address = {Bangkok, Thailand},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.acl-long.260},
  doi = {10.18653/v1/2024.acl-long.260},
  pages = {4722--4749}
}
```
Details
Meng Li, David Schlangen, and Dietrich Klakow Learning Part-whole Hierarchies from the Sequence of Handwriting Proceedings of the Annual Meeting of the Cognitive Science Society 2024 [PDF]
BibTeX
```
@inproceedings{Li-2024,
  title = {Learning Part-whole Hierarchies from the Sequence of Handwriting},
  author = {Li, Meng and Schlangen, David and Klakow, Dietrich},
  booktitle = {Proceedings of the Annual Meeting of the Cognitive Science Society},
  volume = {46},
  year = {2024},
  url = {https://escholarship.org/uc/item/3nd295nf},
  pages = {2316-2323}
}
```
Details
Pelin Çelikkol, David Schlangen, and Jochen Laubrock Effects of Eye Movement Patterns and Scene-Object Relations on Description Production Proceedings of the Annual Meeting of the Cognitive Science Society 2024 [PDF]
BibTeX
```
@inproceedings{Celikkol-2024,
  title = {Effects of Eye Movement Patterns and Scene-Object Relations on Description Production},
  author = {{\c{C}}elikkol, Pelin and Schlangen, David and Laubrock, Jochen},
  booktitle = {Proceedings of the Annual Meeting of the Cognitive Science Society},
  volume = {46},
  pages = {4886--4892},
  url = {https://escholarship.org/uc/item/7485r3f1},
  year = {2024}
}
```
Details
Anne Beyer, Kranti Chalamalasetti, Sherzod Hakimov, Brielen Madureira, Philipp Sadler, and David Schlangen clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents 2024 [PDF]
BibTeX
```
@misc{Beyer-2024,
  title = {clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents},
  author = {Beyer, Anne and Chalamalasetti, Kranti and Hakimov, Sherzod and Madureira, Brielen and Sadler, Philipp and Schlangen, David},
  year = {2024},
  eprint = {2405.20859},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL}
}
```
Details
Sherzod Hakimov, and Gullal S. Cheema Unveiling Global Narratives: A Multilingual Twitter Dataset of News Media on the Russo-Ukrainian Conflict Proceedings of the 2024 International Conference on Multimedia Retrieval 2024 [Abs] [PDF]
The ongoing Russo-Ukrainian conflict has been a subject of intense media coverage worldwide. Understanding the global narrative surrounding this topic is crucial for researchers that aim to gain insights into its multifaceted dimensions. In this paper, we present a novel multimedia dataset that focuses on this topic by collecting and processing tweets posted by news or media companies on social media across the globe. We collected tweets from February 2022 to May 2023 to acquire approximately 1.5 million tweets in 60 different languages along with their images. Each entry in the dataset is accompanied by processed tags, allowing for the identification of entities, stances, textual or visual concepts, and sentiment. The availability of this multimedia dataset serves as a valuable resource for researchers aiming to investigate the global narrative surrounding the ongoing conflict from various aspects such as who are the prominent entities involved, what stances are taken, where do these stances originate from, how are the different textual and visual concepts related to the event portrayed.
BibTeX
```
@inproceedings{Hakimov-2024-1,
  author = {Hakimov, Sherzod and Cheema, Gullal S.},
  title = {Unveiling Global Narratives: A Multilingual Twitter Dataset of News Media on the Russo-Ukrainian Conflict},
  year = {2024},
  isbn = {9798400706196},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3652583.3657622},
  doi = {10.1145/3652583.3657622},
  booktitle = {Proceedings of the 2024 International Conference on Multimedia Retrieval},
  pages = {1160–1164},
  numpages = {5},
  keywords = {multilingual twitter narrative, multimedia news discourse, russo-ukrainian conflict},
  location = {Phuket, Thailand},
  series = {ICMR '24}
}
```
Details
Philipp Sadler, Sherzod Hakimov, and David Schlangen Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policies Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) 2024 [Abs] [PDF]
In collaborative goal-oriented settings, the participants are not only interested in achieving a successful outcome, but do also implicitly negotiate the effort they put into the interaction (by adapting to each other). In this work, we propose a challenging interactive reference game that requires two players to coordinate on vision and language observations. The learning signal in this game is a score (given after playing) that takes into account the achieved goal and the players’ assumed efforts during the interaction. We show that a standard Proximal Policy Optimization (PPO) setup achieves a high success rate when bootstrapped with heuristic partner behaviors that implement insights from the analysis of human-human interactions. And we find that a pairing of neural partners indeed reduces the measured joint effort when playing together repeatedly. However, we observe that in comparison to a reasonable heuristic pairing there is still room for improvement—which invites further research in the direction of cost-sharing in collaborative interactions.
BibTeX
```
@inproceedings{Sadler-2024-1,
  title = {Sharing the Cost of Success: A Game for Evaluating and Learning Collaborative Multi-Agent Instruction Giving and Following Policies},
  author = {Sadler, Philipp and Hakimov, Sherzod and Schlangen, David},
  editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen},
  booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
  month = may,
  year = {2024},
  address = {Torino, Italia},
  publisher = {ELRA and ICCL},
  url = {https://aclanthology.org/2024.lrec-main.1287},
  pages = {14770--14783}
}
```
Details
Gaurish Thakkar, Sherzod Hakimov, and Marko Tadić M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) 2024 [Abs] [PDF]
In recent years, multimodal natural language processing, aimed at learning from diverse data types, has garnered significant attention. However, there needs to be more clarity when it comes to analysing multimodal tasks in multi-lingual contexts. While prior studies on sentiment analysis of tweets have predominantly focused on the English language, this paper addresses this gap by transforming an existing textual Twitter sentiment dataset into a multimodal format through a straightforward curation process. Our work opens up new avenues for sentiment-related research within the research community. Additionally, we conduct baseline experiments utilising this augmented dataset and report the findings. Notably, our evaluations reveal that when comparing unimodal and multimodal configurations, using a sentiment-tuned large language model as a text encoder performs exceptionally well.
BibTeX
```
@inproceedings{Thakkar-2024,
  title = {{M}2{SA}: Multimodal and Multilingual Model for Sentiment Analysis of Tweets},
  author = {Thakkar, Gaurish and Hakimov, Sherzod and Tadi{\'c}, Marko},
  editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen},
  booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
  month = may,
  year = {2024},
  address = {Torino, Italia},
  publisher = {ELRA and ICCL},
  url = {https://aclanthology.org/2024.lrec-main.946/},
  pages = {10833--10845}
}
```
Details
Julian Hough, Sina Zarrieß, Casey Kennington, David Schlangen, and Massimo Poesio Conceptual Pacts for Reference Resolution Using Small, Dynamically Constructed Language Models: A Study in Puzzle Building Dialogues Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) 2024 [Abs] [PDF]
Using Brennan and Clark’s theory of a Conceptual Pact, that when interlocutors agree on a name for an object, they are forming a temporary agreement on how to conceptualize that object, we present an extension to a simple reference resolver which simulates this process over time with different conversation pairs. In a puzzle construction domain, we model pacts with small language models for each referent which update during the interaction. When features from these pact models are incorporated into a simple bag-of-words reference resolver, the accuracy increases compared to using a standard pre-trained model. The model performs equally to a competitor using the same data but with exhaustive re-training after each prediction, while also being more transparent, faster and less resource-intensive. We also experiment with reducing the number of training interactions, and can still achieve reference resolution accuracies of over 80% in testing from observing a single previous interaction, over 20% higher than a pre-trained baseline. While this is a limited domain, we argue the model could be applicable to larger real-world applications in human and human-robot interaction and is an interpretable and transparent model.
BibTeX
```
@inproceedings{Hough-2024,
  title = {Conceptual Pacts for Reference Resolution Using Small, Dynamically Constructed Language Models: A Study in Puzzle Building Dialogues},
  author = {Hough, Julian and Zarrie{\ss}, Sina and Kennington, Casey and Schlangen, David and Poesio, Massimo},
  editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen},
  booktitle = {Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
  month = may,
  year = {2024},
  address = {Torino, Italia},
  publisher = {ELRA and ICCL},
  url = {https://aclanthology.org/2024.lrec-main.327},
  pages = {3689--3699}
}
```
Details
Brielen Madureira, and David Schlangen Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests Proceedings of the Third Workshop on Understanding Implicit and Underspecified Language 2024 [Abs] [PDF]
Clarification requests are a mechanism to help solve communication problems, e.g. due to ambiguity or underspecification, in instruction-following interactions. Despite their importance, even skilful models struggle with producing or interpreting such repair acts. In this work, we test three hypotheses concerning the effects of action taking as an auxiliary task in modelling iCR policies. Contrary to initial expectations, we conclude that its contribution to learning an iCR policy is limited, but some information can still be extracted from prediction uncertainty. We present further evidence that even well-motivated, Transformer-based models fail to learn good policies for when to ask Instruction CRs (iCRs), while the task of determining what to ask about can be more successfully modelled. Considering the implications of these findings, we further discuss the shortcomings of the data-driven paradigm for learning meta-communication acts.
BibTeX
```
@inproceedings{Madureira-2024,
  title = {Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests},
  author = {Madureira, Brielen and Schlangen, David},
  editor = {Pyatkin, Valentina and Fried, Daniel and Stengel-Eskin, Elias and Stengel-Eskin, Elias and Liu, Alisa and Pezzelle, Sandro},
  booktitle = {Proceedings of the Third Workshop on Understanding Implicit and Underspecified Language},
  month = mar,
  year = {2024},
  address = {Malta},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.unimplicit-1.1},
  pages = {1--21}
}
```
Details
Sherzod Hakimov, Yan Weiser, and David Schlangen Evaluating Modular Dialogue System for Form Filling Using Large Language Models Proceedings of the 1st Workshop on Simulating Conversational Intelligence in Chat (SCI-CHAT 2024) 2024 [Abs] [PDF]
This paper introduces a novel approach to form-filling and dialogue system evaluation by leveraging Large Language Models (LLMs). The proposed method establishes a setup wherein multiple modules collaborate on addressing the form-filling task. The dialogue system is constructed on top of LLMs, focusing on defining specific roles for individual modules. We show that using multiple independent sub-modules working cooperatively on this task can improve performance and handle the typical constraints of using LLMs, such as context limitations. The study involves testing the modular setup on four selected forms of varying topics and lengths, employing commercial and open-access LLMs. The experimental results demonstrate that the modular setup consistently outperforms the baseline, showcasing the effectiveness of this approach. Furthermore, our findings reveal that open-access models perform comparably to commercial models for the specified task.
BibTeX
```
@inproceedings{Hakimov-2024,
  title = {Evaluating Modular Dialogue System for Form Filling Using Large Language Models},
  author = {Hakimov, Sherzod and Weiser, Yan and Schlangen, David},
  editor = {Graham, Yvette and Liu, Qun and Lampouras, Gerasimos and Iacobacci, Ignacio and Madden, Sinead and Khalid, Haider and Qureshi, Rameez},
  booktitle = {Proceedings of the 1st Workshop on Simulating Conversational Intelligence in Chat (SCI-CHAT 2024)},
  month = mar,
  year = {2024},
  address = {St. Julians, Malta},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.scichat-1.4},
  pages = {36--52}
}
```
Details
Philipp Sadler, Sherzod Hakimov, and David Schlangen Learning Communication Policies for Different Follower Behaviors in a Collaborative Reference Game Proceedings of the 4th Workshop on Spatial Language Understanding and Grounded Communication for Robotics (SpLU-RoboNLP 2024) 2024 [Abs] [PDF]
In this work, we evaluate the adaptability of neural agents towards assumed partner behaviors in a collaborative reference game. In this game, success is achieved when a knowledgeable guide can verbally lead a follower to the selection of a specific puzzle piece among several distractors. We frame this language grounding and coordination task as a reinforcement learning problem and measure to which extent a common reinforcement training algorithm (PPO) is able to produce neural agents (the guides) that perform well with various heuristic follower behaviors that vary along the dimensions of confidence and autonomy. We experiment with a learning signal that in addition to the goal condition also respects an assumed communicative effort. Our results indicate that this novel ingredient leads to communicative strategies that are less verbose (staying silent in some of the steps) and that with respect to that the guide’s strategies indeed adapt to the partner’s level of confidence and autonomy.
BibTeX
```
@inproceedings{Sadler-2024,
  title = {Learning Communication Policies for Different Follower Behaviors in a Collaborative Reference Game},
  author = {Sadler, Philipp and Hakimov, Sherzod and Schlangen, David},
  editor = {Kordjamshidi, Parisa and Wang, Xin Eric and Zhang, Yue and Ma, Ziqiao and Inan, Mert},
  booktitle = {Proceedings of the 4th Workshop on Spatial Language Understanding and Grounded Communication for Robotics (SpLU-RoboNLP 2024)},
  month = aug,
  year = {2024},
  address = {Bangkok, Thailand},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2024.splurobonlp-1.2},
  pages = {17--29}
}
```
Details

2023

Kranti Chalamalasetti, Jana Götze, Sherzod Hakimov, Brielen Madureira, Philipp Sadler, and David Schlangen clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing 2023 [Abs] [PDF]
Recent work has proposed a methodology for the systematic evaluation of “Situated Language Understanding Agents” — agents that operate in rich linguistic and non-linguistic contexts — through testing them in carefully constructed interactive settings. Other recent work has argued that Large Language Models (LLMs), if suitably set up, can be understood as (simulators of) such agents. A connection suggests itself, which this paper explores: Can LLMs be evaluated meaningfully by exposing them to constrained game-like settings that are built to challenge specific capabilities? As a proof of concept, this paper investigates five interaction settings, showing that current chat-optimised LLMs are, to an extent, capable of following game-play instructions. Both this capability and the quality of the game play, measured by how well the objectives of the different games are met, follows the development cycle, with newer models generally performing better. The metrics even for the comparatively simple example games are far from being saturated, suggesting that the proposed instrument will remain to have diagnostic value.
BibTeX
```
@inproceedings{Chalamalasetti-2023,
  title = {clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents},
  author = {Chalamalasetti, Kranti and G{\"o}tze, Jana and Hakimov, Sherzod and Madureira, Brielen and Sadler, Philipp and Schlangen, David},
  editor = {Bouamor, Houda and Pino, Juan and Bali, Kalika},
  booktitle = {Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing},
  month = dec,
  year = {2023},
  address = {Singapore},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.emnlp-main.689},
  doi = {10.18653/v1/2023.emnlp-main.689},
  pages = {11174--11219}
}
```
Details
David Schlangen On General Language Understanding Findings of the Association for Computational Linguistics: EMNLP 2023 2023 [Abs] [PDF]
Natural Language Processing prides itself to be an empirically-minded, if not outright empiricist field, and yet lately it seems to get itself into essentialist debates on issues of meaning and measurement (“Do Large Language Models Understand Language, And If So, How Much?”). This is not by accident: Here, as everywhere, the evidence underspecifies the understanding. As a remedy, this paper sketches the outlines of a model of understanding, which can ground questions of the adequacy of current methods of measurement of model quality. The paper makes three claims: A) That different language use situation types have different characteristics, B) That language understanding is a multifaceted phenomenon, bringing together individualistic and social processes, and C) That the choice of Understanding Indicator marks the limits of benchmarking, and the beginnings of considerations of the ethics of NLP use.
BibTeX
```
@inproceedings{Schlangen-2023-2,
  title = {On General Language Understanding},
  author = {Schlangen, David},
  editor = {Bouamor, Houda and Pino, Juan and Bali, Kalika},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2023},
  month = dec,
  year = {2023},
  address = {Singapore},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.findings-emnlp.591},
  doi = {10.18653/v1/2023.findings-emnlp.591},
  pages = {8818--8825}
}
```
Details
Brielen Madureira, Pelin Çelikkol, and David Schlangen Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL) 2023 [Abs] [PDF]
In NLP, incremental processors produce output in instalments, based on incoming prefixes of the linguistic input. Some tokens trigger revisions, causing edits to the output hypothesis, but little is known about why models revise when they revise. A policy that detects the time steps where revisions should happen can improve efficiency. Still, retrieving a suitable signal to train a revision policy is an open problem, since it is not naturally available in datasets. In this work, we investigate the appropriateness of regressions and skips in human reading eye-tracking data as signals to inform revision policies in incremental sequence labelling. Using generalised mixed-effects models, we find that the probability of regressions and skips by humans can potentially serve as useful predictors for revisions in BiLSTMs and Transformer models, with consistent results for various languages.
BibTeX
```
@inproceedings{Madureira-2023-4,
  title = {Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing},
  author = {Madureira, Brielen and {\c{C}}elikkol, Pelin and Schlangen, David},
  editor = {Jiang, Jing and Reitter, David and Deng, Shumin},
  booktitle = {Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL)},
  month = dec,
  year = {2023},
  address = {Singapore},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.conll-1.22},
  doi = {10.18653/v1/2023.conll-1.22},
  pages = {335--351}
}
```
Details

Jana Götze, and David Schlangen “Why Do You Say So?” Dialogical Classification Explanations in the Wild and Elicited Through Classification Games Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers 2023 [PDF]

BibTeX

@inproceedings{Goetze-2023,
  title = {``Why Do You Say So?'' Dialogical Classification Explanations in the Wild and Elicited Through Classification Games},
  author = {G{\"o}tze, Jana and Schlangen, David},
  booktitle = {Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers},
  month = aug,
  year = {2023},
  address = {Maribor, Slovenia},
  publisher = {SEMDIAL},
  url = {http://semdial.org/anthology/Z23-Gotze_semdial_0009.pdf}
}

Details

Pelin Çelikkol, Jochen Laubrock, and David Schlangen TF-IDF Based Scene-Object Relations Correlate With Visual Attention Proceedings of the 2023 Symposium on Eye Tracking Research and Applications 2023 [Abs] [PDF]
The relative contribution of bottom-up and top-down attentional guidance is a central topic in vision research. Whereas attention is guided bottom-up by low-level saliency, top-down guidance involves the viewer’s knowledge and expectations accumulated throughout a lifetime. Here we explore the influence of high-level scene-object relations on viewing behavior. To assess top-down guidance, we score the relevance of linguistic object labels using methods from document analysis. Specifically, we computed the term frequency-inverse document frequency (TF-IDF), a statistic that reflects how important a term is to a document. We use object TF-IDF to measure how important a specific object is to a scene category and use these scores to predict eye movement distributions over scenes. Our results show that scene-specific objects are more likely to be fixated. Object TF-IDF had an effect partially independent of image saliency, suggesting that an object’s relevance for a scene category affects attention during scene perception.
BibTeX
```
@inproceedings{Celikkol-2023,
  author = {\c{C}elikkol, Pelin and Laubrock, Jochen and Schlangen, David},
  title = {TF-IDF Based Scene-Object Relations Correlate With Visual Attention},
  year = {2023},
  isbn = {9798400701504},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3588015.3588415},
  doi = {10.1145/3588015.3588415},
  booktitle = {Proceedings of the 2023 Symposium on Eye Tracking Research and Applications},
  articleno = {21},
  numpages = {6},
  keywords = {scene perception, eye tracking, attention, document analysis, statistics},
  location = {Tubingen, Germany},
  series = {ETRA '23}
}
```
Details
Brielen Madureira, Patrick Kahardipraja, and David Schlangen The Road to Quality is Paved with Good Revisions: A Detailed Evaluation Methodology for Revision Policies in Incremental Sequence Labelling Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2023 [Abs] [PDF]
Incremental dialogue model components produce a sequence of output prefixes based on incoming input. Mistakes can occur due to local ambiguities or to wrong hypotheses, making the ability to revise past outputs a desirable property that can be governed by a policy. In this work, we formalise and characterise edits and revisions in incremental sequence labelling and propose metrics to evaluate revision policies. We then apply our methodology to profile the incremental behaviour of three Transformer-based encoders in various tasks, paving the road for better revision policies.
BibTeX
```
@inproceedings{Madureira-2023-3,
  title = {The Road to Quality is Paved with Good Revisions: A Detailed Evaluation Methodology for Revision Policies in Incremental Sequence Labelling},
  author = {Madureira, Brielen and Kahardipraja, Patrick and Schlangen, David},
  editor = {Stoyanchev, Svetlana and Joty, Shafiq and Schlangen, David and Dusek, Ondrej and Kennington, Casey and Alikhani, Malihe},
  booktitle = {Proceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
  month = sep,
  year = {2023},
  address = {Prague, Czechia},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.sigdial-1.14},
  doi = {10.18653/v1/2023.sigdial-1.14},
  pages = {156--167}
}
```
Details

Brielen Madureira, and David Schlangen “Are you telling me to put glasses on the dog?” Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue - Poster Abstracts 2023 [PDF]

BibTeX

@inproceedings{Madureira-2023-2,
  title = {``Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset},
  author = {Madureira, Brielen and Schlangen, David},
  booktitle = {Proceedings of the 27th Workshop on the Semantics and Pragmatics of Dialogue - Poster Abstracts},
  month = aug,
  year = {2023},
  address = {Maribor, Slovenia},
  publisher = {SEMDIAL}
}

Details

Brielen Madureira, and David Schlangen "Are you telling me to put glasses on the dog?” Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset [full version] 2023 [PDF]

BibTeX

@misc{Madureira-2023-1,
  title = {"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset [full version]},
  author = {Madureira, Brielen and Schlangen, David},
  year = {2023},
  eprint = {2306.02377},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL}
}

Details

Sherzod Hakimov, and David Schlangen Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks Findings of the Association for Computational Linguistics: ACL 2023 2023 [Abs] [PDF]
Large language models have demonstrated robust performance on various language tasks using zero-shot or few-shot learning paradigms. While being actively researched, multimodal models that can additionally handle images as input have yet to catch up in size and generality with language-only models. In this work, we ask whether language-only models can be utilised for tasks that require visual input – but also, as we argue, often require a strong reasoning component. Similar to some recent related work, we make visual information accessible to the language model using separate verbalisation models. Specifically, we investigate the performance of open-source, open-access language models against GPT-3 on five vision-language tasks when given textually-encoded visual information. Our results suggest that language models are effective for solving vision-language tasks even with limited samples. This approach also enhances the interpretability of a model’s output by providing a means of tracing the output back through the verbalised image content.
BibTeX
```
@inproceedings{Hakimov-2023,
  title = {Images in Language Space: Exploring the Suitability of Large Language Models for Vision {\&} Language Tasks},
  author = {Hakimov, Sherzod and Schlangen, David},
  editor = {Rogers, Anna and Boyd-Graber, Jordan and Okazaki, Naoaki},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2023},
  month = jul,
  year = {2023},
  address = {Toronto, Canada},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.findings-acl.894},
  doi = {10.18653/v1/2023.findings-acl.894},
  pages = {14196--14210}
}
```
Details
Patrick Kahardipraja, Brielen Madureira, and David Schlangen TAPIR: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model Findings of the Association for Computational Linguistics: ACL 2023 2023 [Abs] [PDF]
Language is by its very nature incremental in how it is produced and processed. This property can be exploited by NLP systems to produce fast responses, which has been shown to be beneficial for real-time interactive applications. Recent neural network-based approaches for incremental processing mainly use RNNs or Transformers. RNNs are fast but monotonic (cannot correct earlier output, which can be necessary in incremental processing). Transformers, on the other hand, consume whole sequences, and hence are by nature non-incremental. A restart-incremental interface that repeatedly passes longer input prefixes can be used to obtain partial outputs, while providing the ability to revise. However, this method becomes costly as the sentence grows longer. In this work, we propose the Two-pass model for AdaPtIve Revision (TAPIR) and introduce a method to obtain an incremental supervision signal for learning an adaptive revision policy. Experimental results on sequence labelling show that our model has better incremental performance and faster inference speed compared to restart-incremental Transformers, while showing little degradation on full sequences.
BibTeX
```
@inproceedings{Kahardipraja-2023,
  title = {{TAPIR}: Learning Adaptive Revision for Incremental Natural Language Understanding with a Two-Pass Model},
  author = {Kahardipraja, Patrick and Madureira, Brielen and Schlangen, David},
  editor = {Rogers, Anna and Boyd-Graber, Jordan and Okazaki, Naoaki},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2023},
  month = jul,
  year = {2023},
  address = {Toronto, Canada},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.findings-acl.257},
  doi = {10.18653/v1/2023.findings-acl.257},
  pages = {4173--4197}
}
```
Details
Philipp Sadler, Sherzod Hakimov, and David Schlangen Yes, this Way! Learning to Ground Referring Expressions into Actions with Intra-episodic Feedback from Supportive Teachers Findings of the Association for Computational Linguistics: ACL 2023 2023 [Abs] [PDF]
The ability to pick up on language signals in an ongoing interaction is crucial for future machine learning models to collaborate and interact with humans naturally. In this paper, we present an initial study that evaluates intra-episodic feedback given in a collaborative setting. We use a referential language game as a controllable example of a task-oriented collaborative joint activity. A teacher utters a referring expression generated by a well-known symbolic algorithm (the “Incremental Algorithm”) as an initial instruction and then monitors the follower’s actions to possibly intervene with intra-episodic feedback (which does not explicitly have to be requested). We frame this task as a reinforcement learning problem with sparse rewards and learn a follower policy for a heuristic teacher. Our results show that intra-episodic feedback allows the follower to generalize on aspects of scene complexity and performs better than providing only the initial statement.
BibTeX
```
@inproceedings{Sadler-2023-1,
  title = {Yes, this Way! Learning to Ground Referring Expressions into Actions with Intra-episodic Feedback from Supportive Teachers},
  author = {Sadler, Philipp and Hakimov, Sherzod and Schlangen, David},
  editor = {Rogers, Anna and Boyd-Graber, Jordan and Okazaki, Naoaki},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2023},
  month = jul,
  year = {2023},
  address = {Toronto, Canada},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.findings-acl.587},
  doi = {10.18653/v1/2023.findings-acl.587},
  pages = {9228--9239}
}
```
Details
Brielen Madureira, and David Schlangen Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics 2023 [Abs] [PDF]
In visual instruction-following dialogue games, players can engage in repair mechanisms in face of an ambiguous or underspecified instruction that cannot be fully mapped to actions in the world. In this work, we annotate Instruction Clarification Requests (iCRs) in CoDraw, an existing dataset of interactions in a multimodal collaborative dialogue game. We show that it contains lexically and semantically diverse iCRs being produced self-motivatedly by players deciding to clarify in order to solve the task successfully. With 8.8k iCRs found in 9.9k dialogues, CoDraw-iCR (v1) is a large spontaneous iCR corpus, making it a valuable resource for data-driven research on clarification in dialogue. We then formalise and provide baseline models for two tasks: Determining when to make an iCR and how to recognise them, in order to investigate to what extent these tasks are learnable from data.
BibTeX
```
@inproceedings{Madureira-2023,
  title = {Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the {C}o{D}raw Dataset},
  author = {Madureira, Brielen and Schlangen, David},
  editor = {Vlachos, Andreas and Augenstein, Isabelle},
  booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics},
  month = may,
  year = {2023},
  address = {Dubrovnik, Croatia},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.eacl-main.169},
  doi = {10.18653/v1/2023.eacl-main.169},
  pages = {2303--2319}
}
```
Details
Philipp Sadler, and David Schlangen Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics 2023 [Abs] [PDF]
NLP tasks are typically defined extensionally through datasets containing example instantiations (e.g., pairs of image _i_ and text _t_), but motivated intensionally through capabilities invoked in verbal descriptions of the task (e.g., “_t_ is a description of _i_, for which the content of _i_ needs to be recognised and understood”).We present Pento-DIARef, a diagnostic dataset in a visual domain of puzzle pieces where referring expressions are generated by a well-known symbolic algorithm (the “Incremental Algorithm”),which itself is motivated by appeal to a hypothesised capability (eliminating distractors through application of Gricean maxims). Our question then is whether the extensional description (the dataset) is sufficient for a neural model to pick up the underlying regularity and exhibit this capability given the simple task definition of producing expressions from visual inputs. We find that a model supported by a vision detection step and a targeted data generation scheme achieves an almost perfect BLEU@1 score and sentence accuracy, whereas simpler baselines do not.
BibTeX
```
@inproceedings{Sadler-2023,
  title = {Pento-{DIAR}ef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples},
  author = {Sadler, Philipp and Schlangen, David},
  editor = {Vlachos, Andreas and Augenstein, Isabelle},
  booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics},
  month = may,
  year = {2023},
  address = {Dubrovnik, Croatia},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2023.eacl-main.154},
  doi = {10.18653/v1/2023.eacl-main.154},
  pages = {2106--2122}
}
```
Details

David Schlangen Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategy CoRR 2023 [PDF]

BibTeX

@article{Schlangen-2023-1,
  author = {Schlangen, David},
  title = {Dialogue Games for Benchmarking Language Understanding: Motivation,
                    Taxonomy, Strategy},
  journal = {CoRR},
  volume = {abs/2304.07007},
  year = {2023},
  url = {https://doi.org/10.48550/arXiv.2304.07007},
  doi = {10.48550/arXiv.2304.07007},
  eprinttype = {arXiv},
  eprint = {2304.07007},
  timestamp = {Wed, 19 Apr 2023 12:42:23 +0200},
  biburl = {https://dblp.org/rec/journals/corr/abs-2304-07007.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen What A Situated Language-Using Agent Must be Able to Do: A Top-Down Analysis CoRR 2023 [PDF]

BibTeX

@article{Schlangen-2023,
  author = {Schlangen, David},
  title = {What {A} Situated Language-Using Agent Must be Able to Do: {A} Top-Down
                    Analysis},
  journal = {CoRR},
  volume = {abs/2302.08590},
  year = {2023},
  url = {https://doi.org/10.48550/arXiv.2302.08590},
  doi = {10.48550/arXiv.2302.08590},
  eprinttype = {arXiv},
  eprint = {2302.08590},
  timestamp = {Thu, 23 Feb 2023 16:02:44 +0100},
  biburl = {https://dblp.org/rec/journals/corr/abs-2302-08590.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Mark Dingemanse, Andreas Liesenfeld, Marlou Rasenberg, Saul Albert, Felix K. Ameka, Abeba Birhane, Dimitris Bolis, Justine Cassell, Rebecca Clift, Elena Cuffari, Hanne De Jaegher, Catarina Dutilh Novaes, N. J. Enfield, Riccardo Fusaroli, Eleni Gregoromichelaki, Edwin Hutchins, Ivana Konvalinka, Damian Milton, Joanna Rączaszek-Leonardi, Vasudevi Reddy, Federico Rossano, David Schlangen, Johanna Seibt, Elizabeth Stokoe, Lucy Suchman, Cordula Vesper, Thalia Wheatley, and Martina Wiltschko Beyond Single-Mindedness: A Figure-Ground Reversal for the Cognitive Sciences Cognitive Science 2023 [Abs] [PDF]
Abstract A fundamental fact about human minds is that they are never truly alone: all minds are steeped in situated interaction. That social interaction matters is recognized by any experimentalist who seeks to exclude its influence by studying individuals in isolation. On this view, interaction complicates cognition. Here, we explore the more radical stance that interaction co-constitutes cognition: that we benefit from looking beyond single minds toward cognition as a process involving interacting minds. All around the cognitive sciences, there are approaches that put interaction center stage. Their diverse and pluralistic origins may obscure the fact that collectively, they harbor insights and methods that can respecify foundational assumptions and fuel novel interdisciplinary work. What might the cognitive sciences gain from stronger interactional foundations? This represents, we believe, one of the key questions for the future. Writing as a transdisciplinary collective assembled from across the classic cognitive science hexagon and beyond, we highlight the opportunity for a figure-ground reversal that puts interaction at the heart of cognition. The interactive stance is a way of seeing that deserves to be a key part of the conceptual toolkit of cognitive scientists.
BibTeX
```
@article{Dingemanse-2023,
  author = {Dingemanse, Mark and Liesenfeld, Andreas and Rasenberg, Marlou and Albert, Saul and Ameka, Felix K. and Birhane, f, Abeba and Bolis, Dimitris and Cassell, Justine and Clift, Rebecca and Cuffari, Elena and De Jaegher, Hanne and Novaes, Catarina Dutilh and Enfield, N. J. and Fusaroli, Riccardo and Gregoromichelaki, Eleni and Hutchins, Edwin and Konvalinka, Ivana and Milton, Damian and Rączaszek-Leonardi, Joanna and Reddy, Vasudevi and Rossano, Federico and Schlangen, David and Seibt, Johanna and Stokoe, Elizabeth and Suchman, Lucy and Vesper, Cordula and Wheatley, Thalia and Wiltschko, Martina},
  title = {Beyond Single-Mindedness: A Figure-Ground Reversal for the Cognitive Sciences},
  journal = {Cognitive Science},
  volume = {47},
  number = {1},
  pages = {e13230},
  keywords = {Interaction, Cognitive science, Pluralism, Interdisciplinarity, Social interaction},
  doi = {https://doi.org/10.1111/cogs.13230},
  url = {https://onlinelibrary.wiley.com/doi/abs/10.1111/cogs.13230},
  eprint = {https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.13230},
  year = {2023},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2022

Isabel Donya Meywirth, and Jana Götze Can you tell that I’m confused? An overhearer study for German backchannels by an embodied agent Companion Publication of the 2022 International Conference on Multimodal Interaction 2022 [Abs] [PDF]
In spoken interaction, humans constantly display and interpret each others’ state of understanding. For an embodied agent, displaying its internal state of understanding in an efficient manner can be an important means for making a user-interaction more natural and initiate error recovery as early as possible. We carry out an overhearer study with 62 participants to investigate whether German verbal and non-verbal backchannels by the virtual Furhat embodied agent can be interpreted by an overhearer of a human-robot conversation. We compare three positive, three negative, and one neutral feedback reaction. We find that even though it is difficult to generate certain verbal backchannels, our participants can recognize displays of understanding with an accuracy of up to 0.92. Trying to communicate a lack of understanding is more often misunderstood (accuracy: 0.55), meaning that interaction designers need to carefully craft them in order to be useful for the interaction flow.
BibTeX
```
@inproceedings{Meywirth-2022,
  address = {New York, NY, USA},
  series = {{ICMI} '22 {Companion}},
  title = {Can you tell that {I}’m confused? {An} overhearer study for {German} backchannels by an embodied agent},
  isbn = {978-1-4503-9389-8},
  shorttitle = {Can you tell that {I}’m confused?},
  url = {https://doi.org/10.1145/3536220.3558804},
  doi = {10.1145/3536220.3558804},
  urldate = {2022-12-06},
  booktitle = {Companion {Publication} of the 2022 {International} {Conference} on {Multimodal} {Interaction}},
  publisher = {Association for Computing Machinery},
  author = {Meywirth, Isabel Donya and Götze, Jana},
  month = nov,
  year = {2022},
  keywords = {backchannels, grounding in conversation, human-robot interaction, listener responses, social virtual agents},
  pages = {89--93},
  file = {Meywirth and Götze - 2022 - Can you tell that I’m confused An overhearer stud.pdf:/Users/jana/work/BIBLIOGRAPHY/zotero/storage/IL8KC96P/Meywirth and Götze - 2022 - Can you tell that I’m confused An overhearer stud.pdf:application/pdf},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Sharid Loáiciga, Simon Dobnik, and David Schlangen Anaphoric Phenomena in Situated dialog: A First Round of Annotations Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference 2022 [Abs] [PDF]
We present a first release of 500 documents from the multimodal corpus Tell-me-more (Ilinykh et al., 2019) annotated with coreference information according to the ARRAU guidelines (Poesio et al., 2021). The corpus consists of images and short texts of five sentences. We describe the annotation process and present the adaptations to the original guidelines in order to account for the challenges of grounding the annotations to the image. 50 documents from the 500 available are annotated by two people and used to estimate inter-annotator agreement (IAA) relying on Krippendorff’s alpha.
BibTeX
```
@inproceedings{Loaiciga-2022-1,
  title = {Anaphoric Phenomena in Situated dialog: A First Round of Annotations},
  author = {Lo{\'a}iciga, Sharid and Dobnik, Simon and Schlangen, David},
  booktitle = {Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference},
  month = oct,
  year = {2022},
  address = {Gyeongju, Republic of Korea},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2022.crac-1.4},
  pages = {31--37},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Sharid Loáiciga, Anne Beyer, and David Schlangen New or Old? Exploring How Pre-Trained Language Models Represent Discourse Entities Proceedings of the 29th International Conference on Computational Linguistics 2022 [Abs] [PDF]
Recent research shows that pre-trained language models, built to generate text conditioned on some context, learn to encode syntactic knowledge to a certain degree. This has motivated researchers to move beyond the sentence-level and look into their ability to encode less studied discourse-level phenomena. In this paper, we add to the body of probing research by investigating discourse entity representations in large pre-trained language models in English. Motivated by early theories of discourse and key pieces of previous work, we focus on the information-status of entities as discourse-new or discourse-old. We present two probing models, one based on binary classification and another one on sequence labeling. The results of our experiments show that pre-trained language models do encode information on whether an entity has been introduced before or not in the discourse. However, this information alone is not sufficient to find the entities in a discourse, opening up interesting questions about the definition of entities for future work.
BibTeX
```
@inproceedings{Loaiciga-2022,
  title = {New or Old? Exploring How Pre-Trained Language Models Represent Discourse Entities},
  author = {Lo{\'a}iciga, Sharid and Beyer, Anne and Schlangen, David},
  booktitle = {Proceedings of the 29th International Conference on Computational Linguistics},
  month = oct,
  year = {2022},
  address = {Gyeongju, Republic of Korea},
  publisher = {International Committee on Computational Linguistics},
  url = {https://aclanthology.org/2022.coling-1.73},
  pages = {875--886},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
David Schlangen Norm Participation Grounds Language Proceedings of the 2022 CLASP Conference on (Dis)embodiment 2022 [Abs] [PDF]
The striking recent advances in eliciting seemingly meaningful language behaviour from language-only machine learning models have only made more apparent, through the surfacing of clear limitations, the need to go beyond the language-only mode and to ground these models “in the world”. Proposals for doing so vary in the details, but what unites them is that the solution is sought in the addition of non-linguistic data types such as images or video streams, while largely keeping the mode of learning constant. I propose a different, and more wide-ranging conception of how grounding should be understood: What grounds language is its normative nature. There are standards for doing things right, these standards are public and authoritative, while at the same time acceptance of authority can and must be disputed and negotiated, in interactions in which only bearers of normative status can rightfully participate. What grounds language, then, is the determined use that language users make of it, and what it is grounded in is the community of language users. I sketch this idea, and draw some conclusions for work on computational modelling of meaningful language use.
BibTeX
```
@inproceedings{Schlangen-2022,
  title = {Norm Participation Grounds Language},
  author = {Schlangen, David},
  booktitle = {Proceedings of the 2022 CLASP Conference on (Dis)embodiment},
  month = sep,
  year = {2022},
  address = {Gothenburg, Sweden},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2022.clasp-1.7},
  pages = {62--69},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Jana Götze, Maike Paetzel-Prüsmann, Wencke Liermann, Tim Diekmann, and David Schlangen The Slurk Interaction Server Framework: Better Data for Better Dialog Models Proceedings of the Language Resources and Evaluation Conference 2022 [PDF]

BibTeX

@inproceedings{Goetze-2022-1,
  title = {The Slurk Interaction Server Framework: {{Better}} Data for Better Dialog Models},
  booktitle = {Proceedings of the Language Resources and Evaluation Conference},
  author = {G{\"o}tze, Jana and {Paetzel-Pr{\"u}smann}, Maike and Liermann, Wencke and Diekmann, Tim and Schlangen, David},
  year = {2022},
  month = jun,
  pages = {4069--4078},
  publisher = {{European Language Resources Association}},
  address = {{Marseille, France}},
  url = {http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.433.pdf},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Jana Götze, Karla Friedrichs, and David Schlangen Interactive and Cooperative Delivery of Referring Expressions: A Comparison of Three Algorithms Proceedings of the 26th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers 2022 [PDF]

BibTeX

@inproceedings{Goetze-2022,
  title = {{{Interactive}} and {{Cooperative}} {{Delivery}} of {{Referring}} {{Expressions}}:
  {{A}} {{Comparison}} of {{Three}} {{Algorithms}}},
  booktitle = {Proceedings of the 26th {{Workshop}} on the {{Semantics}} and {{Pragmatics}} of {{Dialogue}} - {{Full Papers}}},
  author = {Götze, Jana and Friedrichs, Karla and Schlangen, David},
  year = {2022},
  publisher = {{SEMDIAL}},
  address = {{Virtually and at Dublin, Ireland}},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sina Zarrieß, Henrik Voigt, David Schlangen, and Philipp Sadler Generating Landmark-based Manipulation Instructions from Image Pairs Proceedings of the 15th International Natural Language Generation Conference 2022 [PDF]
BibTeX
```
@inproceedings{Zarriess-2022,
  author = {Zarrie{\ss}, Sina and Voigt, Henrik and Schlangen, David and Sadler, Philipp},
  title = {Generating Landmark-based Manipulation Instructions from Image Pairs},
  booktitle = {Proceedings of the 15th International Natural Language Generation Conference},
  year = {2022},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Nazia Attari, David Schlangen, Martin Heckmann, Heiko Wersing, and Sina Zarrieß Generating Coherent and Informative Descriptions for Groups of Visual Objects and Categories: A Simple Decoding Approach Proceedings of the 15th International Natural Language Generation Conference 2022 [PDF]
BibTeX
```
@inproceedings{Attari-2022,
  title = {Generating Coherent and Informative Descriptions for Groups of Visual Objects and Categories: A Simple Decoding Approach},
  author = {Attari, Nazia and Schlangen, David and Heckmann, Martin and Wersing, Heiko and Zarrie{\ss}, Sina},
  year = {2022},
  booktitle = {Proceedings of the 15th International Natural Language Generation Conference},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Guy Laban, Sébastien Le Maguer, Minha Lee, Dimosthenis Kontogiorgos, Samantha Reig, Ilaria Torre, Ravi Tejwani, Matthew J Dennis, and Andre Pereira Robo-Identity: Exploring Artificial Identity and Emotion via Speech Interactions 2022 ACM/IEEE International Conference on Human-Robot Interaction 2022 [PDF]
BibTeX
```
@inproceedings{Kontogiorgos-2022,
  title = {Robo-Identity: Exploring Artificial Identity and Emotion via Speech Interactions},
  author = {Laban, Guy and Le Maguer, Sébastien and Lee, Minha and Kontogiorgos, Dimosthenis and Reig, Samantha and Torre, Ilaria and Tejwani, Ravi and Dennis, Matthew J and Pereira, Andre},
  booktitle = {2022 ACM/IEEE International Conference on Human-Robot Interaction},
  year = {2022},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Maike Paetzel-Prüsmann, Julie Hunter, Kranti Chalamalasetti, Kate Thompson, Alexandros Nicolaou, Ozan Güngör, David Schlangen, and Nicholas Asher Conversational Programming for Collaborative Robots ICRA 2022 Workshop on Collaborative Robots and the Work of the Future 2022 [PDF]
BibTeX
```
@inproceedings{Paetzel-2022,
  title = {Conversational Programming for Collaborative Robots},
  author = {Paetzel-Pr{\"u}smann, Maike and Hunter, Julie and Chalamalasetti, Kranti and Thompson, Kate and Nicolaou, Alexandros and G{\"u}ng{\"o}r, Ozan and Schlangen, David and Asher, Nicholas},
  year = {2022},
  booktitle = {ICRA 2022 Workshop on Collaborative Robots and the Work of the Future},
  organisation = {ICRA},
  month = may,
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Brielen Madureira, and David Schlangen Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) 2022 [PDF]

BibTeX

@inproceedings{Madureira-2022,
  title = {Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge},
  author = {Madureira, Brielen and Schlangen, David},
  booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)},
  month = may,
  year = {2022},
  address = {Dublin, Ireland},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2022.acl-short.73},
  doi = {10.18653/v1/2022.acl-short.73},
  pages = {651--664},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Mincheng Chang, Thilo Michael, Sebastian Möller, and David Schlangen The power of conversation flow in video conference tools: evaluation of speaker change cues Proceedings of the 33rd Conference on Electronic Speech Signal Processing 2022 [PDF]
BibTeX
```
@inproceedings{Chang-2022,
  author = {Chang, Mincheng and Michael, Thilo and Möller, Sebastian and Schlangen, David},
  title = {The power of conversation flow in video conference tools: evaluation of speaker change cues},
  year = {2022},
  booktitle = {Proceedings of the 33rd Conference on Electronic Speech Signal Processing},
  address = {Sonderborg, Denmark / Online},
  month = mar,
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2021

Patrick Kahardipraja, Brielen Madureira, and David Schlangen Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing 2021 [Abs] [PDF]
Incremental processing allows interactive systems to respond based on partial inputs, which is a desirable property e.g. in dialogue agents. The currently popular Transformer architecture inherently processes sequences as a whole, abstracting away the notion of time. Recent work attempts to apply Transformers incrementally via restart-incrementality by repeatedly feeding, to an unchanged model, increasingly longer input prefixes to produce partial outputs. However, this approach is computationally costly and does not scale efficiently for long sequences. In parallel, we witness efforts to make Transformers more efficient, e.g. the Linear Transformer (LT) with a recurrence mechanism. In this work, we examine the feasibility of LT for incremental NLU in English. Our results show that the recurrent LT model has better incremental performance and faster inference speed compared to the standard Transformer and LT with restart-incrementality, at the cost of part of the non-incremental (full sequence) quality. We show that the performance drop can be mitigated by training the model to wait for right context before committing to an output and that training with input prefixes is beneficial for delivering correct partial outputs.
BibTeX
```
@inproceedings{Kahardipraja-2021,
  title = {Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental {NLU}},
  author = {Kahardipraja, Patrick and Madureira, Brielen and Schlangen, David},
  booktitle = {Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing},
  month = nov,
  year = {2021},
  address = {Online and Punta Cana, Dominican Republic},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2021.emnlp-main.90},
  pages = {1178--1189},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Fabian Galetzka, Jewgeni Rose, David Schlangen, and Jens Lehmann Space Efficient Context Encoding for Non-Task-Oriented Dialogue Generation with Graph Attention Transformer Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) 2021 [Abs] [PDF]
To improve the coherence and knowledge retrieval capabilities of non-task-oriented dialogue systems, recent Transformer-based models aim to integrate fixed background context. This often comes in the form of knowledge graphs, and the integration is done by creating pseudo utterances through paraphrasing knowledge triples, added into the accumulated dialogue context. However, the context length is fixed in these architectures, which restricts how much background or dialogue context can be kept. In this work, we propose a more concise encoding for background context structured in the form of knowledge graphs, by expressing the graph connections through restrictions on the attention weights. The results of our human evaluation show that this encoding reduces space requirements without negative effects on the precision of reproduction of knowledge and perceived consistency. Further, models trained with our proposed context encoding generate dialogues that are judged to be more comprehensive and interesting.
BibTeX
```
@inproceedings{Galetzka-2021,
  title = {Space Efficient Context Encoding for Non-Task-Oriented Dialogue Generation with Graph Attention Transformer},
  author = {Galetzka, Fabian and Rose, Jewgeni and Schlangen, David and Lehmann, Jens},
  booktitle = {Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)},
  month = aug,
  year = {2021},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2021.acl-long.546},
  doi = {10.18653/v1/2021.acl-long.546},
  pages = {7028--7041},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen Targeting the Benchmark: On Methodology in Current Natural Language Processing Research Proceedings of the Annual Meeting for the Association for Computational Linguistics: Short Papers 2021 [PDF]

BibTeX

@inproceedings{Schlangen-2021,
  author = {Schlangen, David},
  title = {Targeting the Benchmark: On Methodology in Current Natural Language Processing Research},
  booktitle = {Proceedings of the Annual Meeting for the Association for Computational Linguistics: Short Papers},
  year = {2021},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Anne Beyer, Sharid Loáiciga, and David Schlangen Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2021 [Abs] [PDF]
Coherent discourse is distinguished from a mere collection of utterances by the satisfaction of a diverse set of constraints, for example choice of expression, logical relation between denoted events, and implicit compatibility with world-knowledge. Do neural language models encode such constraints? We design an extendable set of test suites addressing different aspects of discourse and dialogue coherence. Unlike most previous coherence evaluation studies, we address specific linguistic devices beyond sentence order perturbations, allowing for a more fine-grained analysis of what constitutes coherence and what neural models trained on a language modelling objective do encode. Extending the targeted evaluation paradigm for neural language models (Marvin and Linzen, 2018) to phenomena beyond syntax, we show that this paradigm is equally suited to evaluate linguistic qualities that contribute to the notion of coherence.
BibTeX
```
@inproceedings{Beyer-2021,
  author = {Beyer, Anne and Lo\'aiciga, Sharid and Schlangen, David},
  year = {2021},
  title = {Is {Incoherence} {Surprising}? {Targeted} {Evaluation} of {Coherence} {Prediction} from {Language} {Models}},
  booktitle = {Proceedings of the 2021 {Conference} of the {North} {A}merican {Chapter} of the {Association} for {Computational} {Linguistics}: {Human} {Language} {Technologies}},
  publisher = {Association for {Computational} {Linguistics}},
  url = {https://aclanthology.org/2021.naacl-main.328},
  doi = {10.18653/v1/2021.naacl-main.328},
  pages = {4164--4173},
  address = {Online},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sharid Loáiciga, Simon Dobnik, and David Schlangen Annotating anaphoric phenomena in situated dialogue Proceedings of the First Workshop on Multimodal Semantic Representations 2021 [PDF]

BibTeX

@inproceedings{Loaiciga-2021-1,
  title = {Annotating anaphoric phenomena in situated dialogue},
  author = {Lo\'{a}iciga, Sharid and Dobnik, Simon and Schlangen, David},
  booktitle = {Proceedings of the First Workshop on Multimodal Semantic Representations},
  month = jun,
  year = {2021},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {},
  doi = {},
  pages = {},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sharid Loáiciga, Simon Dobnik, and David Schlangen Reference and coreference in situated dialogue Proceedings of the Second Workshop on Advances in Language and Vision Research 2021 [PDF]

BibTeX

@inproceedings{Loaiciga-2021,
  title = {Reference and coreference in situated dialogue},
  author = {Lo\'{a}iciga, Sharid and Dobnik, Simon and Schlangen, David},
  booktitle = {Proceedings of the Second Workshop on Advances in Language and Vision Research},
  month = jul,
  year = {2021},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {},
  doi = {},
  pages = {},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Maike Paetzel-Prüsmann, Giulia Perugia, and Ginevra Castellano The Influence of Robot Personality on the Development of Uncanny Feelings Computers in Human Behavior 2021 [PDF]

BibTeX

@article{Paetzel-2021,
  title = {The Influence of Robot Personality on the Development of Uncanny Feelings},
  author = {Paetzel-Pr{\"u}smann, Maike and Perugia, Giulia and Castellano, Ginevra},
  journal = {Computers in Human Behavior},
  volume = {120},
  pages = {106756},
  year = {2021},
  publisher = {Elsevier},
  issn = {0747-5632},
  doi = {https://doi.org/10.1016/j.chb.2021.106756},
  url = {https://www.sciencedirect.com/science/article/pii/S0747563221000789},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Giulia Perugia, Maike Paetzel-Prüsmann, Madelene Alanenpää, and Ginevra Castellano I Can See it in Your Eyes: Gaze towards a Robot as an Implicit Cue of Uncanniness and Task Performance in Long-term Interactions Frontiers in Robotics and AI 2021 [PDF]

BibTeX

@article{Perugia-2021,
  title = {I Can See it in Your Eyes: Gaze towards a Robot as an Implicit Cue of Uncanniness and Task Performance in Long-term Interactions},
  author = {Perugia, Giulia and Paetzel-Pr{\"u}smann, Maike and Alanenp{\"a}{\"a}, Madelene and Castellano, Ginevra},
  journal = {Frontiers in Robotics and AI},
  volume = {8},
  pages = {78},
  year = {2021},
  url = {https://www.frontiersin.org/article/10.3389/frobt.2021.645956},
  doi = {10.3389/frobt.2021.645956},
  issn = {2296-9144},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Jakob Nyberg, Ramesh Manuvinakurike, and Maike Paetzel-Prüsmann Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation. Workshop on Human Evaluation of NLP Systems (EACL 2021) 2021 [PDF]

BibTeX

@inproceedings{Nyberg-2021,
  title = {Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation.},
  author = {Nyberg, Jakob and Manuvinakurike, Ramesh and Paetzel-Pr{\"u}smann, Maike},
  year = {2021},
  booktitle = {Workshop on Human Evaluation of NLP Systems (EACL 2021)},
  url = {https://arxiv.org/abs/2104.05224},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Frank Grimm, David Schlangen, Julian Hough, and Philipp Cimiano Reproducing an experiment in automatic disfluency detection 2021 [PDF]

BibTeX

@incollection{Grimm-2021,
  author = {Grimm, Frank and Schlangen, David and Hough, Julian and Cimiano, Philipp},
  title = {Reproducing an experiment in automatic disfluency detection},
  editor = {Cimiano, Philipp and Pietsch, Christian and Wiljes, Cord},
  booktitle = {Studies in Analytical Reproducibility: the Conquaire Project},
  publisher = {Bielefeld University},
  address = {Bielefeld},
  year = {2021},
  pages = {97-112},
  chapter = {8},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2020

Robin Rojowiec, Jana Götze, Philipp Sadler, Henrik Voigt, Sina Zarrieß, and David Schlangen From “Before” to “After”: Generating Natural Language Instructions from Image Pairs in a Simple Visual Domain Proceedings of the 13th International Conference on Natural Language Generation 2020 [Abs] [PDF]
While certain types of instructions can be com-pactly expressed via images, there are situations where one might want to verbalise them, for example when directing someone. We investigate the task of Instruction Generation from Before/After Image Pairs which is to derive from images an instruction for effecting the implied change. For this, we make use of prior work on instruction following in a visual environment. We take an existing dataset, the BLOCKS data collected by Bisk et al. (2016) and investigate whether it is suitable for training an instruction generator as well. We find that it is, and investigate several simple baselines, taking these from the related task of image captioning. Through a series of experiments that simplify the task (by making image processing easier or completely side-stepping it; and by creating template-based targeted instructions), we investigate areas for improvement. We find that captioning models get some way towards solving the task, but have some difficulty with it, and future improvements must lie in the way the change is detected in the instruction.
BibTeX
```
@inproceedings{Rojowiec-2020,
  title = {From {``}Before{''} to {``}After{''}: Generating Natural Language Instructions from Image Pairs in a Simple Visual Domain},
  author = {Rojowiec, Robin and G{\"o}tze, Jana and Sadler, Philipp and Voigt, Henrik and Zarrie{\ss}, Sina and Schlangen, David},
  booktitle = {Proceedings of the 13th International Conference on Natural Language Generation},
  month = dec,
  year = {2020},
  address = {Dublin, Ireland},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2020.inlg-1.38},
  pages = {316--326},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Patrick Kahardipraja, Olena Vyshnevska, and Sharid Loáiciga Exploring Span Representations in Neural Coreference Resolution Proceedings of the First Workshop on Computational Approaches to Discourse 2020 [Abs] [PDF]
In coreference resolution, span representations play a key role to predict coreference links accurately. We present a thorough examination of the span representation derived by applying BERT on coreference resolution (Joshi et al., 2019) using a probing model. Our results show that the span representation is able to encode a significant amount of coreference information. In addition, we find that the head-finding attention mechanism involved in creating the spans is crucial in encoding coreference knowledge. Last, our analysis shows that the span representation cannot capture non-local coreference as efficiently as local coreference.
BibTeX
```
@inproceedings{Kahardipraja-2020,
  title = {Exploring Span Representations in Neural Coreference Resolution},
  author = {Kahardipraja, Patrick and Vyshnevska, Olena and Lo{\'a}iciga, Sharid},
  booktitle = {Proceedings of the First Workshop on Computational Approaches to Discourse},
  month = nov,
  year = {2020},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {https://www.aclweb.org/anthology/2020.codi-1.4},
  doi = {10.18653/v1/2020.codi-1.4},
  pages = {32--41},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations 2020 [PDF]

BibTeX

@proceedings{Schlangen-2020-2,
  title = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations},
  editor = {Liu, Qun and Schlangen, David},
  month = oct,
  year = {2020},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {https://www.aclweb.org/anthology/2020.emnlp-demos.0},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Brielen Madureira, and David Schlangen Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2020 [Abs] [PDF]
While humans process language incrementally, the best language encoders currently used in NLP do not. Both bidirectional LSTMs and Transformers assume that the sequence that is to be encoded is available in full, to be processed either forwards and backwards (BiLSTMs) or as a whole (Transformers). We investigate how they behave under incremental interfaces, when partial output must be provided based on partial input seen up to a certain time step, which may happen in interactive systems. We test five models on various NLU datasets and compare their performance using three incremental evaluation metrics. The results support the possibility of using bidirectional encoders in incremental mode while retaining most of their non-incremental quality. The “omni-directional” BERT model, which achieves better non-incremental performance, is impacted more by the incremental access. This can be alleviated by adapting the training regime (truncated training), or the testing procedure, by delaying the output until some right context is available or by incorporating hypothetical right contexts generated by a language model like GPT-2.
BibTeX
```
@inproceedings{Madureira-2020-1,
  title = {Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental {NLU}},
  author = {Madureira, Brielen and Schlangen, David},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
  month = nov,
  year = {2020},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2020.emnlp-main.26},
  doi = {10.18653/v1/2020.emnlp-main.26},
  pages = {357--374},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen An Outline of a Model of Situated Discourse Representation and Processing Proceedings of semdial 2020 (WatchDial) 2020 [PDF]

BibTeX

@inproceedings{Schlangen-2020-1,
  author = {Schlangen, David},
  title = {An Outline of a Model of Situated Discourse Representation and Processing},
  booktitle = {Proceedings of semdial 2020 (WatchDial)},
  year = {2020},
  month = jul,
  address = {Brandeis University / Internet},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Brielen Madureira, and David Schlangen An Overview of Natural Language State Representation for Reinforcement Learning Proceedings of the ICML Workshop on Language in Reinforcement Learning 2020 [PDF]

BibTeX

@inproceedings{Madureira-2020,
  title = {An Overview of Natural Language State Representation for Reinforcement Learning},
  author = {Madureira, Brielen and Schlangen, David},
  year = {2020},
  booktitle = {Proceedings of the ICML Workshop on Language in Reinforcement Learning},
  month = jul,
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen Targeting the Benchmark: On Methodology in Current Natural Language Processing Research 2020 [PDF]

BibTeX

@misc{Schlangen-2020,
  title = {Targeting the Benchmark: On Methodology in Current Natural Language Processing Research},
  author = {Schlangen, David},
  year = {2020},
  eprint = {2007.04792},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Fabian Galetzka, Chukwuemeka U. Eneh, and David Schlangen A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models Proceedings of the 12th Language Resources and Evaluation Conference 2020 [PDF]
BibTeX
```
@inproceedings{Galetzka-2020,
  author = {Galetzka, Fabian and Eneh, Chukwuemeka U. and Schlangen, David},
  title = {A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models},
  booktitle = {Proceedings of the 12th Language Resources and Evaluation Conference},
  year = {2020},
  address = {Marseille, France / online},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2019

Nikolai Ilinykh, Sina Zarrieß, and David Schlangen Tell Me More: A Dataset of Visual Scene Description Sequences Proceedings of the 12th International Conference on Natural Language Generation (INLG) 2019 [PDF]

BibTeX

@inproceedings{Ilinykh-2019-1,
  author = {Ilinykh, Nikolai and Zarrie{\ss}, Sina and Schlangen, David},
  title = {Tell Me More: A Dataset of Visual Scene Description Sequences},
  booktitle = {Proceedings of the 12th International Conference on Natural Language Generation (INLG)},
  year = {2019},
  month = oct,
  address = {Tokyo, Japan},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Philipp Sadler, Tatjana Scheffler, and David Schlangen Can Neural Image Captioning be Controlled via Forced Attention? Proceedings of the 12th International Conference on Natural Language Generation (INLG) 2019 [PDF]
BibTeX
```
@inproceedings{Sadler-2019,
  author = {Sadler, Philipp and Scheffler, Tatjana and Schlangen, David},
  title = {Can Neural Image Captioning be Controlled via Forced Attention?},
  booktitle = {Proceedings of the 12th International Conference on Natural Language Generation (INLG)},
  year = {2019},
  month = oct,
  address = {Tokyo, Japan},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Nazia Attari, Martin Heckmann, and David Schlangen From Explainability to Explanation: Using a Dialogue Setting to Elicit Annotations with Justifications Proceedings of SIGdial 2019, Short Papers 2019 [PDF]

BibTeX

@inproceedings{Attari-2019,
  author = {Attari, Nazia and Heckmann, Martin and Schlangen, David},
  title = {From Explainability to Explanation: Using a Dialogue Setting to Elicit Annotations with Justifications},
  year = {2019},
  booktitle = {Proceedings of SIGdial 2019, Short Papers},
  address = {Stockholm, Sweden},
  month = sep,
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settings CoRR 2019 [PDF]

BibTeX

@article{Schlangen-2019-2,
  author = {Schlangen, David},
  title = {Grounded Agreement Games: Emphasizing Conversational Grounding in
                 Visual Dialogue Settings},
  journal = {CoRR},
  volume = {abs/1908.11279},
  year = {2019},
  url = {http://arxiv.org/abs/1908.11279},
  archiveprefix = {arXiv},
  eprint = {1908.11279},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen Language Tasks and Language Games: On Methodology in Current Natural Language Processing Research CoRR 2019 [PDF]

BibTeX

@article{Schlangen-2019-1,
  author = {Schlangen, David},
  title = {Language Tasks and Language Games: On Methodology in Current Natural
                 Language Processing Research},
  journal = {CoRR},
  volume = {abs/1908.10747},
  year = {2019},
  url = {http://arxiv.org/abs/1908.10747},
  archiveprefix = {arXiv},
  eprint = {1908.10747},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Nikolai Ilinykh, Sina Zarrieß, and David Schlangen MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment Proceedings of the 23rd Workshop on the Semantics and Pragmatics of Dialogue (SemDial 2019 / LondonLogue) 2019 [PDF]
BibTeX
```
@inproceedings{Ilinykh-2019,
  author = {Ilinykh, Nikolai and Zarrie{\ss}, Sina and Schlangen, David},
  title = {MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment},
  booktitle = {Proceedings of the 23rd Workshop on the Semantics and Pragmatics of Dialogue (SemDial 2019 / LondonLogue)},
  year = {2019},
  month = sep,
  address = {London, UK}
}
```
Details

Sina Zarrieß, and David Schlangen Know What You Don’t Know: Modeling a Pragmatic Speaker that Refers to Objects of Unknown Categories Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Short Papers 2019 [PDF]

BibTeX

@inproceedings{Zarrieß-2019,
  author = {Zarrie{\ss}, Sina and Schlangen, David},
  title = {Know What You Don't Know: Modeling a Pragmatic Speaker that Refers to Objects of Unknown Categories},
  booktitle = {Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), Short Papers},
  year = {2019},
  month = jul,
  address = {Florence, Italy}
}

Details

David Schlangen Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics Proceedings of the 13th International Conference on Computational Semantics - Long Papers 2019 [Abs] [PDF]
Propelling, and propelled by, the "deep learning revolution", recent years have seen the introduction of ever larger corpora of images annotated with natural language expressions. We survey some of these corpora, taking a perspective that reverses the usual directionality, as it were, by viewing the images as semantic annotation of the natural language expressions. We discuss datasets that can be derived from the corpora, and tasks of potential interest for computational semanticists that can be defined on those. In this, we make use of relations provided by the corpora (namely, the link between expression and image, and that between two expressions linked to the same image) and relations that we can add (similarity relations between expressions, or between images). Specifically, we show that in this way we can create data that can be used to learn and evaluate lexical and compositional grounded semantics, and we show that the "linked to same image" relation tracks a semantic implication relation that is recognisable to annotators even in the absence of the linking image as evidence. Finally, as an example of possible benefits of this approach, we show that an exemplar-model-based approach to implication beats a (simple) distributional space-based one on some derived datasets, while lending itself to explainability.
BibTeX
```
@inproceedings{Schlangen-2019,
  author = {Schlangen, David},
  editor = {Dobnik, Simon and Chatzikyriakidis, Stergios and Demberg, Vera},
  booktitle = {Proceedings of the 13th International Conference on Computational Semantics - Long Papers},
  isbn = {978-1-950737-19-2},
  pages = {283--294},
  publisher = {Association for Computational Linguistics},
  title = {{Natural Language Semantics With Pictures: Some Language \& Vision Datasets and Potential Uses for Computational Semantics}},
  year = {2019},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2018

Ting Han, Sina Zarrieß, Kazunori Komatani, and David Schlangen Learning to describe multimodally from parallel unimodal data? A pilot study on verbal and sketched object descriptions Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial) 2018 [PDF]
BibTeX
```
@inproceedings{Han-2018,
  author = {Han, Ting and Zarrieß, Sina and Komatani, Kazunori and Schlangen, David},
  booktitle = {Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial)},
  location = {Aix-en-Provence (France)},
  title = {{Learning to describe multimodally from parallel unimodal data? A pilot study on verbal and sketched object descriptions}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Nikolai Ilinykh, Sina Zarrieß, and David Schlangen The Task Matters. Comparing Image Captioning and Task-Based Dialogical Image Description Proceedings of 11th International Conference on Natural Language Generation (INLG 2018) 2018 [PDF]
BibTeX
```
@inproceedings{Ilinykh-2018,
  author = {Ilinykh, Nikolai and Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of 11th International Conference on Natural Language Generation (INLG 2018)},
  location = {Tilburg, the Netherlands},
  title = {{The Task Matters. Comparing Image Captioning and Task-Based Dialogical Image Description}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
David Schlangen, Tim Diekmann, Nikolai Ilinykh, and Sina Zarrieß slurk – A Lightweight Interaction Server For Dialogue Experiments and Data Collection Short Paper Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial / semdial 2018) 2018 [PDF]
BibTeX
```
@inproceedings{Schlangen-2018,
  author = {Schlangen, David and Diekmann, Tim and Ilinykh, Nikolai and Zarrieß, Sina},
  booktitle = {Short Paper Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial / semdial 2018)},
  location = {Aix-en-Provence, France},
  title = {{slurk – A Lightweight Interaction Server For Dialogue Experiments and Data Collection}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, Nikolai Ilinykh, and Sina Zarrieß MeetUp! A Task For Modelling Visual Dialogue Short Paper Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial / semdial 2018) 2018 [PDF]

BibTeX

@inproceedings{Schlangen-2018-1,
  author = {Schlangen, David and Ilinykh, Nikolai and Zarrieß, Sina},
  booktitle = {Short Paper Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue (AixDial / semdial 2018)},
  location = {Aix-en-Provence, France},
  title = {{MeetUp! A Task For Modelling Visual Dialogue}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Nikolai Ilinykh, and Sina Zarrieß Visual Dialogue Needs Symmetry, Goals, andDynamics: The Example of the MeetUp Task Proceedings of the 1st Workshop on Shortcomings in Vision and Language (SiVL) at ECCV 2018 2018 [PDF]
BibTeX
```
@inproceedings{Schlangen-2018-2,
  author = {Schlangen, David and Ilinykh, Nikolai and Zarrieß, Sina},
  booktitle = {Proceedings of the 1st Workshop on Shortcomings in Vision and Language (SiVL) at ECCV 2018},
  location = {Munich},
  title = {{Visual Dialogue Needs Symmetry, Goals, andDynamics: The Example of the MeetUp Task}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sina Zarrieß, and David Schlangen Decoding Strategies for Neural Referring Expression Generation Proceedings of INLG 2018 2018 [PDF]

BibTeX

@inproceedings{Zarrieß-2018,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of INLG 2018},
  location = {Tilburg},
  title = {{Decoding Strategies for Neural Referring Expression Generation}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Jonathan Ginzburg, Robin Cooper, Julian Hough, and David Schlangen Incrementality and Clarification/Sluicing Potential Proceedings of Sinn und Bedeutung 21. Volume 1 2018 [PDF]

BibTeX

@inproceedings{Ginzburg-2018,
  author = {Ginzburg, Jonathan and Cooper, Robin and Hough, Julian and Schlangen, David},
  editor = {Truswell, Robert and Cummins, Chris and Heycock, Caroline and Rohde, Hannah},
  booktitle = {Proceedings of Sinn und Bedeutung 21. Volume 1},
  location = {Edinburgh},
  pages = {463--480},
  title = {{Incrementality and Clarification/Sluicing Potential}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Maria Soledad Lopez Gambino, Sina Zarrieß, and David Schlangen Testing Strategies For Bridging Time-To-Content In Spoken Dialogue Systems Proceedings of the Ninth International Workshop on Spoken Dialogue Systems Technology (IWSDS 2018) 2018 [PDF]
BibTeX
```
@inproceedings{Lopez_Gambino-2018,
  author = {Lopez Gambino, Maria Soledad and Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of the Ninth International Workshop on Spoken Dialogue Systems Technology (IWSDS 2018)},
  location = {Singapore},
  title = {{Testing Strategies For Bridging Time-To-Content In Spoken Dialogue Systems}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Birte Carlmeyer, Simon Betz, Petra Wagner, Britta Wrede, and David Schlangen The Hesitating Robot - Implementation and First Impressions Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction - HRI ’18 2018 [PDF]
BibTeX
```
@inproceedings{Carlmeyer-2018,
  author = {Carlmeyer, Birte and Betz, Simon and Wagner, Petra and Wrede, Britta and Schlangen, David},
  booktitle = {Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction - HRI '18},
  isbn = {978-1-4503-5615-2},
  location = {Chicago, IL, USA},
  pages = {77--78},
  publisher = {ACM Press},
  title = {{The Hesitating Robot - Implementation and First Impressions}},
  doi = {10.1145/3173386.3176992},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Ting Han, and David Schlangen A Corpus of Natural Multimodal Spatial Scene Descriptions The 11th edition of the Language Resources and Evaluation Conference (LREC) 2018 [PDF]

BibTeX

@inproceedings{Han-2018-1,
  author = {Han, Ting and Schlangen, David},
  booktitle = {The 11th edition of the Language Resources and Evaluation Conference (LREC)},
  location = {Miyazaki},
  title = {{A Corpus of Natural Multimodal Spatial Scene Descriptions}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, Casey Kennington, and David Schlangen Placing Objects in Gesture Space: Toward Real-Time Understanding of Spatial Descriptions Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI18) 2018 [PDF]

BibTeX

@inproceedings{Han-2018-2,
  author = {Han, Ting and Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI18)},
  location = {New Orleans},
  publisher = {The association for the advancement of artificial intelligence},
  title = {{Placing Objects in Gesture Space: Toward Real-Time Understanding of Spatial Descriptions}},
  year = {2018},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2017

Julian Hough, and David Schlangen Joint, Incremental Disfluency Detection and Utterance Segmentation from Speech Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL) 2017 [PDF]

BibTeX

@inproceedings{Hough-2017,
  author = {Hough, Julian and Schlangen, David},
  booktitle = {Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL)},
  location = {Valencia, Spain},
  pages = {326--336},
  title = {{Joint, Incremental Disfluency Detection and Utterance Segmentation from Speech}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, and David Schlangen Draw and Tell: a Corpus of Multimodal Object Descriptions 2017 [PDF]

BibTeX

@misc{Han-2017,
  author = {Han, Ting and Schlangen, David},
  publisher = {Bielefeld University},
  title = {{Draw and Tell: a Corpus of Multimodal Object Descriptions}},
  doi = {10.4119/unibi/2913193},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, and David Schlangen A Corpus of Multimodal Spatial Scene Descriptions 2017 [PDF]

BibTeX

@misc{Han-2017-1,
  author = {Han, Ting and Schlangen, David},
  keyword = {Multimodal descriptions, abstract deictic gestures},
  publisher = {Bielefeld University},
  title = {{A Corpus of Multimodal Spatial Scene Descriptions}},
  doi = {10.4119/unibi/2913177},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, Sina Zarrieß, and David Schlangen Grounding Imperatives to Actions is Not Enough: A Challenge for Grounded NLU for Robots from Human-Human Data 2017 [PDF]
BibTeX
```
@inproceedings{Hough-2017-1,
  author = {Hough, Julian and Zarrieß, Sina and Schlangen, David},
  location = {Stockholm, Sweden},
  title = {{Grounding Imperatives to Actions is Not Enough: A Challenge for Grounded NLU for Robots from Human-Human Data}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Angelika Maier, Julian Hough, and David Schlangen Towards Deep End-of-Turn Prediction for Situated Spoken Dialogue Systems Proceedings of INTERSPEECH 2017 2017 [PDF]
BibTeX
```
@inproceedings{Maier-2017,
  author = {Maier, Angelika and Hough, Julian and Schlangen, David},
  booktitle = {Proceedings of INTERSPEECH 2017},
  location = {Stockholm, Sweden},
  title = {{Towards Deep End-of-Turn Prediction for Situated Spoken Dialogue Systems}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sina Zarrieß, and David Schlangen Deriving continous grounded meaning representations from referentially structured multimodal contexts Proceedings of EMNLP 2017 – Short Papers 2017 [PDF]

BibTeX

@inproceedings{Zarrieß-2017,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of EMNLP 2017 -- Short Papers},
  location = {Copenhagen},
  title = {{Deriving continous grounded meaning representations from referentially structured multimodal contexts}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Maria Soledad Lopez Gambino, Sina Zarrieß, and David Schlangen Beyond On-Hold Messages: Conversational Time-Buying in Task-Oriented Dialogue Proceedings of SIGdial 2017 2017 [PDF]
BibTeX
```
@inproceedings{Lopez_Gambino-2017,
  author = {Lopez Gambino, Maria Soledad and Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of SIGdial 2017},
  title = {{Beyond On-Hold Messages: Conversational Time-Buying in Task-Oriented Dialogue}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sina Zarrieß, and David Schlangen Obtaining referential word meanings from visual and distributional information: Experiments on object naming Proceedings of 55th annual meeting of the Association for Computational Linguistics (ACL) 2017 [PDF]

BibTeX

@inproceedings{Zarrieß-2017-1,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of 55th annual meeting of the Association for Computational Linguistics (ACL)},
  title = {{Obtaining referential word meanings from visual and distributional information: Experiments on object naming}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, and David Schlangen A Model of Continuous Intention Grounding for HRI 2017 [PDF]

BibTeX

@inproceedings{Hough-2017-2,
  author = {Hough, Julian and Schlangen, David},
  location = {Vienna},
  title = {{A Model of Continuous Intention Grounding for HRI}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, and David Schlangen Grounding Language by Continuous Observation of Instruction Following Short Papers – Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL) 2017 [PDF]

BibTeX

@inproceedings{Han-2017-2,
  author = {Han, Ting and Schlangen, David},
  booktitle = {Short Papers -- Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL)},
  location = {Valencia, Spain},
  pages = {491--496},
  publisher = {Association for Computational Linguistics},
  title = {{Grounding Language by Continuous Observation of Instruction Following}},
  volume = {2},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sina Zarrieß, and David Schlangen Is this a Child, a Girl, or a Car? Exploring the Contribution of Distributional Similarity to Learning Referential Word Meanings Short Papers – Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL) 2017 [PDF]

BibTeX

@inproceedings{Zarrieß-2017-2,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Short Papers -- Proceedings of the Annual Meeting of the European Chapter of the Association for Computational Linguistics (EACL)},
  location = {Valencia, Spain},
  title = {{Is this a Child, a Girl, or a Car? Exploring the Contribution of Distributional Similarity to Learning Referential Word Meanings}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Maria Soledad Lopez Gambino, Casey Kennington, and David Schlangen Silence, Please! Interrupting In-Car Phone Conversations Proceedings of the First Workshop on Conversational Interruptions in Human-Agent Interactions (CIHAI 2017) 2017 [PDF]

BibTeX

@inproceedings{Lopez_Gambino-2017-1,
  author = {Lopez Gambino, Maria Soledad and Kennington, Casey and Schlangen, David},
  editor = {Cafaro, Angelo and Coutinho, Eduardo and Gebhard, Patrick and Potard, Blaise},
  booktitle = {Proceedings of the First Workshop on Conversational Interruptions in Human-Agent Interactions (CIHAI 2017)},
  issn = {1613-0073},
  location = {Stockholm},
  pages = {9 -- 18},
  title = {{Silence, Please! Interrupting In-Car Phone Conversations}},
  volume = {1943},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, Julian Hough, and David Schlangen Natural Language Informs the Interpretation of Iconic Gestures. A Computational Approach The 8th International Joint Conference on Natural Language Processing. Proceedings of the Conference. Vol. 2: Short Papers 2017 [PDF]

BibTeX

@inproceedings{Han-2017-3,
  author = {Han, Ting and Hough, Julian and Schlangen, David},
  booktitle = {The 8th International Joint Conference on Natural Language Processing. Proceedings of the Conference. Vol. 2: Short Papers},
  isbn = {978-1-948087-01-8},
  location = {Taipei},
  pages = {134 -- 139},
  title = {{Natural Language Informs the Interpretation of Iconic Gestures. A Computational Approach}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, and David Schlangen A simple generative model of incremental reference resolution for situated dialogue Computer Speech & Language 2017 [PDF]

BibTeX

@article{Kennington-2017,
  author = {Kennington, Casey and Schlangen, David},
  issn = {0885-2308},
  journal = {Computer Speech \& Language},
  pages = {43--67},
  publisher = {Elsevier BV},
  title = {{A simple generative model of incremental reference resolution for situated dialogue}},
  doi = {10.1016/j.csl.2016.04.002},
  volume = {41},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Iwan Kok, Felix Hülsmann, Thomas Waltemate, Cornelia Frank, Julian Hough, Thies Pfeiffer, David Schlangen, Thomas Schack, Mario Botsch, and Stefan Kopp The Intelligent Coaching Space: A Demonstration Intelligent Virtual Agents: 17th International Conference on Intelligent Virtual Agents from August 27th to 30th in Stockholm, Sweden 2017 [PDF]
BibTeX
```
@inproceedings{Kok-2017,
  author = {de Kok, Iwan and Hülsmann, Felix and Waltemate, Thomas and Frank, Cornelia and Hough, Julian and Pfeiffer, Thies and Schlangen, David and Schack, Thomas and Botsch, Mario and Kopp, Stefan},
  editor = {Beskow, Jonas and Peters, Christopher and Castellano, Ginevra and O'Sullivan, Carol and Leite, Iolanda and Kopp, Stefan},
  booktitle = {Intelligent Virtual Agents: 17th International Conference on Intelligent Virtual Agents from August 27th to 30th in Stockholm, Sweden},
  isbn = {978-3-319-67400-1},
  location = {Stockholm, Sweden},
  pages = {105--108},
  publisher = {Springer},
  title = {{The Intelligent Coaching Space: A Demonstration}},
  doi = {10.1007/978-3-319-67401-8},
  volume = {10498},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Ting Han, and David Schlangen Draw and Tell. Multimodal Descriptions Outperform Verbal- or Sketch-Only Descriptions in an Image Retrieval Task The 8th International Joint Conference on Natural Language Processing. Proceedings of the Conference. Vol. 2: Short Papers 2017 [PDF]

BibTeX

@inproceedings{Han-2017-4,
  author = {Han, Ting and Schlangen, David},
  booktitle = {The 8th International Joint Conference on Natural Language Processing. Proceedings of the Conference. Vol. 2: Short Papers},
  isbn = {978-1-948087-01-8},
  location = {Taipei},
  pages = {361 -- 365},
  title = {{Draw and Tell. Multimodal Descriptions Outperform Verbal- or Sketch-Only Descriptions in an Image Retrieval Task}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sina Zarrieß, and David Schlangen Refer-iTTS: A System for Referring in Spoken Installments to Objects in Real-World Images Proceedings of INLG 2017 (demo papers) 2017 [PDF]

BibTeX

@inproceedings{Zarrieß-2017-3,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of INLG 2017 (demo papers)},
  title = {{Refer-iTTS: A System for Referring in Spoken Installments to Objects in Real-World Images}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, Ting Han, and David Schlangen Temporal alignment using the incremental unit framework Proceedings of 19th ACM International Conference on Multimodal Interaction 2017 [PDF]

BibTeX

@inproceedings{Kennington-2017-1,
  author = {Kennington, Casey and Han, Ting and Schlangen, David},
  booktitle = {Proceedings of 19th ACM International Conference on Multimodal Interaction},
  isbn = {978-1-4503-5543-8},
  location = {Glasglow},
  pages = {297 -- 301},
  publisher = {ACM},
  title = {{Temporal alignment using the incremental unit framework}},
  doi = {10.1145/3136755.3136769},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, and David Schlangen It’s Not What You Do, It’s How You Do It: Grounding Uncertainty for a Simple Robot Proceedings of the 2017 Conference on Human-Robot Interaction (HRI2017) 2017 [PDF]

BibTeX

@inproceedings{Hough-2017-3,
  author = {Hough, Julian and Schlangen, David},
  booktitle = {Proceedings of the 2017 Conference on Human-Robot Interaction (HRI2017)},
  title = {{It's Not What You Do, It's How You Do It: Grounding Uncertainty for a Simple Robot}},
  year = {2017},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2016

Iwan Kok, Julian Hough, David Schlangen, and Stefan Kopp Deictic gestures in coaching interactions Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction - MA3HMI ’16 2016 [PDF]
BibTeX
```
@inproceedings{Kok-2016,
  author = {de Kok, Iwan and Hough, Julian and Schlangen, David and Kopp, Stefan},
  booktitle = {Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction - MA3HMI '16},
  isbn = {9781450345620},
  publisher = {Association for Computing Machinery (ACM)},
  title = {{Deictic gestures in coaching interactions}},
  doi = {10.1145/3011263.3011267},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Jasmin Bernotat, Birte Schiffhauer, Friederike Anne Eyssel, Patrick Holthaus, Christian Leichsenring, Viktor Richter, Marian Pohling, Birte Carlmeyer, Norman Köster, Sebastian Borgsen, René Zorn, Kai Frederic Engelmann, Florian Lier, Simon Schulz, Rebecca Bröhl, Elena Seibel, Paul Hellwig, Philipp Cimiano, Franz Kummert, David Schlangen, Petra Wagner, Thomas Hermann, Sven Wachsmuth, Britta Wrede, and Sebastian Wrede Welcome to the future – How naïve users intuitively address an intelligent robotics apartment. Lecture Notes in Artificial Intelligence (LNAI) 2016 [PDF]
BibTeX
```
@inproceedings{Bernotat-2016,
  author = {Bernotat, Jasmin and Schiffhauer, Birte and Eyssel, Friederike Anne and Holthaus, Patrick and Leichsenring, Christian and Richter, Viktor and Pohling, Marian and Carlmeyer, Birte and Köster, Norman and Meyer zu Borgsen, Sebastian and Zorn, René and Engelmann, Kai Frederic and Lier, Florian and Schulz, Simon and Bröhl, Rebecca and Seibel, Elena and Hellwig, Paul and Cimiano, Philipp and Kummert, Franz and Schlangen, David and Wagner, Petra and Hermann, Thomas and Wachsmuth, Sven and Wrede, Britta and Wrede, Sebastian},
  editor = {Agah, A. and Cabibihan, J.J. and Howard, A.M. and Salichs, M.A. and He, H.},
  booktitle = {Lecture Notes in Artificial Intelligence (LNAI)},
  location = {Kansas City, USA},
  pages = {982--992},
  publisher = {Springer},
  title = {{Welcome to the future – How naïve users intuitively address an intelligent robotics apartment.}},
  doi = {10.1007/978-3-319-47437-3\_96},
  volume = {9979},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Jonathan Ginzburg, Julian Hough, Robin Cooper, and David Schlangen Incrementality and Clarification / Sluicing Potential Proceedings of Sinn und Bedeutung 21 2016 [PDF]
BibTeX
```
@inproceedings{Ginzburg-2016,
  author = {Ginzburg, Jonathan and Hough, Julian and Cooper, Robin and Schlangen, David},
  booktitle = {Proceedings of Sinn und Bedeutung 21},
  location = {Edinburgh},
  title = {{Incrementality and Clarification / Sluicing Potential}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sina Zarrieß, and David Schlangen Easy Things First: Installments Improve Referring Expression Generation for Objects in Photographs Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016) 2016 [PDF]

BibTeX

@inproceedings{Zarrieß-2016,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016)},
  location = {Berlin, Germany},
  title = {{Easy Things First: Installments Improve Referring Expression Generation for Objects in Photographs}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sean Andrist, Dan Bohus, Bilge Mutlu, and David Schlangen Turn-Taking and Coordination in Human-Machine Interaction AI Magazine 2016 [PDF]
BibTeX
```
@article{Andrist-2016,
  author = {Andrist, Sean and Bohus, Dan and Mutlu, Bilge and Schlangen, David},
  journal = {AI Magazine},
  number = {4},
  publisher = {AAAI},
  title = {{Turn-Taking and Coordination in Human-Machine Interaction}},
  volume = {37},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Birte Carlmeyer, David Schlangen, and Britta Wrede Exploring self-interruptions as a strategy for regaining the attention of distracted users Proceedings of the 1st Workshop on Embodied Interaction with Smart Environments - EISE ’16 2016 [PDF]

BibTeX

@inproceedings{Carlmeyer-2016,
  author = {Carlmeyer, Birte and Schlangen, David and Wrede, Britta},
  booktitle = {Proceedings of the 1st Workshop on Embodied Interaction with Smart Environments - EISE '16},
  isbn = {9781450345552},
  publisher = {Association for Computing Machinery (ACM)},
  title = {{Exploring self-interruptions as a strategy for regaining the attention of distracted users}},
  doi = {10.1145/3008028.3008029},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, Casey Kennington, Julian Hough, and David Schlangen Recognising Conversational Speech: What an Incremental ASR Should Do for a Dialogue System and How to Get There Proceedings of the International Workshop Series on Spoken Dialogue Systems Technology (IWSDS) 2016 2016 [PDF]
BibTeX
```
@inproceedings{Baumann-2016,
  author = {Baumann, Timo and Kennington, Casey and Hough, Julian and Schlangen, David},
  booktitle = {Proceedings of the International Workshop Series on Spoken Dialogue Systems Technology (IWSDS) 2016},
  title = {{Recognising Conversational Speech: What an Incremental ASR Should Do for a Dialogue System and How to Get There}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Birte Carlmeyer, David Schlangen, and Britta Wrede "Look at Me!": Self-Interruptions as Attention Booster? Proceedings of the Fourth International Conference on Human Agent Interaction - HAI ’16 2016 [PDF]

BibTeX

@inproceedings{Carlmeyer-2016-1,
  author = {Carlmeyer, Birte and Schlangen, David and Wrede, Britta},
  booktitle = {Proceedings of the Fourth International Conference on Human Agent Interaction - HAI '16},
  isbn = {9781450345088},
  location = {Singapore},
  publisher = {Association for Computing Machinery (ACM)},
  title = {{"Look at Me!": Self-Interruptions as Attention Booster?}},
  doi = {10.1145/2974804.2980488},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ramesh Manuvinakurike, Maike Paetzel, Cheng Qu, David Schlangen, and David DeVault Toward Incremental Dialogue Act Segmentation in Fast-Paced Interactive Dialogue Systems Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue 2016 [PDF]
BibTeX
```
@inproceedings{Manuvinakurike-2016,
  author = {Manuvinakurike, Ramesh and Paetzel, Maike and Qu, Cheng and Schlangen, David and DeVault, David},
  booktitle = {Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue},
  location = {Los Angeles, CA, USA},
  title = {{Toward Incremental Dialogue Act Segmentation in Fast-Paced Interactive Dialogue Systems}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, Sina Zarrieß, and Casey Kennington Resolving References to Objects in Photographs using the Words-As-Classifiers Model Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2016 [PDF]

BibTeX

@inproceedings{Schlangen-2016,
  title = {Resolving References to Objects in Photographs using the Words-As-Classifiers Model},
  author = {Schlangen, David and Zarrieß, Sina and Kennington, Casey},
  booktitle = {Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  month = aug,
  year = {2016},
  address = {Berlin, Germany},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/P16-1115},
  doi = {10.18653/v1/P16-1115},
  pages = {1213--1223},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, Ye Tian, Laura Ruiter, Simon Betz, Spyros Kousidis, David Schlangen, and Jonathan Ginzburg DUEL: A Multi-lingual Multimodal Dialogue Corpus for Disfluency, Exclamations and Laughter 10th edition of the Language Resources and Evaluation Conference 2016 [PDF]
BibTeX
```
@inproceedings{Hough-2016,
  author = {Hough, Julian and Tian, Ye and de Ruiter, Laura and Betz, Simon and Kousidis, Spyros and Schlangen, David and Ginzburg, Jonathan},
  booktitle = {10th edition of the Language Resources and Evaluation Conference},
  location = {Portorož (Slovenia)},
  title = {{DUEL: A Multi-lingual Multimodal Dialogue Corpus for Disfluency, Exclamations and Laughter}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Sina Zarrieß, Julian Hough, Casey Kennington, Ramesh Manuvinakurike, David DeVault, Raquel Fernández, and David Schlangen PentoRef: A Corpus of Spoken References in Task-oriented Dialogues 10th edition of the Language Resources and Evaluation Conference 2016 [PDF]
BibTeX
```
@inproceedings{Zarrieß-2016-3,
  author = {Zarrieß, Sina and Hough, Julian and Kennington, Casey and Manuvinakurike, Ramesh and DeVault, David and Fernández, Raquel and Schlangen, David},
  booktitle = {10th edition of the Language Resources and Evaluation Conference},
  location = {Portorož (Slovenia)},
  title = {{PentoRef: A Corpus of Spoken References in Task-oriented Dialogues}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Patrick Holthaus, Christian Leichsenring, Jasmin Bernotat, Viktor Richter, Marian Pohling, Birte Carlmeyer, Norman Köster, Sebastian Borgsen, René Zorn, Birte Schiffhauer, Kai Frederic Engelmann, Florian Lier, Simon Schulz, Philipp Cimiano, Friederike Anne Eyssel, Thomas Hermann, Franz Kummert, David Schlangen, Sven Wachsmuth, Petra Wagner, Britta Wrede, and Sebastian Wrede How to address smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment LREC 2016, Tenth International Conference on Language Resources and Evaluation. [Proceedings] 2016 [Abs] [PDF]
In order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is also inhabited by a social robot that is available as a humanoid interface. This paper presents a multi-modal corpus that contains goal-directed actions of naive users in attempts to solve a number of predefined tasks. Alongside audio and video recordings, our data-set consists of large amount of temporally aligned sensory data and system behavior provided by the environment and its interactive components. Non-verbal system responses such as changes in light or display contents, as well as robot and apartment utterances and gestures serve as a rich basis for later in-depth analysis. Manual annotations provide further information about meta data like the current course of study and user behavior including the incorporated modality, all literal utterances, language features, emotional expressions, foci of attention, and addressees.
BibTeX
```
@inproceedings{Holthaus-2016,
  author = {Holthaus, Patrick and Leichsenring, Christian and Bernotat, Jasmin and Richter, Viktor and Pohling, Marian and Carlmeyer, Birte and Köster, Norman and Meyer zu Borgsen, Sebastian and Zorn, René and Schiffhauer, Birte and Engelmann, Kai Frederic and Lier, Florian and Schulz, Simon and Cimiano, Philipp and Eyssel, Friederike Anne and Hermann, Thomas and Kummert, Franz and Schlangen, David and Wachsmuth, Sven and Wagner, Petra and Wrede, Britta and Wrede, Sebastian},
  editor = {Calzolari, Nicoletta},
  booktitle = {LREC 2016, Tenth International Conference on Language Resources and Evaluation. [Proceedings]},
  isbn = {978-2-9517408-9-1},
  keyword = {interactive corpus, smart home, social robot},
  location = {Portorož, Slovenia},
  pages = {3440--3446},
  publisher = {European Language Resources Association (ELRA)},
  title = {{How to address smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Julian Hough, and David Schlangen Investigating Fluidity for Human-Robot Interaction with Real-Time, Real-World Grounding Strategies Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue 2016 [PDF]

BibTeX

@inproceedings{Hough-2016-1,
  author = {Hough, Julian and Schlangen, David},
  booktitle = {Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue},
  location = {Los Angeles, CA, USA},
  title = {{Investigating Fluidity for Human-Robot Interaction with Real-Time, Real-World Grounding Strategies}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, and David Schlangen Supporting Spoken Assistant Systems with a Graphical User Interface that Signals Incremental Understanding and Prediction State Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue 2016 [PDF]

BibTeX

@inproceedings{Kennington-2016,
  author = {Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue},
  location = {Los Angeles, CA, USA},
  title = {{Supporting Spoken Assistant Systems with a Graphical User Interface that Signals Incremental Understanding and Prediction State}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Viktor Richter, Birte Carlmeyer, Florian Lier, Sebastian Borgsen, David Schlangen, Franz Kummert, Sven Wachsmuth, and Britta Wrede Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees Proceedings of the Fourth International Conference on Human-agent Interaction 2016 [Abs] [PDF]
In this paper we present our humanoid robot “Meka”, partici- pating in a multi party human robot dialogue scenario. Active arbitration of the robot’s attention based-on multi-modal stim- uli is utilised to attain persons which are outside of the robots field of view. We investigate the impact of this attention management and an addressee recognition on the robot’s capability to distinguish utterances directed at it from communication between humans. Based on the results of a user study, we show that mutual gaze at the end of an utterance, as a means of yielding a turn, is a substantial cue for addressee recognition. Verification of a speaker through the detection of lip movements can be used to further increase precision. Further- more, we show that even a rather simplistic fusion of gaze and lip movement cues allows a considerable enhancement in addressee estimation, and can be altered to adapt to the requirements of a particular scenario.
BibTeX
```
@inproceedings{Richter-2016,
  author = {Richter, Viktor and Carlmeyer, Birte and Lier, Florian and Meyer zu Borgsen, Sebastian and Schlangen, David and Kummert, Franz and Wachsmuth, Sven and Wrede, Britta},
  booktitle = {Proceedings of the Fourth International Conference on Human-agent Interaction},
  location = {Singapore},
  publisher = {ACM Digital Library},
  title = {{Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees}},
  doi = {10.1145/2974804.2974823},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Sina Zarrieß, and David Schlangen Towards Generating Colour Terms for Referents in Photographs: Prefer the Expected or the Unexpected? Proceedings of the 9th International Natural Language Generation conference 2016 [Abs] [PDF]

BibTeX

@inproceedings{Zarrieß-2016-4,
  author = {Zarrieß, Sina and Schlangen, David},
  booktitle = {Proceedings of the 9th International Natural Language Generation conference},
  location = {Edinburgh, UK},
  pages = {246----255},
  publisher = {Association for Computational Linguistics},
  title = {{Towards Generating Colour Terms for Referents in Photographs: Prefer the Expected or the Unexpected?}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, and David Schlangen PentoRob: A Puzzle-Playing Robot for Dialogue Experiments Proceedings of JerSem: The 20th Workshop on the Semantics and Pragmatics of Dialogue 2016 [PDF]

BibTeX

@inproceedings{Hough-2016-2,
  author = {Hough, Julian and Schlangen, David},
  editor = {Hunter, Julie and Simons, Mandy and Stone, Matthew},
  booktitle = {Proceedings of JerSem: The 20th Workshop on the Semantics and Pragmatics of Dialogue},
  issn = {2308-2275},
  location = {New Brunswick, NJ},
  pages = {114--115},
  title = {{PentoRob: A Puzzle-Playing Robot for Dialogue Experiments}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ramesh Manuvinakurike, Casey Kennington, David DeVault, and David Schlangen Real-Time Understanding of Complex Discriminative Scene Descriptions Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue 2016 [PDF]
BibTeX
```
@inproceedings{Manuvinakurike-2016-1,
  author = {Manuvinakurike, Ramesh and Kennington, Casey and DeVault, David and Schlangen, David},
  booktitle = {Proceedings of the 17th Annual SIGdial Meeting on Discourse and Dialogue},
  location = {Los Angeles, CA, USA},
  title = {{Real-Time Understanding of Complex Discriminative Scene Descriptions}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen Grounding, Justification, Adaptation: Towards Machines That Mean What They Say Proceedings of the 20th Workshop on the Semantics and Pragmatics of Dialogue (JerSem) 2016 [PDF]

BibTeX

@inproceedings{Schlangen-2016-1,
  author = {Schlangen, David},
  booktitle = {Proceedings of the 20th Workshop on the Semantics and Pragmatics of Dialogue (JerSem)},
  location = {New Brunswick, United States},
  title = {{Grounding, Justification, Adaptation: Towards Machines That Mean What They Say}},
  year = {2016},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2015

Spyridon Kousidis, and David Schlangen The Power of a Glance: Evaluating Embodiment and Turn-Tracking Strategies of an Active Robotic Overhearer Proceedings of AAAI Spring Symposium on Turn-taking and Coordination in Human-Machine Interaction 2015 [PDF]

BibTeX

@inproceedings{Kousidis-2015,
  author = {Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of AAAI Spring Symposium on Turn-taking and Coordination in Human-Machine Interaction},
  location = {Palo Alto, CA, U.S.A.},
  pages = {36--43},
  publisher = {Association for the Advancement of Artificial Intelligence},
  title = {{The Power of a Glance: Evaluating Embodiment and Turn-Tracking Strategies of an Active Robotic Overhearer}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, Livia Dia, and David Schlangen A Discriminative Model for Perceptually-Grounded Incremental Reference Resolution Proceedings of the 11th International Conference on Computational Semantics (IWCS) 2015 2015 [Abs] [PDF]
A large part of human communication involves referring to entities in the world, and often these entities are objects that are visually present for the interlocutors. A computer system that aims to resolve such references needs to tackle a complex task: objects and their visual features must be determined, the referring expressions must be recognised, extra-linguistic information such as eye gaze or pointing gestures must be incorporated — and the intended connection between words and world must be reconstructed. In this paper, we introduce a discriminative model of reference resolution that processes incrementally (i.e., word for word), is perceptually-grounded, and improves when interpolated with information from gaze and pointing gestures. We evaluated our model and found that it performed robustly in a realistic reference resolution task, when compared to a generative model.
BibTeX
```
@inproceedings{Kennington-2015,
  author = {Kennington, Casey and Dia, Livia and Schlangen, David},
  booktitle = {Proceedings of the 11th International Conference on Computational Semantics (IWCS) 2015},
  location = {London},
  pages = {195--205},
  title = {{A Discriminative Model for Perceptually-Grounded Incremental Reference Resolution}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Iwan Kok, Julian Hough, Felix Hülsmann, Mario Botsch, David Schlangen, and Stefan Kopp A Multimodal System for Real-Time Action Instruction in Motor Skill Learning Proceedings of ACM ICMI 17th ACM International Conference on Multimodal Interaction 2015 [PDF]
BibTeX
```
@inproceedings{Kok-2015,
  author = {de Kok, Iwan and Hough, Julian and Hülsmann, Felix and Botsch, Mario and Schlangen, David and Kopp, Stefan},
  booktitle = {Proceedings of ACM ICMI 17th ACM International Conference on Multimodal Interaction},
  location = {Washington},
  pages = {355--362},
  title = {{A Multimodal System for Real-Time Action Instruction in Motor Skill Learning}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Iwan Kok, Julian Hough, Felix Hülsmann, Thomas Waltemate, Mario Botsch, David Schlangen, and Stefan Kopp Demonstrating the Dialogue System of the Intelligent Coaching Space Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue 2015 [PDF]
BibTeX
```
@inproceedings{Kok-2015-1,
  author = {de Kok, Iwan and Hough, Julian and Hülsmann, Felix and Waltemate, Thomas and Botsch, Mario and Schlangen, David and Kopp, Stefan},
  editor = {Howes, Christine and Larsson, Staffan},
  booktitle = {Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue},
  issn = {2308-2275},
  location = {Gothenburg, Sweden},
  pages = {168--169},
  publisher = {University of Gothenburg},
  title = {{Demonstrating the Dialogue System of the Intelligent Coaching Space}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Julian Hough, and David Schlangen Recurrent Neural Networks for Incremental Disfluency Detection Interspeech 2015 2015 [PDF]

BibTeX

@inproceedings{Hough-2015,
  author = {Hough, Julian and Schlangen, David},
  booktitle = {Interspeech 2015},
  location = {Dresden},
  pages = {849--853},
  title = {{Recurrent Neural Networks for Incremental Disfluency Detection}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Simon Betz, Petra Wagner, and David Schlangen Micro-Structure of Disfluencies: Basics for Conversational Speech Synthesis Interspeech 2015 2015 [PDF]

BibTeX

@inproceedings{Betz-2015,
  author = {Betz, Simon and Wagner, Petra and Schlangen, David},
  booktitle = {Interspeech 2015},
  location = {Dresden},
  pages = {2222--2226},
  title = {{Micro-Structure of Disfluencies: Basics for Conversational Speech Synthesis}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Sina Zarrieß, Sebastian Loth, and David Schlangen Reading Times Predict the Quality of Generated Text Above and Beyond Human Ratings Proceedings of the 15th European Workshop on Natural Language Generation 2015 [Abs] [PDF]
Typically, human evaluation of NLG output is based on user ratings. We collected ratings and reading time data in a simple, low-cost experimental paradigm for text generation. Participants were presented corpus texts, automatically linearised texts, and texts containing predicted referring expressions and automatic linearisation. We demonstrate that the reading time metrics outperform the ratings in classifying texts according to their quality. Regression analyses showed that self-reported ratings discriminated poorly between the kinds of manipulation, especially between defects in word order and text coherence. In contrast, a combination of objective measures from the low-cost mouse contingent reading paradigm provided very high classification accuracy and thus, greater insight into the actual quality of an automatically generated text.
BibTeX
```
@inproceedings{Zarrieß-2015,
  author = {Zarrieß, Sina and Loth, Sebastian and Schlangen, David},
  editor = {Belz, Anya and Gatt, Albert and Portet, François and Purver, Matthew},
  booktitle = {Proceedings of the 15th European Workshop on Natural Language Generation},
  isbn = {978-1-941643-78-5},
  location = {BRIGHTON, Sussex, United Kingdom},
  pages = {38--47},
  publisher = {The Association for Computational Linguistics},
  title = {{Reading Times Predict the Quality of Generated Text Above and Beyond Human Ratings}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Julian Hough, Iwan Kok, David Schlangen, and Stefan Kopp Timing and Grounding in Motor Skill Coaching Interaction: Consequences for the Information State Proceedings of the 19th SemDial Workshop on the Semantics and Pragmatics of Dialogue (goDIAL) 2015 [PDF]
BibTeX
```
@inproceedings{Hough-2015-1,
  author = {Hough, Julian and de Kok, Iwan and Schlangen, David and Kopp, Stefan},
  booktitle = {Proceedings of the 19th SemDial Workshop on the Semantics and Pragmatics of Dialogue (goDIAL)},
  issn = {2308-2275},
  location = {Gothenburg, Sweden},
  pages = {86--94},
  title = {{Timing and Grounding in Motor Skill Coaching Interaction: Consequences for the Information State}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Casey Kennington, Ryu Iida, Takunobu Tokunaga, and David Schlangen Incrementally Tracking Reference in Human/Human Dialogue Using Linguistic and Extra-Linguistic Information Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL HLT 2015) 2015 [PDF]
BibTeX
```
@inproceedings{Kennington-2015-1,
  author = {Kennington, Casey and Iida, Ryu and Tokunaga, Takunobu and Schlangen, David},
  booktitle = {Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL HLT 2015)},
  location = {Denver, U.S.A.},
  pages = {272--282},
  publisher = {Association for Computational Linguistics},
  title = {{Incrementally Tracking Reference in Human/Human Dialogue Using Linguistic and Extra-Linguistic Information}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen Semantics and Dialogue 2015 [PDF]

BibTeX

@inbook{Schlangen-2015,
  author = {Schlangen, David},
  editor = {Lappin, Shalom and Fox, Chris},
  booktitle = {The Handbook of Contemporary Semantic Theory, Second Edition},
  publisher = {John Wiley \& Sons, Ltd.},
  title = {{Semantics and Dialogue}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Turn-Taking and Coordination in Human-Machine Interaction 2015 [PDF]

BibTeX

@proceedings{Schlangen-2015-1,
  editor = {Andrist, Sean and Bohus, Dan and Horvitz, Eric and Mutlu, Bilge and Schlangen, David},
  location = {Palo Alto, California, USA},
  publisher = {AAAI},
  title = {{Turn-Taking and Coordination in Human-Machine Interaction}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Simon Betz, Petra Wagner, and David Schlangen Modular Synthesis of Disfluencies for Conversational Speech Systems 2015 [Abs] [PDF]
It has been shown that dialogue systems benefit from incremental architectures to produce fast responses and to interact with the interlocutor in a more human-like way. The advantage of quick responses yields the disadvantage of running out of things to say for a while. In such occasions, humans tend to produce disfluencies as a listener-oriented strategy to signal the ongoing production process and to buy time for finalizing the turn. Introducing disfluency capabilities into a speech synthesis module of a dialogue system may therefore be a straightforward strategy towards conversational speech systems. Disfluencies are a very complex matter, they can take various chaining and nested forms in human communication. We do not attempt to equip our system with the full range of possible disfluent time-buying strategies found in human interaction. For a first perceptual evaluation of the most suitable synthetic disfluency strategy to be integrated into the dialogue system, we focus on three structural factors that are able to cover a wide range of attested disfluency patterns: lengthening, word cutoffs and pauses. This leads to several different configurations a disfluent sentence can take. Sentences from a spontaneous speech corpus were resynthesized in all possible configurations using Mary TTS. In order to identify euphone configurations, these stimuli were then presented to test subjects in a perception test.
BibTeX
```
@inproceedings{Betz-2015-1,
  author = {Betz, Simon and Wagner, Petra and Schlangen, David},
  keyword = {Incrementality, Disfluencies, Speech Synthesis},
  location = {Eichstätt},
  pages = {128--134},
  title = {{Modular Synthesis of Disfluencies for Conversational Speech Systems}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Julian Hough, Casey Kennington, David Schlangen, and Jonathan Ginzburg Incremental Semantics for Dialogue Processing: Requirements and a Comparison of Two Approaches Proceedings of the 11th International Conference on Computational Semantics (IWCS) 2015 2015 [Abs] [PDF]
Truly interactive dialogue systems need to construct meaning on at least a word-by-word basis. We propose desiderata for incremental semantics for dialogue models and systems, a task not heretofore attempted thoroughly. After laying out the desirable properties we illustrate how they are met by current approaches, comparing two incremental semantic processing frameworks: Dynamic Syntax enriched with Type Theory with Records (DS-TTR) and Robust Minimal Recursion Semantics with incremental processing (RMRS-IP). We conclude these approaches are not significantly different with regards to their semantic representation construction, however their purported role within semantic models and dialogue models is where they diverge.
BibTeX
```
@inproceedings{Hough-2015-2,
  author = {Hough, Julian and Kennington, Casey and Schlangen, David and Ginzburg, Jonathan},
  booktitle = {Proceedings of the 11th International Conference on Computational Semantics (IWCS) 2015},
  location = {London},
  pages = {206--216},
  title = {{Incremental Semantics for Dialogue Processing: Requirements and a Comparison of Two Approaches}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Casey Kennington, and David Schlangen Simple Learning and Compositional Application of Perceptually Grounded Word Meanings for Incremental Reference Resolution Proceedings of the Conference for the Association for Computational Linguistics (ACL) 2015 [PDF]

BibTeX

@inproceedings{Kennington-2015-2,
  author = {Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of the Conference for the Association for Computational Linguistics (ACL)},
  location = {Beijing, China},
  pages = {292--301},
  publisher = {Association for Computational Linguistics},
  title = {{Simple Learning and Compositional Application of Perceptually Grounded Word Meanings for Incremental Reference Resolution}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Spyridon Kousidis, Julian Hough, and David Schlangen Exploring the Body and Head Kinematics of Laughter, Filled Pauses and Breaths 2015 [PDF]

BibTeX

@inproceedings{Kousidis-2015-1,
  author = {Kousidis, Spyridon and Hough, Julian and Schlangen, David},
  location = {Enschede, Netherlands},
  pages = {23--25},
  title = {{Exploring the Body and Head Kinematics of Laughter, Filled Pauses and Breaths}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, Maria Soledad Lopez Gambino, and David Schlangen Real-world Reference Game using the Words-as-Classifiers Model of Reference Resolution Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue 2015 [PDF]

BibTeX

@inproceedings{Kennington-2015-3,
  author = {Kennington, Casey and Lopez Gambino, Maria Soledad and Schlangen, David},
  booktitle = {Proceedings of the 19th Workshop on the Semantics and Pragmatics of Dialogue},
  issn = {2308-2275},
  location = {Gothenburg, Sweden},
  pages = {188--189},
  publisher = {University of Gothenburg},
  title = {{Real-world Reference Game using the Words-as-Classifiers Model of Reference Resolution}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, Casey Kennington, and David Schlangen Building and Applying Perceptually-Grounded Representations of Multimodal Scene Descriptions Proceedings of the 19th SemDial Workshop on the Semantics and Pragmatics of Dialogue (goDIAL) 2015 [PDF]

BibTeX

@inproceedings{Han-2015,
  author = {Han, Ting and Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of the 19th SemDial Workshop on the Semantics and Pragmatics of Dialogue (goDIAL)},
  issn = {2308-2275},
  location = {Gothenburg, Sweden},
  pages = {58--66},
  title = {{Building and Applying Perceptually-Grounded Representations of Multimodal Scene Descriptions}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Julian Hough, Laura Ruiter, Simon Betz, and David Schlangen Disfluency and Laughter Annotation in a Light-weight Dialogue Mark-up Protocol 2015 [PDF]
BibTeX
```
@inproceedings{Hough-2015-3,
  author = {Hough, Julian and de Ruiter, Laura and Betz, Simon and Schlangen, David},
  location = {Edinburgh, UK},
  title = {{Disfluency and Laughter Annotation in a Light-weight Dialogue Mark-up Protocol}},
  year = {2015},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2014

Birte Carlmeyer, David Schlangen, and Britta Wrede Towards Closed Feedback Loops in HRI Proceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction - MMRWHRI ’14 2014 [PDF]

BibTeX

@inproceedings{Carlmeyer-2014,
  author = {Carlmeyer, Birte and Schlangen, David and Wrede, Britta},
  booktitle = {Proceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction - MMRWHRI '14},
  isbn = {9781450305518},
  publisher = {Association for Computing Machinery (ACM)},
  title = {{Towards Closed Feedback Loops in HRI}},
  doi = {10.1145/2666499.2666500},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Iwan Kok, Julian Hough, Cornelia Frank, David Schlangen, and Stefan Kopp Dialogue Structure of Coaching Sessions Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters 2014 [PDF]
BibTeX
```
@inproceedings{Kok-2014,
  author = {de Kok, Iwan and Hough, Julian and Frank, Cornelia and Schlangen, David and Kopp, Stefan},
  booktitle = {Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters},
  issn = {2308-2275},
  pages = {167--169},
  title = {{Dialogue Structure of Coaching Sessions}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Casey Kennington, Spyridon Kousidis, Timo Baumann, Hendrik Buschmeier, Stefan Kopp, and David Schlangen Better Driving and Recall When In-car Information Presentation Uses Situationally-Aware Incremental Speech Output Generation AutomotiveUI 2014: Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications 2014 [Abs] [PDF]
It is established that driver distraction is the result of sharing cognitive resources between the primary task (driving) and any other secondary task. In the case of holding conversations, a human passenger who is aware of the driving conditions can choose to interrupt his speech in situations potentially requiring more attention from the driver, but in-car information systems typically do not exhibit such sensitivity. We have designed and tested such a system in a driving simulation environment. Unlike other systems, our system delivers infor- mation via speech (calendar entries with scheduled meetings) but is able to react to signals from the environment to interrupt when the driver needs to be fully attentive to the driving task and subsequently resume its delivery. Distraction is measured by a secondary short-term memory task. In both tasks, drivers perform significantly worse when the system does not adapt its speech, while they perform equally well to control conditions (no concurrent task) when the system intelligently interrupts and resumes.
BibTeX
```
@inproceedings{Kennington-2014,
  author = {Kennington, Casey and Kousidis, Spyridon and Baumann, Timo and Buschmeier, Hendrik and Kopp, Stefan and Schlangen, David},
  booktitle = {AutomotiveUI 2014: Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications},
  location = {Seattle, Washington, USA},
  pages = {7:1--7:7},
  title = {{Better Driving and Recall When In-car Information Presentation Uses Situationally-Aware Incremental Speech Output Generation}},
  doi = {10.1145/2667317.2667332},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Casey Kennington, Spyros Kousidis, and David Schlangen InproTKs: A Toolkit for Incremental Situated Processing Proceedings of SIGdial 2014: Short Papers 2014 [PDF]

BibTeX

@inproceedings{Kennington-2014-1,
  author = {Kennington, Casey and Kousidis, Spyros and Schlangen, David},
  booktitle = {Proceedings of SIGdial 2014: Short Papers},
  location = {Philadelphia, USA},
  pages = {84--88},
  title = {{InproTKs: A Toolkit for Incremental Situated Processing}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Spyridon Kousidis, Casey Kennington, Timo Baumann, Hendrik Buschmeier, Stefan Kopp, and David Schlangen Situationally Aware In-Car Information Presentation Using Incremental Speech Generation: Safer, and More Effective Proceedings of the EACL 2014 Workshop on Dialogue in Motion 2014 [Abs] [PDF]
Holding non-co-located conversations while driving is dangerous (Horrey and Wickens, 2006; Strayer et al., 2006), much more so than conversations with physically present, “situated” interlocutors (Drews et al., 2004). In-car dialogue systems typically resemble non-co-located conversations more, and share their negative impact (Strayer et al., 2013). We implemented and tested a simple strategy for making in-car dialogue systems aware of the driving situation, by giving them the capability to interrupt themselves when a dangerous situation is detected, and resume when over. We show that this improves both driving performance and recall of system-presented information, compared to a non-adaptive strategy.
BibTeX
```
@inproceedings{Kousidis-2014,
  author = {Kousidis, Spyridon and Kennington, Casey and Baumann, Timo and Buschmeier, Hendrik and Kopp, Stefan and Schlangen, David},
  booktitle = {Proceedings of the EACL 2014 Workshop on Dialogue in Motion},
  location = {Gothenburg, Sweden},
  pages = {68--72},
  title = {{Situationally Aware In-Car Information Presentation Using Incremental Speech Generation: Safer, and More Effective}},
  doi = {10.3115/v1/W14-0212},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Casey Kennington, and David Schlangen Situated Incremental Natural Language Understanding Using Markov Logic Networks Computer Speech and Language 2014 [PDF]

BibTeX

@article{Kennington-2014-2,
  author = {Kennington, Casey and Schlangen, David},
  issn = {0885-2308},
  journal = {Computer Speech and Language},
  number = {1},
  pages = {240--255},
  publisher = {Elsevier BV},
  title = {{Situated Incremental Natural Language Understanding Using Markov Logic Networks}},
  doi = {10.1016/j.csl.2013.06.004},
  volume = {28},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Spyridon Kousidis, Casey Kennington, Timo Baumann, Hendrik Buschmeier, Stefan Kopp, and David Schlangen A Multimodal In-Car Dialogue System That Tracks The Driver’s Attention Proceedings of the 16th International Conference on Multimodal Interfaces 2014 [Abs] [PDF]
When a passenger speaks to a driver, he or she is co-located with the driver, is generally aware of the situation, and can stop speaking to allow the driver to focus on the driving task. In-car dialogue systems ignore these important aspects, making them more distracting than even cell-phone conversations. We developed and tested a “situationally-aware” dialogue system that can interrupt its speech when a situation which requires more attention from the driver is detected, and can resume when driving conditions return to normal. Furthermore, our system allows driver-controlled resumption of interrupted speech via verbal or visual cues (head nods). Over two experiments, we found that the situationally-aware spoken dialogue system improves driving performance and attention to the speech content, while driver-controlled speech resumption does not hinder performance in either of these two tasks.
BibTeX
```
@inproceedings{Kousidis-2014-1,
  author = {Kousidis, Spyridon and Kennington, Casey and Baumann, Timo and Buschmeier, Hendrik and Kopp, Stefan and Schlangen, David},
  booktitle = {Proceedings of the 16th International Conference on Multimodal Interfaces},
  location = {Istanbul, Turkey},
  pages = {26--33},
  title = {{A Multimodal In-Car Dialogue System That Tracks The Driver's Attention}},
  doi = {10.1145/2663204.2663244},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Jonathan Ginzburg, Ye Tian, Pascal Amsili, Claire Beyssade, Barbera Hemforth, Yannick Mathieu, Claire Saillard, Julian Hough, Spyridon Kousidis, and David Schlangen The Disfluency, Exclamation and Laughter in Dialogue (DUEL) Project Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters 2014 [PDF]
BibTeX
```
@inproceedings{Ginzburg-2014,
  author = {Ginzburg, Jonathan and Tian, Ye and Amsili, Pascal and Beyssade, Claire and Hemforth, Barbera and Mathieu, Yannick and Saillard, Claire and Hough, Julian and Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters},
  issn = {2308-2275},
  location = {Herriot-Watt University},
  pages = {176--178},
  title = {{The Disfluency, Exclamation and Laughter in Dialogue (DUEL) Project}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Casey Kennington, Spyridon Kousidis, and David Schlangen Multimodal Dialogue Systems with InproTKs and Venice Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt). Posters 2014 [PDF]

BibTeX

@inproceedings{Kennington-2014-3,
  author = {Kennington, Casey and Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt). Posters},
  issn = {2308-2275},
  pages = {202--204},
  title = {{Multimodal Dialogue Systems with InproTKs and Venice}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, Spyridon Kousidis, and David Schlangen Situated Incremental Natural Language Understanding using a Multimodal, Linguistically-driven Update Model Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers (COLING 14) 2014 [PDF]

BibTeX

@inproceedings{Kennington-2014-4,
  author = {Kennington, Casey and Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers (COLING 14)},
  location = {Dublin},
  pages = {1803--1812},
  publisher = {Dublin University and Association for Computational Linguistics},
  title = {{Situated Incremental Natural Language Understanding using a Multimodal, Linguistically-driven Update Model}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, and David Schlangen Comparing Listener Gaze with Predictions of an Incremental Reference Resolution Model 2014 [PDF]

BibTeX

@inproceedings{Kennington-2014-5,
  author = {Kennington, Casey and Schlangen, David},
  location = {Edinburgh},
  title = {{Comparing Listener Gaze with Predictions of an Incremental Reference Resolution Model}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ting Han, Spyridon Kousidis, and David Schlangen Towards Automatic Understanding of ‘Virtual Pointing’ in Interaction Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters 2014 [PDF]
BibTeX
```
@inproceedings{Han-2014,
  author = {Han, Ting and Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of the 18th SemDial Workshop on the Semantics and Pragmatics of Dialogue (DialWatt), Posters},
  issn = {2308-2275},
  pages = {188--190},
  title = {{Towards Automatic Understanding of `Virtual Pointing’ in Interaction}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Ting Han, Spyridon Kousidis, and David Schlangen A Corpus of Virtual Pointing Gestures 2014 [PDF]
BibTeX
```
@inproceedings{Han-2014-1,
  author = {Han, Ting and Kousidis, Spyridon and Schlangen, David},
  location = {Edinburgh},
  title = {{A Corpus of Virtual Pointing Gestures}},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Jonathan Ginzburg, Raquel Fernández, and David Schlangen Dysfluencies as intra-utterance dialogue moves Semantics and Pragmatics 2014 [PDF]

BibTeX

@article{Ginzburg-2014-1,
  author = {Ginzburg, Jonathan and Fernández, Raquel and Schlangen, David},
  issn = {1937-8912},
  journal = {Semantics and Pragmatics},
  publisher = {Semantics and Pragmatics},
  title = {{Dysfluencies as intra-utterance dialogue moves}},
  doi = {10.3765/sp.7.9},
  volume = {7},
  year = {2014},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2013

Spyridon Kousidis, and David Schlangen Experiences in Collection and Analysis of Multimodal Data using MINT.tools Proceedings of the International Workshop Series on Multimodal Corpora, Tools and Resources 2013 [PDF]

BibTeX

@inproceedings{Kousidis-2013,
  author = {Kousidis, Spyridon and Schlangen, David},
  editor = {Edlund, Jens and Heylen, Dirk and Paggio, P},
  booktitle = {Proceedings of the International Workshop Series on Multimodal Corpora, Tools and Resources},
  location = {Edinburgh},
  title = {{Experiences in Collection and Analysis of Multimodal Data using MINT.tools}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Spyridon Kousidis, Thies Pfeiffer, and David Schlangen MINT.tools: Tools and Adaptors Supporting Acquisition, Annotation and Analysis of Multimodal Corpora Proceedings of Interspeech 2013 2013 [PDF]

BibTeX

@inproceedings{Kousidis-2013-1,
  author = {Kousidis, Spyridon and Pfeiffer, Thies and Schlangen, David},
  booktitle = {Proceedings of Interspeech 2013},
  keyword = {Multimodal Communication},
  location = {Lyon, France},
  publisher = {ISCA},
  title = {{MINT.tools: Tools and Adaptors Supporting Acquisition, Annotation and Analysis of Multimodal Corpora}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Spyridon Kousidis, Zofia Malisz, Petra Wagner, and David Schlangen Exploring Annotation of Head Gesture Forms in Spontaneous Human Interaction Proceedings of the Tilburg Gesture Meeting (TiGeR 2013) 2013 [PDF]
BibTeX
```
@inproceedings{Kousidis-2013-2,
  author = {Kousidis, Spyridon and Malisz, Zofia and Wagner, Petra and Schlangen, David},
  booktitle = {Proceedings of the Tilburg Gesture Meeting (TiGeR 2013)},
  location = {Tilburg},
  title = {{Exploring Annotation of Head Gesture Forms in Spontaneous Human Interaction}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Jonathan Ginzburg, Raquel Fernández, and David Schlangen Self-Addressed Questions in Dysfluencies Proceedings of DiSS 2013: The 6th Workshop on Disfluency in Spontaneous Speech 2013 [PDF]
BibTeX
```
@inproceedings{Ginzburg-2013,
  author = {Ginzburg, Jonathan and Fernández, Raquel and Schlangen, David},
  booktitle = {Proceedings of DiSS 2013: The 6th Workshop on Disfluency in Spontaneous Speech},
  location = {Stockholm, Sweden},
  title = {{Self-Addressed Questions in Dysfluencies}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Spyridon Kousidis, David Schlangen, and Stavros Skopeteas A cross-linguistic study on turn-taking and temporal alignment in verbal interaction Proceedings of Interspeech 2013 2013 [PDF]
BibTeX
```
@inproceedings{Kousidis-2013-3,
  author = {Kousidis, Spyridon and Schlangen, David and Skopeteas, Stavros},
  booktitle = {Proceedings of Interspeech 2013},
  location = {Lyon, France},
  title = {{A cross-linguistic study on turn-taking and temporal alignment in verbal interaction}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Herwin Welbergen, Timo Baumann, Stefan Kopp, and David Schlangen Incremental, Adaptive and Interruptive Speech Realization for Fluent Conversation with ECAs Intelligent Virtual Agents 2013 [PDF]

BibTeX

@inproceedings{Welbergen-2013,
  author = {van Welbergen, Herwin and Baumann, Timo and Kopp, Stefan and Schlangen, David},
  editor = {Aylett, Ruth and Krenn, Brigitte and Pelachaud, Catherine and Shimodaira, Hiroshi},
  booktitle = {Intelligent Virtual Agents},
  isbn = {978-3-642-40414-6},
  pages = {468--469},
  publisher = {Springer},
  title = {{Incremental, Adaptive and Interruptive Speech Realization for Fluent Conversation with ECAs}},
  volume = {8108},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, and David Schlangen Interactional Adequacy as a Factor in the Perception of Synthesized Speech Proceedings of the 8th ISCA Speech Synthesis Workshop 2013 [PDF]

BibTeX

@inproceedings{Baumann-2013,
  author = {Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the 8th ISCA Speech Synthesis Workshop},
  location = {Barcelona, Spain},
  title = {{Interactional Adequacy as a Factor in the Perception of Synthesized Speech}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, and David Schlangen Open-ended, Extensible System Utterances Are Preferred, Even If They Require Filled Pauses Proceedings of Short Papers at SIGdial 2013 2013 [PDF]

BibTeX

@inproceedings{Baumann-2013-1,
  author = {Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of Short Papers at SIGdial 2013},
  location = {Metz, France},
  title = {{Open-ended, Extensible System Utterances Are Preferred, Even If They Require Filled Pauses}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, Spyridon Kousidis, and David Schlangen Interpreting Situated Dialogue Utterances: an Update Model that Uses Speech, Gaze, and Gesture Information Proceedings of SIGdial 2013 2013 [PDF]
BibTeX
```
@inproceedings{Kennington-2013,
  author = {Kennington, Casey and Kousidis, Spyridon and Schlangen, David},
  booktitle = {Proceedings of SIGdial 2013},
  location = {Metz, France},
  title = {{Interpreting Situated Dialogue Utterances: an Update Model that Uses Speech, Gaze, and Gesture Information}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Spyridon Kousidis, Casey Kennington, and David Schlangen Investigating speaker gaze and pointing behaviour in human-computer interaction with the ‘mint.tools‘ collection Proceedings of Short Papers at SIGdial 2013 2013 [PDF]
BibTeX
```
@inproceedings{Kousidis-2013-4,
  author = {Kousidis, Spyridon and Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of Short Papers at SIGdial 2013},
  location = {Metz, France},
  title = {{Investigating speaker gaze and pointing behaviour in human-computer interaction with the `mint.tools` collection}},
  year = {2013},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2012

Spyridon Kousidis, Thies Pfeiffer, Zofia Malisz, Petra Wagner, and David Schlangen Evaluating a minimally invasive laboratory architecture for recording multimodal conversational data. Proceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog, INTERSPEECH2012 Satellite Workshop 2012 [Abs] [PDF]
This paper presents ongoing work on the design, deployment and evaluation of a multimodal data acquisition architecture which utilises minimally invasive motion, head, eye and gaze tracking alongside high-quality audiovisual recording of human interactions. The different data streams are centrally collected and visualised at a single point and in real time by means of integration in a virtual reality (VR) environment. The overall aim of this endeavour is the implementation of a multimodal data acquisition facility for the purpose of studying non-verbal phenomena such as feedback gestures, hand and pointing gestures and multi-modal alignment. In the first part of this work that is described here, a series of tests were performed in order to evaluate the feasibility of tracking feedback head gestures using the proposed architecture.
BibTeX
```
@inproceedings{Kousidis-2012,
  author = {Kousidis, Spyridon and Pfeiffer, Thies and Malisz, Zofia and Wagner, Petra and Schlangen, David},
  booktitle = {Proceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog, INTERSPEECH2012 Satellite Workshop},
  keyword = {Multimodal Communication},
  location = {Stevenson, WA},
  pages = {39--42},
  title = {{Evaluating a minimally invasive laboratory architecture for recording multimodal conversational data.}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Timo Baumann, and David Schlangen INPRO_iSS: A Component for Just-In-Time Incremental Speech Synthesis Proceedings of the ACL 2012 System Demonstrations 2012 [PDF]

BibTeX

@inproceedings{Baumann-2012,
  author = {Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the ACL 2012 System Demonstrations},
  location = {Jeju, Korea},
  pages = {103--108},
  publisher = {ACL},
  title = {{INPRO\_iSS: A Component for Just-In-Time Incremental Speech Synthesis}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, and David Schlangen Evaluating Prosodic Processing for Incremental Speech Synthesis Proceedings of Interspeech 2012 [PDF]

BibTeX

@inproceedings{Baumann-2012-1,
  author = {Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of Interspeech},
  location = {Portland, USA},
  title = {{Evaluating Prosodic Processing for Incremental Speech Synthesis}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Hendrik Buschmeier, Timo Baumann, Benjamin Dosch, Stefan Kopp, and David Schlangen Combining Incremental Language Generation and Incremental Speech Synthesis for Adaptive Information Presentation Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue 2012 [Abs] [PDF]
Participants in a conversation are normally receptive to their surroundings and their interlocutors, even while they are speaking and can, if necessary, adapt their ongoing utterance. Typical dialogue systems are not receptive and cannot adapt while uttering. We present combinable components for incremental natural language generation and incremental speech synthesis and demonstrate the flexibility they can achieve with an example system that adapts to a listener’s acoustic understanding problems by pausing, repeating and possibly rephrasing problematic parts of an utterance. In an evaluation, this system was rated as significantly more natural than two systems representing the current state of the art that either ignore the interrupting event or just pause; it also has a lower response time. Video of talk available here: http://www.superlectures.com/sigdial2012/lecture.php?lang=en&id=17
BibTeX
```
@inproceedings{Buschmeier-2012,
  author = {Buschmeier, Hendrik and Baumann, Timo and Dosch, Benjamin and Kopp, Stefan and Schlangen, David},
  booktitle = {Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
  keyword = {Dialogue Systems, Incremental Speech Synthesis, Incremental Natural Language Generation},
  location = {Seoul, South Korea},
  pages = {295--303},
  title = {{Combining Incremental Language Generation and Incremental Speech Synthesis for Adaptive Information Presentation}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Andreas Peldszus, and David Schlangen Incremental Construction of Robust but Deep Semantic Representations for Use in Responsive Dialogue Systems Proceedings of the Coling Workshop on Advances in Discourse Analysis and its Computational Aspects 2012 [PDF]

BibTeX

@inproceedings{Peldszus-2012,
  author = {Peldszus, Andreas and Schlangen, David},
  editor = {Hajičová, Eva},
  booktitle = {Proceedings of the Coling Workshop on Advances in Discourse Analysis and its Computational Aspects},
  location = {Mumbai, India},
  title = {{Incremental Construction of Robust but Deep Semantic Representations for Use in Responsive Dialogue Systems}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Jonathan Ginzburg, Raquel Fernández, and David Schlangen On the Semantics and Pragmatics of Dysfluency 2012 [PDF]

BibTeX

@inbook{Ginzburg-2012,
  author = {Ginzburg, Jonathan and Fernández, Raquel and Schlangen, David},
  editor = {Aloni, Maria},
  booktitle = {Logic, Language and Meaning: 18th Amsterdam Colloquium, Amsterdam , The Netherlands, December 19-21, 2011, Revised Selected Papers},
  isbn = {978-3-642-31482-7},
  pages = {321--330},
  publisher = {Springer},
  title = {{On the Semantics and Pragmatics of Dysfluency}},
  doi = {10.1007/978-3-642-31482-7\_33},
  volume = {7218},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, and David Schlangen The InproTK 2012 release SDCTD ’12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data 2012 [PDF]

BibTeX

@inproceedings{Baumann-2012-2,
  author = {Baumann, Timo and Schlangen, David},
  editor = {Eskenazi, Maxine and Black, Alan and Traum, David},
  booktitle = {SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data},
  location = {Montreal, Canada},
  pages = {29--32},
  publisher = {ACL},
  title = {{The InproTK 2012 release}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen The Future of Spoken Dialogue Systems is in their Past: Long-Term Adaptive, Conversational Assistants Proceedings of the NAACL-HLT 2012 Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data 2012 [PDF]

BibTeX

@inproceedings{Schlangen-2012,
  author = {Schlangen, David},
  booktitle = {Proceedings of the NAACL-HLT 2012 Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data},
  location = {Montreal, Canada},
  pages = {11--12},
  publisher = {ACL},
  title = {{The Future of Spoken Dialogue Systems is in their Past: Long-Term Adaptive, Conversational Assistants}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Casey Kennington, and David Schlangen Markov Logic Networks for Incremental Natural Language Understanding Proceedings of the 13th Meeting of the Special Interest Group on Discourse and Dialogue (SIGdial) 2012 [Abs] [PDF]
Video of talk available here: href="http://www.superlectures.com/sigdial2012/lecture.php?lang=en&id=19
BibTeX
```
@inproceedings{Kennington-2012,
  author = {Kennington, Casey and Schlangen, David},
  booktitle = {Proceedings of the 13th Meeting of the Special Interest Group on Discourse and Dialogue (SIGdial)},
  location = {Seoul, Korea},
  pages = {314--323},
  publisher = {SIGdial},
  title = {{Markov Logic Networks for Incremental Natural Language Understanding}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Andreas Peldszus, Okko Buß, Timo Baumann, and David Schlangen Joint Satisfaction of Syntactic and Pragmatic Constraints Improves Incremental Spoken Language Understanding 2012 [PDF]
BibTeX
```
@inproceedings{Peldszus-2012-1,
  author = {Peldszus, Andreas and Buß, Okko and Baumann, Timo and Schlangen, David},
  location = {Avignon, France},
  pages = {514--523},
  publisher = {Association for Computational Linguistics},
  title = {{Joint Satisfaction of Syntactic and Pragmatic Constraints Improves Incremental Spoken Language Understanding}},
  year = {2012},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2011

Special issue 2011 [PDF]

BibTeX

@misc{Peldszus-2011,
  editor = {Rieser, Hannes and Schlangen, David},
  booktitle = {Dialogue and Discourse},
  number = {1},
  title = {{Special issue}},
  volume = {2},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, and David Schlangen Predicting the Micro-Timing of User Input for an Incremental Spoken Dialogue System that Completes a User’s Ongoing Turn 2011 [PDF]

BibTeX

@inproceedings{Baumann-2011,
  author = {Baumann, Timo and Schlangen, David},
  location = {Portland, OR, USA},
  pages = {120--129},
  title = {{Predicting the Micro-Timing of User Input for an Incremental Spoken Dialogue System that Completes a User's Ongoing Turn}},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Timo Baumann, Okko Buß, and David Schlangen Evaluation and Optimisation of Incremental Processors Dialogue and Discourse 2011 [PDF]

BibTeX

@article{Baumann-2011-1,
  author = {Baumann, Timo and Buß, Okko and Schlangen, David},
  issn = {2152-9620},
  journal = {Dialogue and Discourse},
  number = {1},
  pages = {113--141},
  publisher = {Dialogue and Discourse},
  title = {{Evaluation and Optimisation of Incremental Processors}},
  doi = {10.5087/dad.2011.106},
  volume = {2},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Hannes Rieser, and David Schlangen Introduction to the Special Issue on Incremental Processing in Dialogue Dialogue and Discourse 2011 [PDF]

BibTeX

@article{Rieser-2011,
  author = {Rieser, Hannes and Schlangen, David},
  issn = {2152-9620},
  journal = {Dialogue and Discourse},
  number = {1},
  pages = {1--10},
  publisher = {Dialogue and Discourse},
  title = {{Introduction to the Special Issue on Incremental Processing in Dialogue}},
  doi = {10.5087/dad.2010.001},
  volume = {2},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Okko Buß, and David Schlangen DIUM – An Incremental Dialogue Manager That Can Produce Self-Corrections Proceedings of semdial 2011 (Los Angelogue) 2011 [PDF]

BibTeX

@inproceedings{Buß-2011,
  author = {Buß, Okko and Schlangen, David},
  booktitle = {Proceedings of semdial 2011 (Los Angelogue)},
  location = {Los Angeles, CA, USA},
  title = {{DIUM – An Incremental Dialogue Manager That Can Produce Self-Corrections}},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Raquel Fernández, Staffan Larsson, Robin Cooper, Jonathan Ginzburg, and David Schlangen Reciprocal Learning via Dialogue Interaction: Challenges and Prospects Proceedings of the IJCAI 2011 Workshop on Agents Learning Interactively from Human Teachers (ALIHT 2011) 2011 [PDF]
BibTeX
```
@inproceedings{Fernandez-2011,
  author = {Fernández, Raquel and Larsson, Staffan and Cooper, Robin and Ginzburg, Jonathan and Schlangen, David},
  booktitle = {Proceedings of the IJCAI 2011 Workshop on Agents Learning Interactively from Human Teachers (ALIHT 2011)},
  title = {{Reciprocal Learning via Dialogue Interaction: Challenges and Prospects}},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, and Gabriel Skantze A General, Abstract Model of Incremental Dialogue Processing Dialogue and Discourse 2011 [PDF]

BibTeX

@article{Schlangen-2011,
  author = {Schlangen, David and Skantze, Gabriel},
  issn = {2152-9620},
  journal = {Dialogue and Discourse},
  number = {1},
  pages = {83--111},
  publisher = {Dialogue and Discourse},
  title = {{A General, Abstract Model of Incremental Dialogue Processing}},
  doi = {10.5087/dad.2011.105},
  volume = {2},
  year = {2011},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2010

Okko Buß, and David Schlangen Modelling Sub-Utterance Phenomena in Spoken Dialogue Systems Proceedings of the 14th International Workshop on the Semantics and Pragmatics of Dialogue (Pozdial 2010) 2010 [PDF]

BibTeX

@inproceedings{Buß-2010,
  author = {Buß, Okko and Schlangen, David},
  booktitle = {Proceedings of the 14th International Workshop on the Semantics and Pragmatics of Dialogue (Pozdial 2010)},
  pages = {33--41},
  title = {{Modelling Sub-Utterance Phenomena in Spoken Dialogue Systems}},
  year = {2010},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Silvan Heintze, Timo Baumann, and David Schlangen Comparing Local and Sequential Models for Statistical Incremental Natural Language Understanding Proceedings of the SIGdial 2010 Conference 2010 [PDF]
BibTeX
```
@inproceedings{Heintze-2010,
  author = {Heintze, Silvan and Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the SIGdial 2010 Conference},
  pages = {9--16},
  title = {{Comparing Local and Sequential Models for Statistical Incremental Natural Language Understanding}},
  year = {2010},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Okko Buß, Timo Baumann, and David Schlangen Collaborating on Utterances with a Spoken Dialogue System Using an ISU-based Approach to Incremental Dialogue Management Proceedings of the SIGdial 2010 Conference 2010 [PDF]
BibTeX
```
@inproceedings{Buß-2010-1,
  author = {Buß, Okko and Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the SIGdial 2010 Conference},
  pages = {233--236},
  title = {{Collaborating on Utterances with a Spoken Dialogue System Using an ISU-based Approach to Incremental Dialogue Management}},
  year = {2010},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen Practices in Dialogue Proceedings of the 14th International Workshop on the Semantics and Pragmatics of Dialogue (Pozdial 2010) 2010 [PDF]

BibTeX

@inproceedings{Schlangen-2010,
  author = {Schlangen, David},
  booktitle = {Proceedings of the 14th International Workshop on the Semantics and Pragmatics of Dialogue (Pozdial 2010)},
  pages = {25--32},
  title = {{Practices in Dialogue}},
  year = {2010},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Timo Baumann, Hendrik Buschmeier, Stefan Kopp, Gabriel Skantze, and Ramin Yaghoubzadeh Middleware for Incremental Processing in Conversational Agents Proceedings of SIGDIAL 2010: the 11th Annual Meeting of the Special Interest Group in Discourse and Dialogue 2010 [Abs] [PDF]
We describe work done at three sites on designing conversational agents capable of incremental processing. We focus on the ‘middleware’ layer in these systems, which takes care of passing around and maintaining incremental information between the modules of such agents. All implementations are based on the abstract model of incremental dialogue processing proposed by Schlangen and Skantze (2009), and the paper shows what different instantiations of the model can look like given specific requirements and application areas.
BibTeX
```
@inproceedings{Schlangen-2010-1,
  author = {Schlangen, David and Baumann, Timo and Buschmeier, Hendrik and Kopp, Stefan and Skantze, Gabriel and Yaghoubzadeh, Ramin},
  booktitle = {Proceedings of SIGDIAL 2010: the 11th Annual Meeting of the Special Interest Group in Discourse and Dialogue},
  location = {Tokyo, Japan},
  pages = {51--54},
  publisher = {Association for Computational Linguistics},
  title = {{Middleware for Incremental Processing in Conversational Agents}},
  year = {2010},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2009

Timo Baumann, Michaela Atterer, and David Schlangen Assessing and Improving the Performance of Speech Recognition for Incremental Systems Proceedings of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT) 2009 Conference 2009 [PDF]
BibTeX
```
@inproceedings{Baumann-2009,
  author = {Baumann, Timo and Atterer, Michaela and Schlangen, David},
  booktitle = {Proceedings of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT) 2009 Conference},
  title = {{Assessing and Improving the Performance of Speech Recognition for Incremental Systems}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen What we can learn from Dialogue Systems that don’t work: On Dialogue Systems as Cognitive Models Proceedings of DiaHolmia, the 13th International Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2009) 2009 [PDF]

BibTeX

@inproceedings{Schlangen-2009,
  author = {Schlangen, David},
  booktitle = {Proceedings of DiaHolmia, the 13th International Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2009)},
  pages = {51--58},
  title = {{What we can learn from Dialogue Systems that don't work: On Dialogue Systems as Cognitive Models}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Gabriel Skantze, and David Schlangen Incremental Dialogue Processing in a Micro-Domain Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2009) 2009 [PDF]

BibTeX

@inproceedings{Skantze-2009,
  author = {Skantze, Gabriel and Schlangen, David},
  booktitle = {Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2009)},
  pages = {745--753},
  title = {{Incremental Dialogue Processing in a Micro-Domain}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Titus Malsburg, Timo Baumann, and David Schlangen TELIDA: A Package for Manipulation and Visualisation of Timed Linguistic Data Proceedings of the Poster Session at SIGdial 2009, the 10th Annual SIGDIAL Meeting on Discourse and Dialogue 2009 [PDF]
BibTeX
```
@inproceedings{Malsburg-2009,
  author = {von der Malsburg, Titus and Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the Poster Session at SIGdial 2009, the 10th Annual SIGDIAL Meeting on Discourse and Dialogue},
  title = {{TELIDA: A Package for Manipulation and Visualisation of Timed Linguistic Data}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Michaela Atterer, Timo Baumann, and David Schlangen No Sooner Said Than Done? Testing Incrementality of Semantic Interpretations of Spontaneous Speech Proceedings of Interspeech 2009 2009 [PDF]
BibTeX
```
@inproceedings{Atterer-2009,
  author = {Atterer, Michaela and Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of Interspeech 2009},
  title = {{No Sooner Said Than Done? Testing Incrementality of Semantic Interpretations of Spontaneous Speech}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, and Gabriel Skantze A General, Abstract Model of Incremental Dialogue Processing Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2009) 2009 [PDF]

BibTeX

@inproceedings{Schlangen-2009-1,
  author = {Schlangen, David and Skantze, Gabriel},
  booktitle = {Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2009)},
  pages = {710--718},
  title = {{A General, Abstract Model of Incremental Dialogue Processing}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Timo Baumann, and Michaela Atterer Incremental Reference Resolution: The Task, Metrics for Evaluation, and a Bayesian Filtering Model that is Sensitive to Disfluencies Proceedings of SIGdial 2009, the 10th Annual SIGDIAL Meeting on Discourse and Dialogue 2009 [PDF]
BibTeX
```
@inproceedings{Schlangen-2009-2,
  author = {Schlangen, David and Baumann, Timo and Atterer, Michaela},
  booktitle = {Proceedings of SIGdial 2009, the 10th Annual SIGDIAL Meeting on Discourse and Dialogue},
  title = {{Incremental Reference Resolution: The Task, Metrics for Evaluation, and a Bayesian Filtering Model that is Sensitive to Disfluencies}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details
Timo Baumann, Okko Buß, and David Schlangen Evaluating the Potential Utility of ASR N-Best Lists for Incremental Spoken Dialogue Systems Proceedings of Interspeech 2009 2009 [PDF]
BibTeX
```
@inproceedings{Baumann-2009-1,
  author = {Baumann, Timo and Buß, Okko and Schlangen, David},
  booktitle = {Proceedings of Interspeech 2009},
  title = {{Evaluating the Potential Utility of ASR N-Best Lists for Incremental Spoken Dialogue Systems}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Michaela Atterer, and David Schlangen RUBISC – A Robust Unification-Based Incremental Semantic Chunker Proceedings of the 2nd International Workshop on Semantic Representation of Spoken Language (SRSL 2009) 2009 [PDF]

BibTeX

@inproceedings{Atterer-2009-1,
  author = {Atterer, Michaela and Schlangen, David},
  booktitle = {Proceedings of the 2nd International Workshop on Semantic Representation of Spoken Language (SRSL 2009)},
  title = {{RUBISC – A Robust Unification-Based Incremental Semantic Chunker}},
  year = {2009},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2008

David Schlangen, and Raquel Fernández The Potsdam Dialogue Corpora: Transcription and Annotation Manual 2008 [PDF]

BibTeX

@techreport{Schlangen-2008,
  author = {Schlangen, David and Fernández, Raquel},
  publisher = {University of Potsdam},
  title = {{The Potsdam Dialogue Corpora: Transcription and Annotation Manual}},
  year = {2008},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Michaela Atterer, Timo Baumann, and David Schlangen Towards Incremental End-of-Utterance Detection in Dialogue Systems Proceedings of the 22nd International Conference on Computational Linguistics 2008 [PDF]
BibTeX
```
@inproceedings{Atterer-2008,
  author = {Atterer, Michaela and Baumann, Timo and Schlangen, David},
  booktitle = {Proceedings of the 22nd International Conference on Computational Linguistics},
  title = {{Towards Incremental End-of-Utterance Detection in Dialogue Systems}},
  year = {2008},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, and Raquel Fernández The Potsdam Dialogue Corpora: Experiment Handbook 2008 [PDF]

BibTeX

@techreport{Schlangen-2008-1,
  author = {Schlangen, David and Fernández, Raquel},
  publisher = {University of Potsdam},
  title = {{The Potsdam Dialogue Corpora: Experiment Handbook}},
  year = {2008},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Alexander Siebert, and David Schlangen A Simple Method for Resolution of Definite Reference in a Shared Visual Context Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue 2008 [PDF]

BibTeX

@inproceedings{Siebert-2008,
  author = {Siebert, Alexander and Schlangen, David},
  booktitle = {Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue},
  pages = {84--87},
  publisher = {Association for Computational Linguistics},
  title = {{A Simple Method for Resolution of Definite Reference in a Shared Visual Context}},
  year = {2008},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2007

Jonathan Ginzburg, Raquel Fernández, and David Schlangen Unifying Self- and Other-Repair Proceeding of DECALOG, the 11th International Workshop on the Semantics and Pragmatics of Dialogue (SemDial07) 2007 [PDF]
BibTeX
```
@inproceedings{Ginzburg-2007,
  author = {Ginzburg, Jonathan and Fernández, Raquel and Schlangen, David},
  booktitle = {Proceeding of DECALOG, the 11th International Workshop on the Semantics and Pragmatics of Dialogue (SemDial07)},
  title = {{Unifying Self- and Other-Repair}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Raquel Fernández, and David Schlangen Referring under Restricted Interactivity Conditions Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue 2007 [PDF]

BibTeX

@inproceedings{Fernandez-2007,
  author = {Fernández, Raquel and Schlangen, David},
  editor = {Keizer, Simon and Bunt, Harry and Paek, Tim},
  booktitle = {Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue},
  pages = {136--139},
  title = {{Referring under Restricted Interactivity Conditions}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Alexander Siebert, David Schlangen, and Raquel Fernández An Implemented Method for Distributed Collection and Assessment of Speech Data Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue 2007 [PDF]

BibTeX

@inproceedings{Siebert-2007,
  author = {Siebert, Alexander and Schlangen, David and Fernández, Raquel},
  editor = {Keizer, Simon and Bunt, Harry and Paek, Tim},
  booktitle = {Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue},
  pages = {47--50},
  title = {{An Implemented Method for Distributed Collection and Assessment of Speech Data}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, and Raquel Fernández Speaking through a noisy channel - Experiments on inducing clarification behaviour in human-human dialogue Proceedings of Interspeech 2007 2007 [PDF]

BibTeX

@inproceedings{Schlangen-2007,
  author = {Schlangen, David and Fernández, Raquel},
  booktitle = {Proceedings of Interspeech 2007},
  title = {{Speaking through a noisy channel - Experiments on inducing clarification behaviour in human-human dialogue}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Raquel Fernández, Andrea Corradini, David Schlangen, and Manfred Stede Towards Reducing and Managing Uncertainty in Spoken Dialogue Systems Proceedings of the 7th International Workshop on Computational Semantics (IWCS07) 2007 [PDF]
BibTeX
```
@inproceedings{Fernandez-2007-1,
  author = {Fernández, Raquel and Corradini, Andrea and Schlangen, David and Stede, Manfred},
  booktitle = {Proceedings of the 7th International Workshop on Computational Semantics (IWCS07)},
  title = {{Towards Reducing and Managing Uncertainty in Spoken Dialogue Systems}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

Elena Paslaru Bontas Simperl, and David Schlangen Creating ontologies for content representation - the OntoSeed suite 2007 [PDF]

BibTeX

@inbook{Bontas_Simperl-2007,
  author = {Bontas Simperl, Elena Paslaru and Schlangen, David},
  editor = {Spaccapietra, Stefano},
  booktitle = {Journal on Data Semantics 9 (u.a.: 4th International Conference on Ontologies, DataBases, and Applications of Semantics (ODBASE 2005)},
  isbn = {3-540-74982-9},
  issn = {1861-2032},
  pages = {141--166},
  publisher = {Springer},
  title = {{Creating ontologies for content representation - the OntoSeed suite}},
  doi = {10.1007/978-3-540-74987-5\_5},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Raquel Fernández, David Schlangen, and Tatjana Lucht Push-to-talk ain’t always bad! Comparing Different Interactivity Settings in Task-oriented Dialogue Proceeding of DECALOG, the 11th International Workshop on the Semantics and Pragmatics of Dialogue (SemDial07) 2007 [PDF]
BibTeX
```
@inproceedings{Fernandez-2007-2,
  author = {Fernández, Raquel and Schlangen, David and Lucht, Tatjana},
  booktitle = {Proceeding of DECALOG, the 11th International Workshop on the Semantics and Pragmatics of Dialogue (SemDial07)},
  title = {{Push-to-talk ain't always bad! Comparing Different Interactivity Settings in Task-oriented Dialogue}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen, and Raquel Fernández Beyond Repair: Testing the Limits of the Conversational Repair System Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue 2007 [PDF]

BibTeX

@inproceedings{Schlangen-2007-1,
  author = {Schlangen, David and Fernández, Raquel},
  editor = {Keizer, Simon and Bunt, Harry and Paek, Tim},
  booktitle = {Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue},
  pages = {51--54},
  title = {{Beyond Repair: Testing the Limits of the Conversational Repair System}},
  year = {2007},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2006

Raquel Fernández, Tatjana Lucht, Kepa Rodríguez, and David Schlangen Interaction in Task-Oriented Human–Human Dialogue: The Effects of Different Turn-Taking Policies Proceedings of the First International IEEE/ACL Workshop on Spoken Language Technology 2006 [PDF]
BibTeX
```
@inproceedings{Fernandez-2006,
  author = {Fernández, Raquel and Lucht, Tatjana and Rodríguez, Kepa and Schlangen, David},
  booktitle = {Proceedings of the First International IEEE/ACL Workshop on Spoken Language Technology},
  title = {{Interaction in Task-Oriented Human–Human Dialogue: The Effects of Different Turn-Taking Policies}},
  doi = {10.1109/slt.2006.326791},
  year = {2006},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen From Reaction to Prediction: Experiments with Computational Models of Turn-Taking Proceedings of Interspeech 2006, Panel on Prosody of Dialogue Acts and Turn-Taking 2006 [PDF]

BibTeX

@inproceedings{Schlangen-2006,
  author = {Schlangen, David},
  booktitle = {Proceedings of Interspeech 2006, Panel on Prosody of Dialogue Acts and Turn-Taking},
  title = {{From Reaction to Prediction: Experiments with Computational Models of Turn-Taking}},
  year = {2006},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2005

David Schlangen Towards Finding and Fixing Fragments–-Using ML to Identify Non-Sentential Utterances and their Antecedents in Multi-Party Dialogue Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL05) 2005 [PDF]

BibTeX

@inproceedings{Schlangen-2005,
  author = {Schlangen, David},
  booktitle = {Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL05)},
  pages = {247--254},
  publisher = {Association for Computational Linguistics},
  title = {{Towards Finding and Fixing Fragments–-Using ML to Identify Non-Sentential Utterances and their Antecedents in Multi-Party Dialogue}},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Elena Paslaru Bontas, David Schlangen, and Sonja Niepage Ontology Engineering for the Semantic Annotation of Medical Data Proceedings of the 4th International Workshop on Web Semantics (WebS 2005) 2005 [PDF]
BibTeX
```
@inproceedings{Paslaru_Bontas-2005,
  author = {Paslaru Bontas, Elena and Schlangen, David and Niepage, Sonja},
  booktitle = {Proceedings of the 4th International Workshop on Web Semantics (WebS 2005)},
  title = {{Ontology Engineering for the Semantic Annotation of Medical Data}},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

David Schlangen The Discourse Contribution of Silence (Abstract) Proceedings of the International Workshop on Constraints in Discourse 2005 [PDF]

BibTeX

@inproceedings{Schlangen-2005-1,
  author = {Schlangen, David},
  editor = {Kühnlein, Peter and Sassen, Claudia and Benz, Anton},
  booktitle = {Proceedings of the International Workshop on Constraints in Discourse},
  title = {{The Discourse Contribution of Silence (Abstract)}},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen Modelling dialogue: Challenges and Approaches Künstliche Intelligenz 2005 [PDF]

BibTeX

@article{Schlangen-2005-2,
  author = {Schlangen, David},
  journal = {Künstliche Intelligenz},
  pages = {23--28},
  title = {{Modelling dialogue: Challenges and Approaches}},
  volume = {3/05},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Elena Paslaru Bontas Simperl, David Schlangen, and Thomas Schrader Creating ontologies for content representation–-the OntoSeed suite Proceedings of the CoopIS/DOA/ODBASE 2005 [PDF]

BibTeX

@inproceedings{Bontas_Simperl-2005,
  author = {Bontas Simperl, Elena Paslaru and Schlangen, David and Schrader, Thomas},
  booktitle = {Proceedings of the CoopIS/DOA/ODBASE},
  location = {Agia Napa, Cyprus},
  publisher = {Springer Verlag},
  title = {{Creating ontologies for content representation–-the OntoSeed suite}},
  doi = {10.1007/11575801\_23},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Thomas Hanneforth, and Manfred Stede Weaving the Semantic Web: Extracting and Representing the Content of Pathology Reports Proceedings of the GLDV Conference 2005 (GLDV05) 2005 [PDF]
BibTeX
```
@inproceedings{Schlangen-2005-3,
  author = {Schlangen, David and Hanneforth, Thomas and Stede, Manfred},
  booktitle = {Proceedings of the GLDV Conference 2005 (GLDV05)},
  title = {{Weaving the Semantic Web: Extracting and Representing the Content of Pathology Reports}},
  year = {2005},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}
```
Details

2004

David Schlangen Causes and Strategies for Requesting Clarification in Dialogue Proceedings of the 5th Workshop of the ACL SIG on Discourse and Dialogue 2004 [PDF]

BibTeX

@inproceedings{Schlangen-2004,
  author = {Schlangen, David},
  booktitle = {Proceedings of the 5th Workshop of the ACL SIG on Discourse and Dialogue},
  isbn = {1-932432-27-2},
  title = {{Causes and Strategies for Requesting Clarification in Dialogue}},
  year = {2004},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Ekaterina Jasinskaja, Jörg Mayer, and David Schlangen Discourse Structure and Information Structure: Interfaces and Prosodic Realization 2004 [PDF]

BibTeX

@inbook{Jasinskaja-2004,
  author = {Jasinskaja, Ekaterina and Mayer, Jörg and Schlangen, David},
  editor = {Ishihara, Shin and Schmitz, M. and Schwarz, A.},
  booktitle = {Interdisciplinary Studies on Information Structure (ISIS)},
  publisher = {Universitätsverlag Potsdam},
  title = {{Discourse Structure and Information Structure: Interfaces and Prosodic Realization}},
  year = {2004},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Manfred Stede, and Elena Paslaru Bontas Feeding OWL: Extracting and Representing the Content of Pathology Reports Proceedings of the 4th Workshop on NLP and XML (NLPXML-2004) 2004 [PDF]

BibTeX

@inproceedings{Schlangen-2004-1,
  author = {Schlangen, David and Stede, Manfred and Paslaru Bontas, Elena},
  booktitle = {Proceedings of the 4th Workshop on NLP and XML (NLPXML-2004)},
  isbn = {1-932432-42-6},
  pages = {43--50},
  title = {{Feeding OWL: Extracting and Representing the Content of Pathology Reports}},
  year = {2004},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Kepa Joseba Rodríguez, and David Schlangen Form, Intonation and Function of Clarification Requests in German Task-Oriented Spoken Dialogues Proceedings of Catalog (the 8th workshop on the semantics and pragmatics of dialogue; SemDial04) 2004 [PDF]

BibTeX

@inproceedings{Rodríguez-2004,
  author = {Rodríguez, Kepa Joseba and Schlangen, David},
  editor = {Vallduv'ı, Enric},
  booktitle = {Proceedings of Catalog (the 8th workshop on the semantics and pragmatics of dialogue; SemDial04)},
  isbn = {84-609-2205-7},
  pages = {101--108},
  title = {{Form, Intonation and Function of Clarification Requests in German Task-Oriented Spoken Dialogues}},
  year = {2004},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

Manfred Stede, and David Schlangen Information-Seeking Chat: Dialogues Driven by Topic-Structure Proceedings of Catalog (the 8th workshop on the semantics and pragmatics of dialogue; SemDial04) 2004 [PDF]

BibTeX

@inproceedings{Stede-2004,
  author = {Stede, Manfred and Schlangen, David},
  editor = {Vallduv'ı, Enric},
  booktitle = {Proceedings of Catalog (the 8th workshop on the semantics and pragmatics of dialogue; SemDial04)},
  isbn = {84-609-2205-7},
  pages = {117--124},
  title = {{Information-Seeking Chat: Dialogues Driven by Topic-Structure}},
  year = {2004},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2003

David Schlangen, and Alex Lascarides A compositional and constraint-based approach to non-sentential utterances Proceedings of the 10th international conference on Head-Driven Phrase Structure Grammar 2003 [PDF]

BibTeX

@inproceedings{Schlangen-2003,
  author = {Schlangen, David and Lascarides, Alex},
  editor = {Müller, Stefan},
  booktitle = {Proceedings of the 10th international conference on Head-Driven Phrase Structure Grammar},
  pages = {123--124},
  publisher = {CSLI Publications, Stanford, USA},
  title = {{A compositional and constraint-based approach to non-sentential utterances}},
  year = {2003},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Alex Lascarides, and Ann Copestake Resolving Underspecification using Discourse Information 2003 [PDF]

BibTeX

@inbook{Schlangen-2003-1,
  author = {Schlangen, David and Lascarides, Alex and Copestake, Ann},
  editor = {Kühnlein, Peter and Rieser, Hannes and Zeevat, Henk},
  booktitle = {Perspectives on Dialogue in the New Millenium},
  pages = {289--307},
  publisher = {John Benjamins},
  title = {{Resolving Underspecification using Discourse Information}},
  year = {2003},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen A Coherence-Based Approach to the Interpretation of Non-Sentential Utterances in Dialogue 2003 [PDF]

BibTeX

@phdthesis{Schlangen-2003-2,
  author = {Schlangen, David},
  publisher = {School of Informatics, University of Edinburgh},
  title = {{A Coherence-Based Approach to the Interpretation of Non-Sentential Utterances in Dialogue}},
  year = {2003},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, and Alex Lascarides The Interpretation of Non-Sentential Utterances in Dialogue Proceedings of the 4th SIGdial workshop on Discourse and Dialogue 2003 [PDF]

BibTeX

@inproceedings{Schlangen-2003-3,
  author = {Schlangen, David and Lascarides, Alex},
  editor = {Rudnicky, Alexander},
  booktitle = {Proceedings of the 4th SIGdial workshop on Discourse and Dialogue},
  title = {{The Interpretation of Non-Sentential Utterances in Dialogue}},
  year = {2003},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, Alex Lascarides, and Jason Baldridge A Tool for Semi-Automatic and Interactive Annotation of Dialogue Utterances with Information States Proceedings of DiaBruck (the 7th Workshop on Semantics and Pragmatics of Dialogue) 2003 [PDF]

BibTeX

@inproceedings{Schlangen-2003-4,
  author = {Schlangen, David and Lascarides, Alex and Baldridge, Jason},
  editor = {Krujiff-Korbayová, Ivana and Kosny, Claudia},
  booktitle = {Proceedings of DiaBruck (the 7th Workshop on Semantics and Pragmatics of Dialogue)},
  pages = {205--206},
  title = {{A Tool for Semi-Automatic and Interactive Annotation of Dialogue Utterances with Information States}},
  year = {2003},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

2002

David Schlangen A compositional approach to short answers in dialogue Proceedings of the Student Research Workshop at the 40th ACL 2002 [PDF]

BibTeX

@inproceedings{Schlangen-2002,
  author = {Schlangen, David},
  editor = {Mann, Gideon and Koller, Alexander},
  booktitle = {Proceedings of the Student Research Workshop at the 40th ACL},
  title = {{A compositional approach to short answers in dialogue}},
  year = {2002},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, and Alex Lascarides CETP: An Automated Theorem Prover for a Fragment of Common Sense Entailment 2002 [PDF]

BibTeX

@techreport{Schlangen-2002-1,
  author = {Schlangen, David and Lascarides, Alex},
  publisher = {Edinburgh University},
  title = {{CETP: An Automated Theorem Prover for a Fragment of Common Sense Entailment}},
  year = {2002},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details

David Schlangen, and Alex Lascarides Resolving Fragments using Discourse Information Proceedings of the 6th International Workshop on Formal Semantics and Pragmatics of Dialogue (EDILOG 2002) 2002 [PDF]

BibTeX

@inproceedings{Schlangen-2002-2,
  author = {Schlangen, David and Lascarides, Alex},
  editor = {Bos, Johan and Foster, Mary Ellen and Matheson, Colin},
  booktitle = {Proceedings of the 6th International Workshop on Formal Semantics and Pragmatics of Dialogue (EDILOG 2002)},
  pages = {161--168},
  title = {{Resolving Fragments using Discourse Information}},
  year = {2002},
  topics = {},
  domains = {},
  approach = {},
  project = {}
}

Details