colab Potsdam | publications

(You can find recordings of talks & slides here.)

195 entries, as of March 2023.

2023

Beyond Single-Mindedness: A Figure-Ground Reversal for the Cognitive Sciences Dingemanse, Mark, Liesenfeld, Andreas, Rasenberg, Marlou, Albert, Saul, Ameka, Felix K., Birhane, Abeba, Bolis, Dimitris, Cassell, Justine, Clift, Rebecca, Cuffari, Elena, De Jaegher, Hanne, Novaes, Catarina Dutilh, Enfield, N. J., Fusaroli, Riccardo, Gregoromichelaki, Eleni, Hutchins, Edwin, Konvalinka, Ivana, Milton, Damian, Rączaszek-Leonardi, Joanna, Reddy, Vasudevi, Rossano, Federico, Schlangen, David, Seibt, Johanna, Stokoe, Elizabeth, Suchman, Lucy, Vesper, Cordula, Wheatley, Thalia, and Wiltschko, Martina Cognitive Science 2023 [Abs] [PDF]
Abstract A fundamental fact about human minds is that they are never truly alone: all minds are steeped in situated interaction. That social interaction matters is recognized by any experimentalist who seeks to exclude its influence by studying individuals in isolation. On this view, interaction complicates cognition. Here, we explore the more radical stance that interaction co-constitutes cognition: that we benefit from looking beyond single minds toward cognition as a process involving interacting minds. All around the cognitive sciences, there are approaches that put interaction center stage. Their diverse and pluralistic origins may obscure the fact that collectively, they harbor insights and methods that can respecify foundational assumptions and fuel novel interdisciplinary work. What might the cognitive sciences gain from stronger interactional foundations? This represents, we believe, one of the key questions for the future. Writing as a transdisciplinary collective assembled from across the classic cognitive science hexagon and beyond, we highlight the opportunity for a figure-ground reversal that puts interaction at the heart of cognition. The interactive stance is a way of seeing that deserves to be a key part of the conceptual toolkit of cognitive scientists.
BibTeX
```
@article{Dingemanse-2023,
  author = {Dingemanse, Mark and Liesenfeld, Andreas and Rasenberg, Marlou and Albert, Saul and Ameka, Felix K. and Birhane, f, Abeba and Bolis, Dimitris and Cassell, Justine and Clift, Rebecca and Cuffari, Elena and De Jaegher, Hanne and Novaes, Catarina Dutilh and Enfield, N. J. and Fusaroli, Riccardo and Gregoromichelaki, Eleni and Hutchins, Edwin and Konvalinka, Ivana and Milton, Damian and Rączaszek-Leonardi, Joanna and Reddy, Vasudevi and Rossano, Federico and Schlangen, David and Seibt, Johanna and Stokoe, Elizabeth and Suchman, Lucy and Vesper, Cordula and Wheatley, Thalia and Wiltschko, Martina},
  title = {Beyond Single-Mindedness: A Figure-Ground Reversal for the Cognitive Sciences},
  journal = {Cognitive Science},
  volume = {47},
  number = {1},
  pages = {e13230},
  keywords = {Interaction, Cognitive science, Pluralism, Interdisciplinarity, Social interaction},
  doi = {https://doi.org/10.1111/cogs.13230},
  url = {https://onlinelibrary.wiley.com/doi/abs/10.1111/cogs.13230},
  eprint = {https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.13230},
  year = {2023}
}
```
Details

2022

Can you tell that I’m confused? An overhearer study for German backchannels by an embodied agent Meywirth, Isabel Donya, and Götze, Jana In Companion Publication of the 2022 International Conference on Multimodal Interaction 2022 [Abs] [PDF]
In spoken interaction, humans constantly display and interpret each others’ state of understanding. For an embodied agent, displaying its internal state of understanding in an efficient manner can be an important means for making a user-interaction more natural and initiate error recovery as early as possible. We carry out an overhearer study with 62 participants to investigate whether German verbal and non-verbal backchannels by the virtual Furhat embodied agent can be interpreted by an overhearer of a human-robot conversation. We compare three positive, three negative, and one neutral feedback reaction. We find that even though it is difficult to generate certain verbal backchannels, our participants can recognize displays of understanding with an accuracy of up to 0.92. Trying to communicate a lack of understanding is more often misunderstood (accuracy: 0.55), meaning that interaction designers need to carefully craft them in order to be useful for the interaction flow.
BibTeX
```
@inproceedings{Meywirth-2022,
  address = {New York, NY, USA},
  series = {{ICMI} '22 {Companion}},
  title = {Can you tell that {I}’m confused? {An} overhearer study for {German} backchannels by an embodied agent},
  isbn = {978-1-4503-9389-8},
  shorttitle = {Can you tell that {I}’m confused?},
  url = {https://doi.org/10.1145/3536220.3558804},
  doi = {10.1145/3536220.3558804},
  urldate = {2022-12-06},
  booktitle = {Companion {Publication} of the 2022 {International} {Conference} on {Multimodal} {Interaction}},
  publisher = {Association for Computing Machinery},
  author = {Meywirth, Isabel Donya and Götze, Jana},
  month = nov,
  year = {2022},
  keywords = {backchannels, grounding in conversation, human-robot interaction, listener responses, social virtual agents},
  pages = {89--93},
  file = {Meywirth and Götze - 2022 - Can you tell that I’m confused An overhearer stud.pdf:/Users/jana/work/BIBLIOGRAPHY/zotero/storage/IL8KC96P/Meywirth and Götze - 2022 - Can you tell that I’m confused An overhearer stud.pdf:application/pdf}
}
```
Details
Anaphoric Phenomena in Situated dialog: A First Round of Annotations Loáiciga, Sharid, Dobnik, Simon, and Schlangen, David In Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference 2022 [Abs] [PDF]
We present a first release of 500 documents from the multimodal corpus Tell-me-more (Ilinykh et al., 2019) annotated with coreference information according to the ARRAU guidelines (Poesio et al., 2021). The corpus consists of images and short texts of five sentences. We describe the annotation process and present the adaptations to the original guidelines in order to account for the challenges of grounding the annotations to the image. 50 documents from the 500 available are annotated by two people and used to estimate inter-annotator agreement (IAA) relying on Krippendorff’s alpha.
BibTeX
```
@inproceedings{Loaiciga-2022-1,
  title = {Anaphoric Phenomena in Situated dialog: A First Round of Annotations},
  author = {Lo{\'a}iciga, Sharid and Dobnik, Simon and Schlangen, David},
  booktitle = {Proceedings of the Fifth Workshop on Computational Models of Reference, Anaphora and Coreference},
  month = oct,
  year = {2022},
  address = {Gyeongju, Republic of Korea},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2022.crac-1.4},
  pages = {31--37}
}
```
Details
New or Old? Exploring How Pre-Trained Language Models Represent Discourse Entities Loáiciga, Sharid, Beyer, Anne, and Schlangen, David In Proceedings of the 29th International Conference on Computational Linguistics 2022 [Abs] [PDF]
Recent research shows that pre-trained language models, built to generate text conditioned on some context, learn to encode syntactic knowledge to a certain degree. This has motivated researchers to move beyond the sentence-level and look into their ability to encode less studied discourse-level phenomena. In this paper, we add to the body of probing research by investigating discourse entity representations in large pre-trained language models in English. Motivated by early theories of discourse and key pieces of previous work, we focus on the information-status of entities as discourse-new or discourse-old. We present two probing models, one based on binary classification and another one on sequence labeling. The results of our experiments show that pre-trained language models do encode information on whether an entity has been introduced before or not in the discourse. However, this information alone is not sufficient to find the entities in a discourse, opening up interesting questions about the definition of entities for future work.
BibTeX
```
@inproceedings{Loaiciga-2022,
  title = {New or Old? Exploring How Pre-Trained Language Models Represent Discourse Entities},
  author = {Lo{\'a}iciga, Sharid and Beyer, Anne and Schlangen, David},
  booktitle = {Proceedings of the 29th International Conference on Computational Linguistics},
  month = oct,
  year = {2022},
  address = {Gyeongju, Republic of Korea},
  publisher = {International Committee on Computational Linguistics},
  url = {https://aclanthology.org/2022.coling-1.73},
  pages = {875--886}
}
```
Details
Norm Participation Grounds Language Schlangen, David In Proceedings of the 2022 CLASP Conference on (Dis)embodiment 2022 [Abs] [PDF]
The striking recent advances in eliciting seemingly meaningful language behaviour from language-only machine learning models have only made more apparent, through the surfacing of clear limitations, the need to go beyond the language-only mode and to ground these models “in the world”. Proposals for doing so vary in the details, but what unites them is that the solution is sought in the addition of non-linguistic data types such as images or video streams, while largely keeping the mode of learning constant. I propose a different, and more wide-ranging conception of how grounding should be understood: What grounds language is its normative nature. There are standards for doing things right, these standards are public and authoritative, while at the same time acceptance of authority can and must be disputed and negotiated, in interactions in which only bearers of normative status can rightfully participate. What grounds language, then, is the determined use that language users make of it, and what it is grounded in is the community of language users. I sketch this idea, and draw some conclusions for work on computational modelling of meaningful language use.
BibTeX
```
@inproceedings{Schlangen-2022,
  title = {Norm Participation Grounds Language},
  author = {Schlangen, David},
  booktitle = {Proceedings of the 2022 CLASP Conference on (Dis)embodiment},
  month = sep,
  year = {2022},
  address = {Gothenburg, Sweden},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2022.clasp-1.7},
  pages = {62--69}
}
```
Details
The Slurk Interaction Server Framework: Better Data for Better Dialog Models Götze, Jana, Paetzel-Prüsmann, Maike, Liermann, Wencke, Diekmann, Tim, and Schlangen, David In Proceedings of the Language Resources and Evaluation Conference 2022 [PDF]
BibTeX
```
@inproceedings{Goetze-2022-1,
  title = {The Slurk Interaction Server Framework: {{Better}} Data for Better Dialog Models},
  booktitle = {Proceedings of the Language Resources and Evaluation Conference},
  author = {G{\"o}tze, Jana and {Paetzel-Pr{\"u}smann}, Maike and Liermann, Wencke and Diekmann, Tim and Schlangen, David},
  year = {2022},
  month = jun,
  pages = {4069--4078},
  publisher = {{European Language Resources Association}},
  address = {{Marseille, France}},
  url = {http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.433.pdf}
}
```
Details

Interactive and Cooperative Delivery of Referring Expressions: A Comparison of Three Algorithms Götze, Jana, Friedrichs, Karla, and Schlangen, David In Proceedings of the 26th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers 2022 [PDF]

BibTeX

@inproceedings{Goetze-2022,
  title = {{{Interactive}} and {{Cooperative}} {{Delivery}} of {{Referring}} {{Expressions}}:
  {{A}} {{Comparison}} of {{Three}} {{Algorithms}}},
  booktitle = {Proceedings of the 26th {{Workshop}} on the {{Semantics}} and {{Pragmatics}} of {{Dialogue}} - {{Full Papers}}},
  author = {Götze, Jana and Friedrichs, Karla and Schlangen, David},
  year = {2022},
  publisher = {{SEMDIAL}},
  address = {{Virtually and at Dublin, Ireland}}
}

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002