Postdoctoral Researcher
Goethe-Universität Frankfurt am Main
Robert-Mayer-Straße 10
Room 402
D-60325 Frankfurt am Main
D-60054 Frankfurt am Main (use for package delivery)
Postfach / P.O. Box: 154
Phone:
Mail:
See also my personal homepage.
Office Hour: virtual on Tuesday, 9h30-11h00 (send me an email)
Research Interests
My research interests revolve around linguistic and philosophical theories of meaning and interaction. One focus is on the interplay of speech and gesture in communication, particularly multimodal grammar, which was a primary topic of my PhD. In this context, we recently developed an encompassing semantic theory of iconic gestures (see Iconic Gesture Semantics at lingbuzz or arxiv). My preferred semantic framework is Type Theory with Records (TTR), which is also employed in outlining Referential Transparency Theory (RTT), a cognitively construable semantic theory of pluralities and quantification (a major focus of my habilitation). Furthermore, I contribute to investigations of language use in specialized media and resources, such as educational learning or biodiversity.
Given the necessity of memory structures to explain dialogue phenomena and data, one of my recent research directions is to ground semantics in neurocognitive terms. In my work, I usually combine theoretical modelling with the use of digital resources and/or experimental methods. This includes the construction of several corpora which are used in linguistics and digital humanities research. I am concerned with topics such as the following ones (see also the list of publications):
- syntax and semantics of spoken German and English
- cognitive dialogue modelling
- (deferred) reference
- quantification
- alignment
- iconicity and perception
- corpus annotation
Short Academic CV
From April 2019 until June 2023, I was a PostDoc research fellow at the Laboratoire de Linguistique Formelle (LLF) at the Université Paris Cité (formerly known as the Université de Paris and the Université Paris Diderot (Paris 7)). The fellowship involves my habilitation on Aspects of Multimodal Communication in September 2022.
In January 2011, I started to work as a research assistant at the Text Technology Lab at the Goethe University Frankfurt.
In 2011, I received my PhD in linguistics at Bielefeld University for my prolegomena for a linguistic theory of co-verbal iconic gesture. The work has been published in 2013 as “Ikonische Gesten. Grundzüge einer linguistischen Theorie”.
I studied linguistics, philosophy and German philology at Bielefeld University.
Publications
2024
BibTeX
@inbook{Konca:et:al:2024:a,
author = {Konca, Maxim and Mehler, Alexander and L{\"u}cking, Andy and Baumartz, Daniel},
editor = {Zlatkin-Troitschanskaia, Olga and Nagel, Marie-Theres and Klose, Verena
and Mehler, Alexander},
title = {Visualizing Domain-specific and Generic Critical Online Reasoning
Related Structures of Online Texts: A Hybrid Approach},
booktitle = {Students', Graduates' and Young Professionals' Critical Use of
Online Information: Digital Performance Assessment and Training
within and across Domains},
year = {2024},
publisher = {Springer Nature Switzerland},
address = {Cham},
pages = {195--239},
abstract = {Besides ``traditional'' educational media, young professionals
in higher education use the Internet to obtain information. To
utilize their online research in professional contexts, they critically
evaluate the information they access and its sources. One dimension
of this evaluation is an assessment of the linguistic state of
the online sources, either implicitly or explicitly. This computational
educational linguistic study applies methods from computational
linguistics to online sources visited by young professionals from
three fields (law students, teacher trainees, and medicine student)
and develops partly novel visualizations that allow to quickly
discover similarities as well as differences between multi-heterogeneous
Internet sources, that is, sources that exhibit various topics,
genres, and textual structure, among others. The visualizations
also allow a comparison of search behaviour between different
professional fields. In this way, we found that (1) genre classification
has a significant impact on reliability scores, (2) young professionals'
search approaches vary by their professional field, and, (3) the
best predictor of reliability is indeed the linguistic profile
of an online source.},
isbn = {978-3-031-69510-0},
doi = {10.1007/978-3-031-69510-0_10},
url = {https://doi.org/10.1007/978-3-031-69510-0_10}
}
BibTeX
@inproceedings{Henlein:Luecking:Mehler:2024,
title = {Virtually Restricting Modalities in Interactions: Va.Si.Li-Lab
for Experimental Multimodal Research},
author = {Henlein, Alexander and L{\"u}cking, Andy and Mehler, Alexander},
booktitle = {Proceedings of the 2nd International Symposium on Multimodal Communication
(MMSYM 2024), Frankfurt, 25-27 September 2024},
pages = {96--97},
year = {2024},
pdf = {http://mmsym.org/wp-content/uploads/2024/09/BookOfAbstractsMMSYM2024-3.pdf}
}
BibTeX
@inproceedings{Luecking:Mehler:Henlein:2024,
title = {The Gesture–Prosody Link in Multimodal Grammar},
author = {L{\"u}cking, Andy and Mehler, Alexander and Henlein, Alexander},
booktitle = {Proceedings of the 2nd International Symposium on Multimodal Communication
(MMSYM 2024), Frankfurt, 25-27 September 2024},
pages = {128--129},
year = {2024},
pdf = {http://mmsym.org/wp-content/uploads/2024/09/BookOfAbstractsMMSYM2024-3.pdf}
}
BibTeX
@inproceedings{Ginzburg:Eliasmith:Luecking:2024-swann,
title = {Swann's name: {Towards} a Dialogical Brain Semantics},
author = {Ginzburg, Jonathan and Eliasmith, Chris and Lücking, Andy},
year = {2024},
booktitle = {Proceedings of the 28th Workshop on The Semantics and Pragmatics of Dialogue},
series = {SemDial'24 -- TrentoLogue},
location = {Università di Trento, Palazzo Piomarta, Rovereto},
url = {https://www.semdial.org/anthology/papers/Z/Z24/Z24-3007/},
pdf = {http://semdial.org/anthology/Z24-Ginzburg_semdial_0007.pdf}
}
BibTeX
@inproceedings{Luecking:Mehler:Henlein:2024-classifier,
title = {The Linguistic Interpretation of Non-emblematic Gestures Must
be agreed in Dialogue: Combining Perceptual Classifiers and Grounding/Clarification
Mechanisms},
author = {Lücking, Andy and Mehler, Alexander and Henlein, Alexander},
year = {2024},
booktitle = {Proceedings of the 28th Workshop on The Semantics and Pragmatics of Dialogue},
series = {SemDial'24 -- TrentoLogue},
location = {Università di Trento, Palazzo Piomarta, Rovereto},
url = {https://www.semdial.org/anthology/papers/Z/Z24/Z24-4031/},
pdf = {http://semdial.org/anthology/Z24-Lucking_semdial_0031.pdf}
}
BibTeX
@article{Mattern:Hemati:Lücking:Mehler:2024,
author = {Mattern, Dominik and Hemati, Wahed and Lücking, Andy and Mehler, Alexander},
title = {On German verb sense disambiguation: A three-part approach based
on linking a sense inventory (GermaNet) to a corpus through annotation
(TGVCorp) and using the corpus to train a VSD classifier (TTvSense)},
abstractnote = {We develop a three-part approach to Verb Sense Disambiguation (VSD) in German. After considering a set of lexical resources and corpora, we arrive at a statistically motivated selection of a subset of verbs and their senses from GermaNet. This sub-inventory is then used to disambiguate the occurrences of the corresponding verbs in a corpus resulting from the union of TüBa-D/Z, Salsa, and E-VALBU. The corpus annotated in this way is called TGVCorp. It is used in the third part of the paper for training a classifier for VSD and for its comparative evaluation with a state-of-the-art approach in this research area, namely EWISER. Our simple classifier outperforms the transformer-based approach on the same data in both accuracy and speed in German but not in English and we discuss possible reasons.},
journal = {Journal of Language Modelling},
volume = {12},
number = {1},
year = {2024},
month = {Sep.},
pages = {155–212},
url = {https://jlm.ipipan.waw.pl/index.php/JLM/article/view/356}
}
BibTeX
@inproceedings{Henlein:et:al:2024-vicom,
title = {An Outlook for AI Innovation in Multimodal Communication Research},
author = {Henlein, Alexander and Bauer, Anastasia and Bhattacharjee, Reetu
and Ćwiek, Aleksandra and Gregori, Alina and Kügler, Frank and Lemanski, Jens
and Lücking, Andy and Mehler, Alexander and Prieto, Pilar and Sánchez-Ramón, Paula G.
and Schepens, Job and Schulte-Rüther, Martin and Schweinberger, Stefan R.
and von Eiff, Celina I.},
editor = {Duffy, Vincent G.},
year = {2024},
booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics
and Risk Management.},
series = {HCII 2024. Lecture Notes in Computer Science},
publisher = {Springer},
address = {Cham},
pages = {182--234},
isbn = {978-3-031-61066-0}
}
BibTeX
@inproceedings{Luecking:et:al:2024,
abstract = {Purpose: Based on the examples of English and German, we investigate
to what extent parsers trained on modern variants of these languages
can be transferred to older language levels without loss. Methods:
We developed a treebank called DoTT (https://github.com/texttechnologylab/DoTT)
which covers, roughly, the time period from 1800 until today,
in conjunction with the further development of the annotation
tool DependencyAnnotator. DoTT consists of a collection of diachronic
corpora enriched with dependency annotations using 3 parsers,
6 pre-trained language models, 5 newly trained models for German,
and two tag sets (TIGER and Universal Dependencies). To assess
how the different parsers perform on texts from different time
periods, we created a gold standard sample as a benchmark. Results:
We found that the parsers/models perform quite well on modern
texts (document-level LAS ranging from 82.89 to 88.54) and slightly
worse on older texts, as expected (average document-level LAS
84.60 vs. 86.14), but not significantly. For German texts, the
(German) TIGER scheme achieved slightly better results than UD.
Conclusion: Overall, this result speaks for the transferability
of parsers to past language levels, at least dating back until
around 1800. This very transferability, it is however argued,
means that studies of language change in the field of dependency
syntax can draw on dependency distance but miss out on some grammatical
phenomena.},
address = {Torino, Italy},
author = {L{\"u}cking, Andy and Abrami, Giuseppe and Hammerla, Leon and Rahn, Marc
and Baumartz, Daniel and Eger, Steffen and Mehler, Alexander},
booktitle = {Proceedings of the 2024 Joint International Conference on Computational
Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro
and Sakti, Sakriani and Xue, Nianwen},
month = {may},
pages = {4641--4653},
publisher = {ELRA and ICCL},
title = {Dependencies over Times and Tools ({D}o{TT})},
url = {https://aclanthology.org/2024.lrec-main.415},
poster = {https://www.texttechnologylab.org/wp-content/uploads/2024/05/LREC_2024_Poster_DoTT.pdf},
year = {2024}
}
BibTeX
@inproceedings{Konca:et:al:2024,
abstract = {A useful semantic role-annotated resource for training semantic
role models for the German language is missing. We point out some
problems of previous resources and provide a new one due to a
combined translation and alignment process: The gold standard
CoNLL-2012 semantic role annotations are translated into German.
Semantic role labels are transferred due to alignment models.
The resulting dataset is used to train a German semantic role
model. With F1-scores around 0.7, the major roles achieve competitive
evaluation scores, but avoid limitations of previous approaches.
The described procedure can be applied to other languages as well.},
address = {Torino, Italy},
author = {Konca, Maxim and L{\"u}cking, Andy and Mehler, Alexander},
booktitle = {Proceedings of the 2024 Joint International Conference on Computational
Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
editor = {Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro
and Sakti, Sakriani and Xue, Nianwen},
month = {may},
pages = {7717--7727},
publisher = {ELRA and ICCL},
title = {{G}erman {SRL}: Corpus Construction and Model Training},
url = {https://aclanthology.org/2024.lrec-main.682},
poster = {https://www.texttechnologylab.org/wp-content/uploads/2024/05/LREC_2024_Poster_GERMAN_SRL.pdf},
year = {2024}
}
2023
BibTeX
@inproceedings{Gregori:et:al:2023-vicom,
author = {Gregori, Alina and Amici, Federica and Brilmayer, Ingmar and {\'{C}}wiek, Aleksandra
and Fritzsche, Lennart and Fuchs, Susanne and Henlein, Alexander and Herbort, Oliver
and K{\"u}gler, Frank and Lemanski, Jens and Liebal, Katja and L{\"u}cking, Andy
and Mehler, Alexander and Nguyen, Kim Tien and Pouw, Wim and Prieto, Pilar
and Rohrer, Patrick Louis and S{\'a}nchez-Ram{\'o}n, Paula G. and Schulte-R{\"u}ther, Martin
and Schumacher, Petra B. and Schweinberger, Stefan R. and Struckmeier, Volker
and Trettenbrein, Patrick C. and von Eiff, Celina I.},
editor = {Duffy, Vincent G.},
title = {A Roadmap for Technological Innovation in Multimodal Communication Research},
booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics
and Risk Management},
year = {2023},
publisher = {Springer Nature Switzerland},
address = {Cham},
pages = {402--438},
abstract = {Multimodal communication research focuses on how different means
of signalling coordinate to communicate effectively. This line
of research is traditionally influenced by fields such as cognitive
and neuroscience, human-computer interaction, and linguistics.
With new technologies becoming available in fields such as natural
language processing and computer vision, the field can increasingly
avail itself of new ways of analyzing and understanding multimodal
communication. As a result, there is a general hope that multimodal
research may be at the ``precipice of greatness'' due to technological
advances in computer science and resulting extended empirical
coverage. However, for this to come about there must be sufficient
guidance on key (theoretical) needs of innovation in the field
of multimodal communication. Absent such guidance, the research
focus of computer scientists might increasingly diverge from crucial
issues in multimodal communication. With this paper, we want to
further promote interaction between these fields, which may enormously
benefit both communities. The multimodal research community (represented
here by a consortium of researchers from the Visual Communication
[ViCom] Priority Programme) can engage in the innovation by clearly
stating which technological tools are needed to make progress
in the field of multimodal communication. In this article, we
try to facilitate the establishment of a much needed common ground
on feasible expectations (e.g., in terms of terminology and measures
to be able to train machine learning algorithms) and to critically
reflect possibly idle hopes for technical advances, informed by
recent successes and challenges in computer science, social signal
processing, and related domains.},
isbn = {978-3-031-35748-0},
pdf = {https://pure.mpg.de/rest/items/item_3511464_5/component/file_3520176/content}
}
BibTeX
@proceedings{SemDial:2023-marilogue,
title = {Proceedings of the 27th Workshop On the Semantics and Pragmatics of Dialogue},
keywords = {own,editor},
year = {2023},
editor = {Lücking, Andy and Mazzocconi, Chiara and Verdonik, Darinka},
editor+an = {1=highlight},
series = {SemDial 2023 -- MariLogue},
publisher = {University of Maribor},
url = {https://www.semdial.org/anthology/events/semdial-2023/}
}
BibTeX
@inproceedings{Ginzburg:Luecking:2023-wh,
author = {Ginzburg, Jonathan and Lücking, Andy},
author+an = {2=highlight},
keywords = {own,conference},
title = {Referential Transparency and Inquisitivity},
booktitle = {Proceedings of the 4th Workshop on Inquisitiveness Below and Beyond
the Sentence Boundary},
series = {InqBnB4'23},
pages = {11-20},
location = {Nancy, France, hosted with IWCS 2023},
year = {2023},
url = {https://aclanthology.org/2023.inqbnb-1.2/},
pdf = {https://aclanthology.org/2023.inqbnb-1.2.pdf}
}
BibTeX
@inproceedings{Luecking:2023-rtt-annotation,
author = {Lücking, Andy},
author+an = {1=highlight},
keywords = {own,conference},
title = {Towards Referential Transparent Annotations of Quantified Noun Phrases},
booktitle = {Proceedings of the 2023 Joint ACL--ISO Workshop on Interoperable
Semantic Annotation},
series = {ISA-19},
pages = {47-55},
location = {Nancy, France, hosted with IWCS 2023},
year = {2023},
url = {https://aclanthology.org/2023.isa-1.7/},
pdf = {https://aclanthology.org/2023.isa-1.7.pdf}
}
BibTeX
@inproceedings{Larsson:Cooper:Ginzburg:Luecking:2023-ttr-spa,
author = {Larsson, Staffan and Cooper, Robin and Ginzburg, Jonathan and Lücking, Andy},
author+an = {4=highlight},
keywords = {own,conference},
title = {{TTR} at the {SPA}: {Relating} type-theoretical semantics to neural
semantic pointers},
booktitle = {Proceedings of Natural Logic Meets Machine Learning IV},
series = {NALOMA'23},
location = {Nancy, France, hosted with IWCS 2023},
year = {2023},
url = {https://aclanthology.org/2023.naloma-1.5/},
pdf = {https://aclanthology.org/2023.naloma-1.5.pdf}
}
BibTeX
@inproceedings{Henlein:et:al:2023c,
title = {Towards grounding multimodal semantics in interaction data with Va.Si.Li-Lab},
author = {Henlein, Alexander and Lücking, Andy and Bagci, Mevlüt and Mehler, Alexander},
booktitle = {Proceedings of the 8th Conference on Gesture and Speech in Interaction (GESPIN)},
location = {Nijmegen, Netherlands},
year = {2023},
keywords = {vasililab},
pdf = {https://www.gespin2023.nl/documents/talks_and_posters/GeSpIn_2023_papers/GeSpIn_2023_paper_1692.pdf}
}
BibTeX
@inproceedings{Mehler:et:al:2023:a,
abstract = {Simulation-based learning is a method in which learners learn
to master real-life scenarios and tasks from simulated application
contexts. It is particularly suitable for the use of VR technologies,
as these allow immersive experiences of the targeted scenarios.
VR methods are also relevant for studies on online learning, especially
in groups, as they provide access to a variety of multimodal learning
and interaction data. However, VR leads to a trade-off between
technological conditions of the observability of such data and
the openness of learner behavior. We present Va.Si.Li-Lab, a VR-L
ab for Simulation-based Learn ing developed to address this trade-off.
Va.Si.Li-Lab uses a graph-theoretical model based on hypergraphs
to represent the data diversity of multimodal learning and interaction.
We develop this data model in relation to mono- and multimodal,
intra- and interpersonal data and interleave it with ISO-Space
to describe distributed multiple documents from the perspective
of their interactive generation. The paper adds three use cases
to motivate the broad applicability of Va.Si.Li-Lab and its data
model.},
address = {Cham},
author = {Mehler, Alexander and Bagci, Mevl{\"u}t and Henlein, Alexander
and Abrami, Giuseppe and Spiekermann, Christian and Schrottenbacher, Patrick
and Konca, Maxim and L{\"u}cking, Andy and Engel, Juliane and Quintino, Marc
and Schreiber, Jakob and Saukel, Kevin and Zlatkin-Troitschanskaia, Olga},
booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics
and Risk Management},
editor = {Duffy, Vincent G.},
isbn = {978-3-031-35741-1},
pages = {539--565},
publisher = {Springer Nature Switzerland},
title = {A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab},
year = {2023},
doi = {10.1007/978-3-031-35741-1_39}
}
2022
BibTeX
@inproceedings{Ebert:et:al:2022,
abstract = {``Behavioromics'' is a term that has been invented to cover the
study of multimodal interaction from various disciplines and points
of view. These disciplines and points of view, however, lack a
platform for exchange. The workshop session on ``Semantic, artificial
and computational interaction studies'' provides such a platform.
We motivate behavioromics, sketch its historical background, and
summarize this year's contributions.},
address = {Cham},
author = {Ebert, Cornelia and L{\"u}cking, Andy and Mehler, Alexander},
booktitle = {HCI International 2022 - Late Breaking Papers. Multimodality in
Advanced Interaction Environments},
editor = {Kurosu, Masaaki and Yamamoto, Sakae and Mori, Hirohiko and Schmorrow, Dylan D.
and Fidopiastis, Cali M. and Streitz, Norbert A. and Konomi, Shin'ichi},
isbn = {978-3-031-17618-0},
pages = {36--47},
publisher = {Springer Nature Switzerland},
title = {Introduction to the 2nd Edition of ``Semantic, Artificial and
Computational Interaction Studies''},
doi = {https://doi.org/10.1007/978-3-031-17618-0_3},
year = {2022}
}
BibTeX
@inproceedings{Ginzburg:Luecking:2022:a,
title = {The Integrated Model of Memory: {A} Dialogical Perspective},
author = {Ginzburg, Jonathan and L{\"u}cking, Andy},
booktitle = {Proceedings of SemDial 2022},
series = {SemDial 2022 -- DubDial},
location = {Dublin, Ireland},
year = {2022},
editor = {Gregoromichelaki, Eleni and Hough, Julian and Kelleher, John D.},
pages = {6-17},
url = {https://www.semdial.org/anthology/papers/Z/Z22/Z22-3004/},
pdf = {http://semdial.org/anthology/Z22-Ginzburg_semdial_0004.pdf}
}
BibTeX
@article{Luecking:Ginzburg:2022:b,
title = {Leading voices: {Dialogue} semantics, cognitive science, and the
polyphonic structure of multimodal interaction},
author = {L{\"u}cking, Andy and Ginzburg, Jonathan},
journal = {Language and Cognition},
year = {2022},
doi = {10.1017/langcog.2022.30}
}
BibTeX
@inproceedings{Luecking:Ginzburg:2022:a,
title = {How to repair a slip of the tongue?},
author = {Lücking, Andy and Ginzburg, Jonathan},
booktitle = {Proceedings of SemDial 2022},
series = {SemDial 2022 -- DubDial},
location = {Dublin, Ireland},
year = {2022},
editor = {Gregoromichelaki, Eleni and Hough, Julian and Kelleher, John D.},
pages = {35-46},
url = {https://www.semdial.org/anthology/papers/Z/Z22/Z22-3007/},
pdf = {http://semdial.org/anthology/Z22-Lücking_semdial_0007.pdf}
}
BibTeX
@misc{Konca:et:al:2022,
author = {Konca, Maxim and L{\"u}cking, Andy and Mehler, Alexander and Nagel, Marie-Theres
and Zlatkin-Troitschanskaia, Olga},
howpublished = {Presentation given at the AERA annual meeting, 21.-26.04. 2022, WERA symposium},
month = {04},
title = {Computational educational linguistics for `Critical Online Reasoning'
among young professionals in medicine, law and teaching},
year = {2022},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2022/10/BRIDGE_WERA_AERA-2022_reduce.pdf}
}
BibTeX
@misc{Mehler:et:al:2022,
author = {Mehler, Alexander and Konca, Maxim and Nagel, Marie-Theres and L\"{u}cking, Andy
and Zlatkin-Troitschanskaia, Olga},
year = {2022},
month = {03},
howpublished = {Presentation at BEBF 2022},
title = {On latent domain-specific textual preferences in solving Internet-based
generic tasks among graduates/young professionals from three domains},
abstract = {Although Critical Online Reasoning (COR) is often viewed as a
general competency (e.g. Alexander et al. 2016), studies have
found evidence supporting their domain-specificity (Toplak et
al. 2002). To investigate this assumption, we focus on commonalities
and differences in textual preferences in solving COR-related
tasks between graduates/young professionals from three domains.
For this reason, we collected data by requiring participants to
solve domain-specific (DOM-COR) and generic (GEN-COR) tasks in
an authentic Internet-based COR performance assessment (CORA),
allowing us to disentangle the assumed components of COR abilities.
Here, we focus on GEN-COR to distinguish between different groups
of graduates from the three disciplines in the context of generic
COR tasks. We present a computational model for educationally
relevant texts that combines features at multiple levels (lexical,
syntactic, semantic). We use machine learning to predict domain-specific
group membership based on documents consulted during task solving.
A major contribution of our analyses is a multi-part text classification
system that contrasts human annotation and rating of the documents
used with a semi-automatic classification to predict the document
type of web pages. That is, we work with competing classifications
to support our findings. In this way, we develop a computational
linguistic model that correlates GEN-COR abilities with properties
of documents consulted for solving the GEN-COR tasks. Results
show that participants from different domains indeed inquire different
sets of online sources for the same task. Machine learning-based
classifications show that the distributional differences can be
reproduced by computational linguistic models.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2022/04/On_latent_domain-specific_textual_preferences_in_solving_Internet-based_generic_tasks_among_graduates__young_professionals_from_three_domains.pdf}
}
BibTeX
@inproceedings{Luecking:Stoeckel:Abrami:Mehler:2022,
author = {L{\"u}cking, Andy and Stoeckel, Manuel and Abrami, Giuseppe and Mehler, Alexander},
title = {I still have Time(s): Extending {HeidelTime} for {German} Texts},
booktitle = {Proceedings of the 13th Language Resources and Evaluation Conference},
series = {LREC 2022},
location = {Marseille, France},
year = {2022},
url = {https://aclanthology.org/2022.lrec-1.505},
pdf = {https://aclanthology.org/2022.lrec-1.505.pdf}
}
2021
BibTeX
@inproceedings{Ginzburg:Luecking:2021-clarifications,
title = {Requesting clarifications with speech and gestures},
author = {Ginzburg, Jonathan and L{\"u}cking, Andy},
series = {MMSR},
year = {2021},
booktitle = {Proceedings of the 1st Workshop on Multimodal Semantic Representations},
location = {Groningen, Netherlands (Online)},
publisher = {Association for Computational Linguistics},
url = {https://aclanthology.org/2021.mmsr-1.3},
pdf = {https://aclanthology.org/2021.mmsr-1.3.pdf},
pages = {21--31},
abstract = {In multimodal natural language interaction both speech and non-speech
gestures are involved in the basic mechanism of grounding and
repair. We discuss a couple of multimodal clarification requests
and argue that gestures, as well as speech expressions, underlie
comparable parallelism constraints. In order to make this precise,
we slightly extend the formal dialogue framework KoS to cover
also gestural counterparts of verbal locutionary propositions.}
}
BibTeX
@incollection{Luecking:Ginzburg:Cooper:2021,
author = {L\"{u}cking, Andy and Ginzburg, Jonathan and Cooper, Robin},
title = {Grammar in dialogue},
chapter = {26},
pages = {1155-1199},
url = {https://langsci-press.org/catalog/book/259},
editor = {M{\"u}ller, Stefan and Abeill{\'e}, Anne and Borsley, Robert D.
and Koenig, Jean-Pierre},
booktitle = {{Head Driven Phrase Structure Grammar: The handbook}},
year = {2021},
series = {Empirically Oriented Theoretical Morphology and
Syntax},
number = {9},
address = {Berlin},
publisher = {Language Science Press},
doi = {10.5281/zenodo.5543318}
}
BibTeX
@incollection{Luecking:2021,
author = {L\"{u}cking, Andy},
title = {Gesture},
pages = {1201-1250},
chapter = {27},
url = {https://langsci-press.org/catalog/book/259},
editor = {M{\"u}ller, Stefan and Abeill{\'e}, Anne and Borsley, Robert D.
and Koenig, Jean-Pierre},
booktitle = {{Head Driven Phrase Structure Grammar: The handbook}},
year = {2021},
series = {Empirically Oriented Theoretical Morphology and
Syntax},
number = {9},
address = {Berlin},
publisher = {Language Science Press},
doi = {10.5281/zenodo.5543318}
}
BibTeX
@inproceedings{Luecking:Ginzburg:2021:a,
author = {L{\"u}cking, Andy and Ginzburg, Jonathan},
title = {Saying and shaking `No'},
booktitle = {{Proceedings of the 28th International Conference on Head-Driven
Phrase Structure Grammar, Online (Frankfurt/Main)}},
editor = {M{\"u}ller, Stefan and Melnik, Nurit},
issn = {1535-1793},
doi = {10.21248/hpsg.2021.15},
publisher = {University Library},
address = {Frankfurt/Main},
pages = {283--299},
year = {2021}
}
BibTeX
@inproceedings{Ginzburg:Luecking:2021:a,
title = {Requesting clarifications with speech and gestures},
author = {Ginzburg, Jonathan and L{\"u}cking, Andy},
booktitle = {Beyond Language: Multimodal Semantic Representations},
series = {MMSR I},
year = {2021},
location = {Virtually at the University of Groningen, held in
conjuction with IWCS 2021},
url = {https://iwcs2021.github.io/proceedings/mmsr/pdf/2021.mmsr-1.3.pdf}
}
BibTeX
@inproceedings{Ginzburg:Luecking:2021:b,
author = {Ginzburg, Jonathan and L{\"u}cking, Andy},
title = {I thought pointing is rude: {A} dialogue-semantic analysis of
pointing at the addressee},
booktitle = {Proceedings of \textit{Sinn und Bedeutung 25}},
series = {SuB 25},
year = {2021},
pages = {276-291},
editor = {Grosz, Patrick and Mart{\'i}, Luisa and Pearson, Hazel and Sudo, Yasutada
and Zobel, Sarah},
note = {Special Session: Gestures and Natural Language
Semantics},
location = {University College London (Online)},
url = {https://ojs.ub.uni-konstanz.de/sub/index.php/sub/article/view/937}
}
BibTeX
@article{Luecking:et:al:2021,
author = {Andy Lücking and Christine Driller and Manuel Stoeckel and Giuseppe Abrami
and Adrian Pachzelt and Alexander Mehler},
year = {2021},
journal = {Language Resources and Evaluation},
title = {Multiple Annotation for Biodiversity: Developing an annotation
framework among biology, linguistics and text technology},
editor = {Nancy Ide and Nicoletta Calzolari},
doi = {10.1007/s10579-021-09553-5},
pdf = {https://link.springer.com/content/pdf/10.1007/s10579-021-09553-5.pdf},
keywords = {biofid}
}
BibTeX
@inproceedings{Abrami:et:al:2021,
author = {Abrami, Giuseppe and Henlein, Alexander and Lücking, Andy and Kett, Attila
and Adeberg, Pascal and Mehler, Alexander},
title = {Unleashing annotations with {TextAnnotator}: Multimedia, multi-perspective
document views for ubiquitous annotation},
booktitle = {Proceedings of the 17th Joint ACL - ISO Workshop on Interoperable
Semantic Annotation},
series = {ISA-17},
publisher = {Association for Computational Linguistics},
address = {Groningen, The Netherlands (online)},
month = {June},
editor = {Bunt, Harry},
year = {2021},
url = {https://aclanthology.org/2021.isa-1.7},
pages = {65--75},
keywords = {textannotator},
pdf = {https://iwcs2021.github.io/proceedings/isa/pdf/2021.isa-1.7.pdf},
abstract = {We argue that mainly due to technical innovation in the landscape
of annotation tools, a conceptual change in annotation models
and processes is also on the horizon. It is diagnosed that these
changes are bound up with multi-media and multi-perspective facilities
of annotation tools, in particular when considering virtual reality
(VR) and augmented reality (AR) applications, their potential
ubiquitous use, and the exploitation of externally trained natural
language pre-processing methods. Such developments potentially
lead to a dynamic and exploratory heuristic construction of the
annotation process. With TextAnnotator an annotation suite is
introduced which focuses on multi-mediality and multi-perspectivity
with an interoperable set of task-specific annotation modules
(e.g., for word classification, rhetorical structures, dependency
trees, semantic roles, and more) and their linkage to VR and mobile
implementations. The basic architecture and usage of TextAnnotator
is described and related to the above mentioned shifts in the
field.}
}
BibTeX
@article{Luecking:Brueckner:Abrami:Uslu:Mehler:2021,
journal = {Frontiers in Education},
doi = {10.3389/feduc.2020.578475},
title = {Computational linguistic assessment of textbooks and online texts
by means of threshold concepts in economics},
author = {L{\"u}cking, Andy and Br{\"u}ckner, Sebastian and Abrami, Giuseppe
and Uslu, Tolga and Mehler, Alexander},
eid = {578475},
url = {https://www.frontiersin.org/articles/10.3389/feduc.2020.578475/},
year = {2021}
}
2020
BibTeX
@article{Luecking:et:al:2020,
author = {Andy L{\"{u}}cking and Sebastian Br{\"{u}}ckner and Giuseppe Abrami
and Tolga Uslu and Alexander Mehler},
title = {Computational linguistic assessment of textbook and online learning
media by means of threshold concepts in business education},
journal = {CoRR},
volume = {abs/2008.02096},
year = {2020},
url = {https://arxiv.org/abs/2008.02096},
archiveprefix = {arXiv},
eprint = {2008.02096},
timestamp = {Fri, 07 Aug 2020 15:07:21 +0200},
biburl = {https://dblp.org/rec/journals/corr/abs-2008-02096.bib},
bibsource = {dblp computer science bibliography, https://dblp.org}
}
BibTeX
@article{Driller:et:al:2020,
author = {Christine Driller and Markus Koch and Giuseppe Abrami and Wahed Hemati
and Andy Lücking and Alexander Mehler and Adrian Pachzelt and Gerwin Kasperek},
title = {Fast and Easy Access to Central European Biodiversity Data with BIOfid},
volume = {4},
number = {},
year = {2020},
doi = {10.3897/biss.4.59157},
publisher = {Pensoft Publishers},
abstract = {The storage of data in public repositories such as the Global
Biodiversity Information Facility (GBIF) or the National Center
for Biotechnology Information (NCBI) is nowadays stipulated in
the policies of many publishers in order to facilitate data replication
or proliferation. Species occurrence records contained in legacy
printed literature are no exception to this. The extent of their
digital and machine-readable availability, however, is still far
from matching the existing data volume (Thessen and Parr 2014).
But precisely these data are becoming more and more relevant to
the investigation of ongoing loss of biodiversity. In order to
extract species occurrence records at a larger scale from available
publications, one has to apply specialised text mining tools.
However, such tools are in short supply especially for scientific
literature in the German language.The Specialised Information
Service Biodiversity Research*1 BIOfid (Koch et al. 2017) aims
at reducing this desideratum, inter alia, by preparing a searchable
text corpus semantically enriched by a new kind of multi-label
annotation. For this purpose, we feed manual annotations into
automatic, machine-learning annotators. This mixture of automatic
and manual methods is needed, because BIOfid approaches a new
application area with respect to language (mainly German of the
19th century), text type (biological reports), and linguistic
focus (technical and everyday language).We will present current
results of the performance of BIOfid’s semantic search engine
and the application of independent natural language processing
(NLP) tools. Most of these are freely available online, such as
TextImager (Hemati et al. 2016). We will show how TextImager is
tied into the BIOfid pipeline and how it is made scalable (e.g.
extendible by further modules) and usable on different systems
(docker containers).Further, we will provide a short introduction
to generating machine-learning training data using TextAnnotator
(Abrami et al. 2019) for multi-label annotation. Annotation reproducibility
can be assessed by the implementation of inter-annotator agreement
methods (Abrami et al. 2020). Beyond taxon recognition and entity
linking, we place particular emphasis on location and time information.
For this purpose, our annotation tag-set combines general categories
and biology-specific categories (including taxonomic names) with
location and time ontologies. The application of the annotation
categories is regimented by annotation guidelines (Lücking et
al. 2020). Within the next years, our work deliverable will be
a semantically accessible and data-extractable text corpus of
around two million pages. In this way, BIOfid is creating a new
valuable resource that expands our knowledge of biodiversity and
its determinants.},
issn = {},
pages = {e59157},
url = {https://doi.org/10.3897/biss.4.59157},
eprint = {https://doi.org/10.3897/biss.4.59157},
journal = {Biodiversity Information Science and Standards},
keywords = {biofid}
}
BibTeX
@inproceedings{Ginzburg:Luecking:2020:a,
author = {Ginzburg, Jonathan and L{\"u}cking, Andy},
title = {On Laughter and Forgetting and Reconversing: {A} neurologically-inspired
model of conversational context},
booktitle = {Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue},
series = {SemDial/WatchDial},
year = {2020},
location = {Brandeis University, Waltham, New Jersey (Online)},
url = {https://www.semdial.org/anthology/papers/Z/Z20/Z20-3008/},
pdf = {http://semdial.org/anthology/Z20-Ginzburg_semdial_0008.pdf}
}
BibTeX
@inproceedings{Luecking:Ginzburg:2020,
author = {L{\"u}cking, Andy and Ginzburg, Jonathan},
title = {Towards the score of communication},
booktitle = {Proceedings of the 24th Workshop on the Semantics and Pragmatics of Dialogue},
series = {SemDial/WatchDial},
year = {2020},
location = {Brandeis University, Waltham, New Jersey (Online)},
url = {https://www.semdial.org/anthology/papers/Z/Z20/Z20-3016/},
pdf = {http://semdial.org/anthology/Z20-Luecking_semdial_0016.pdf}
}
2019
BibTeX
@incollection{Luecking:2019:a,
author = {L\"{u}cking, Andy},
title = {Dialogue semantics: {From} cognitive structures to positive and
negative learning},
year = {2019},
pages = {197-205},
publisher = {Springer Nature Switzerland AG},
address = {Cham, Switzerland},
editor = {Zlatkin-Troitschankskaia, Olga},
booktitle = {Frontiers and Advances in Positive Learning in the Age of InformaTiOn (PLATO)},
doi = {10.1007/978-3-030-26578-6},
url = {https://link.springer.com/chapter/10.1007/978-3-030-26578-6_15}
}
BibTeX
@inproceedings{Luecking:Ginzburg:2019,
author = {L{\"u}cking, Andy and Ginzburg, Jonathan},
title = {Not few but all quantifiers can be negated: towards a referentially
transparent semantics of quantified noun phrases},
booktitle = {Proceedings of the Amsterdam Colloquium 2019},
series = {AC'19},
location = {University of Amsterdam},
year = {2019},
pages = {269-278},
url = {http://events.illc.uva.nl/AC/AC2019/},
pdf = {http://events.illc.uva.nl/AC/AC2019/uploaded_files/inlineitem/L_cking_and_Ginzburg_Not_few_but_all_quantifiers_ca.pdf}
}
BibTeX
@incollection{Luecking:2019:b,
keywords = {own,bookchapter},
author+an = {1=highlight},
author = {L\"{u}cking, Andy},
year = {2019},
title = {Gesture},
editor = {M\"{u}ller, Stefan and Abeill\'{e}, Anne and Borsley, Robert D.
and Koenig, Jean-Pierre},
booktitle = {{Head-Driven Phrase Structure Grammar}: {The} handbook},
address = {Berlin},
publisher = {Language Science Press},
pdf = {https://hpsg.hu-berlin.de/Projects/HPSG-handbook/PDFs/gesture.pdf},
url = {https://langsci-press.org/catalog/book/259}
}
BibTeX
@incollection{Luecking:Ginzburg:Cooper:2019,
keywords = {own,bookchapter},
author+an = {1=highlight},
author = {L\"{u}cking, Andy and Ginzburg, Jonathan and Cooper, Robin},
year = {2019},
title = {Grammar in dialogue},
editor = {M\"{u}ller, Stefan and Abeill\'{e}, Anne and Borsley, Robert D.
and Koenig, Jean-Pierre},
booktitle = {{Head-Driven Phrase Structure Grammar}: {The} handbook},
address = {Berlin},
publisher = {Language Science Press},
pdf = {https://hpsg.hu-berlin.de/Projects/HPSG-handbook/PDFs/dialogue.pdf},
url = {https://langsci-press.org/catalog/book/259}
}
BibTeX
@inproceedings{Luecking:Cooper:Larsson:Ginzburg:2019,
author = {Lücking, Andy and Cooper, Robin and Larsson, Staffan and Ginzburg, Jonathan},
title = {Distribution is not enough -- Going {Firther}},
booktitle = {Proceedings of Natural Language and Computer Science},
maintitle = {The 13th International Conference on Computational
Semantics (IWCS 2019)},
series = {NLCS 6},
location = {Gothenburg, Sweden},
month = {May},
year = {2019},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/05/Distribution_is_not_enough.pdf}
}
BibTeX
@inproceedings{Abrami:et:al:2019,
author = {Abrami, Giuseppe and Mehler, Alexander and Lücking, Andy and Rieb, Elias
and Helfrich, Philipp},
title = {{TextAnnotator}: A flexible framework for semantic annotations},
booktitle = {Proceedings of the Fifteenth Joint ACL - ISO Workshop on Interoperable
Semantic Annotation, (ISA-15)},
series = {ISA-15},
location = {Gothenburg, Sweden},
month = {May},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/TextAnnotator_IWCS_Göteborg.pdf},
year = {2019},
keywords = {textannotator},
abstract = {Modern annotation tools should meet at least the following general
requirements: they can handle diverse data and annotation levels
within one tool, and they support the annotation process with
automatic (pre-)processing outcomes as much as possible. We developed
a framework that meets these general requirements and that enables
versatile and browser-based annotations of texts, the TextAnnotator.
It combines NLP methods of pre-processing with methods of flexible
post-processing. Infact, machine learning (ML) requires a lot
of training and test data, but is usually far from achieving perfect
results. Producing high-level annotations for ML and post-correcting
its results are therefore necessary. This is the purpose of TextAnnotator,
which is entirely implemented in ExtJS and provides a range of
interactive visualizations of annotations. In addition, it allows
for flexibly integrating knowledge resources, e.g. in the course
of post-processing named entity recognition. The paper describes
TextAnnotator’s architecture together with three use cases: annotating
temporal structures, argument structures and named entity linking.}
}
BibTeX
@article{Gleim:Eger:Mehler:2019,
author = {Gleim, R\"{u}diger and Eger, Steffen and Mehler, Alexander and Uslu, Tolga
and Hemati, Wahed and L\"{u}cking, Andy and Henlein, Alexander and Kahlsdorf, Sven
and Hoenen, Armin},
title = {A practitioner's view: a survey and comparison of lemmatization
and morphological tagging in German and Latin},
journal = {Journal of Language Modeling},
year = {2019},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/07/jlm-tagging.pdf},
doi = {10.15398/jlm.v7i1.205},
url = {http://jlm.ipipan.waw.pl/index.php/JLM/article/view/205}
}
2018
BibTeX
@incollection{Luecking:2018:a,
author = {Andy L\"{u}cking},
title = {Witness-loaded and Witness-free Demonstratives},
booktitle = {Atypical Demonstratives},
publisher = {De Gruyter},
year = {2018},
editor = {Marco Coniglio and Andrew Murphy and Eva Schlachter and Tonjes Veenstra},
isbn = {978-3-11-056029-9},
url = {https://www.degruyter.com/view/product/495228},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2020/05/Luecking-witness-loading-rg.pdf}
}
BibTeX
@inproceedings{Luecking:Ginzburg:2018,
title = {`Most people but not {Bill}': integrating sets, individuals and
negation into a cognitively plausible account of noun phrase interpretation},
booktitle = {Proceedings of Cognitive Structures: Linguistic, Philosophical
and Psychological Perspectives},
series = {CoSt'18},
author = {L\"{u}cking, Andy and Ginzburg, Jonathan},
year = {2018}
}
BibTeX
@incollection{Mehler:Hemati:Uslu:Luecking:2018,
author = {Alexander Mehler and Wahed Hemati and Tolga Uslu and Andy Lücking},
title = {A Multidimensional Model of Syntactic Dependency Trees for Authorship
Attribution},
booktitle = {Quantitative analysis of dependency structures},
publisher = {De Gruyter},
editor = {Jingyang Jiang and Haitao Liu},
address = {Berlin/New York},
abstract = {Abstract: In this chapter we introduce a multidimensional model
of syntactic dependency trees. Our ultimate goal is to generate
fingerprints of such trees to predict the author of the underlying
sentences. The chapter makes a first attempt to create such fingerprints
for sentence categorization via the detour of text categorization.
We show that at text level, aggregated dependency structures actually
provide information about authorship. At the same time, we show
that this does not hold for topic detection. We evaluate our model
using a quarter of a million sentences collected in two corpora:
the first is sampled from literary texts, the second from Wikipedia
articles. As a second finding of our approach, we show that quantitative
models of dependency structure do not yet allow for detecting
syntactic alignment in written communication. We conclude that
this is mainly due to effects of lexical alignment on syntactic
alignment.},
keywords = {Dependency structure, Authorship attribution, Text
categorization, Syntactic Alignment},
year = {2018}
}
BibTeX
@article{Mehler:Gleim:Luecking:Uslu:Stegbauer:2018,
author = {Alexander Mehler and Rüdiger Gleim and Andy Lücking and Tolga Uslu
and Christian Stegbauer},
title = {On the Self-similarity of {Wikipedia} Talks: a Combined Discourse-analytical
and Quantitative Approach},
journal = {Glottometrics},
volume = {40},
pages = {1-44},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/Glottometrics-Mehler.pdf},
year = {2018}
}
BibTeX
@inproceedings{Helfrich:et:al:2018,
author = {Philipp Helfrich and Elias Rieb and Giuseppe Abrami and Andy L{\"u}cking
and Alexander Mehler},
title = {TreeAnnotator: Versatile Visual Annotation of Hierarchical Text Relations},
booktitle = {Proceedings of the 11th edition of the Language Resources and
Evaluation Conference, May 7 - 12},
series = {LREC 2018},
address = {Miyazaki, Japan},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/TreeAnnotator.pdf},
year = {2018}
}
BibTeX
@inbook{Mehler:et:al:2018,
abstract = {This chapter develops a computational linguistic model for analyzing
and comparing multilingual data as well as its application to
a large body of standardized assessment data from higher education.
The approach employs both an automatic and a manual annotation
of the data on several linguistic layers (including parts of speech,
text structure and content). Quantitative features of the textual
data are explored that are related to both the students' (domain-specific
knowledge) test results and their level of academic experience.
The respective analysis involves statistics of distance correlation,
text categorization with respect to text types (questions and
response options) as well as languages (English and German), and
network analysis to assess dependencies between features. The
correlation between correct test results of students and linguistic
features of the verbal presentations of tests indicate to what
extent language influences higher education test performance.
It has also been found that this influence relates to specialized
language. Thus, this integrative modeling approach contributes
a test basis for a large-scale analysis of learning data and points
to a number of subsequent, more detailed research questions.},
address = {Wiesbaden},
author = {Mehler, Alexander and Zlatkin-Troitschanskaia, Olga and Hemati, Wahed
and Molerov, Dimitri and L{\"u}cking, Andy and Schmidt, Susanne},
booktitle = {Positive Learning in the Age of Information: A Blessing or a Curse?},
doi = {10.1007/978-3-658-19567-0_10},
editor = {Zlatkin-Troitschanskaia, Olga and Wittum, Gabriel and Dengel, Andreas},
isbn = {978-3-658-19567-0},
pages = {145--193},
publisher = {Springer Fachmedien Wiesbaden},
title = {Integrating Computational Linguistic Analysis of Multilingual
Learning Data and Educational Measurement Approaches to Explore
Learning in Higher Education},
url = {https://doi.org/10.1007/978-3-658-19567-0_10},
year = {2018}
}
2017
BibTeX
@article{Mehler:Luecking:2017,
author = {Alexander Mehler and Andy Lücking},
title = {Modelle sozialer Netzwerke und Natural Language Processing: eine
methodologische Randnotiz},
journal = {Soziologie},
volume = {46},
number = {1},
pages = {43-47},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/Soziologe-NetzwerkeundNLP.pdf},
year = {2017}
}
BibTeX
@inproceedings{Luecking:2017:c,
author = {L\"{u}cking, Andy},
title = {Indexicals as Weak Descriptors},
booktitle = {Proceedings of the 12th International Conference on Computational Semantics},
series = {IWCS 2017},
address = {Montpellier (France)},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/descriptive-indexicals_rev.pdf},
year = {2017}
}
2016
BibTeX
@inproceedings{Luecking:2016:b,
author = {L\"{u}cking, Andy},
title = {Modeling Co-Verbal Gesture Perception in Type Theory with Records},
booktitle = {Proceedings of the 2016 Federated Conference on Computer Science
and Information Systems},
editor = {M. Ganzha and L. Maciaszek and M. Paprzycki},
volume = {8},
series = {Annals of Computer Science and Information Systems},
pages = {383-392},
address = {Gdansk, Poland},
publisher = {IEEE},
note = {Best Paper Award},
doi = {10.15439/2016F83},
pdf = {http://annals-csis.org/Volume_8/pliks/83.pdf},
url = {http://annals-csis.org/Volume_8/drp/83.html},
year = {2016}
}
BibTeX
@inproceedings{Luecking:Mehler:Walther:Mauri:Kurfuerst:2016,
author = {L\"{u}cking, Andy and Mehler, Alexander and Walther, D\'{e}sir\'{e}e
and Mauri, Marcel and Kurf\"{u}rst, Dennis},
title = {Finding Recurrent Features of Image Schema Gestures: the {FIGURE} corpus},
booktitle = {Proceedings of the 10th International Conference on Language Resources
and Evaluation},
series = {LREC 2016},
location = {Portoro\v{z} (Slovenia)},
pdf = {http://www.texttechnologylab.org/wp-content/uploads/2016/04/lrec2016-gesture-study-final-version-short.pdf},
year = {2016}
}
BibTeX
@inproceedings{Luecking:Hoenen:Mehler:2016,
author = {L\"{u}cking, Andy and Hoenen, Armin and Mehler, Alexander},
title = {{TGermaCorp} -- A (Digital) Humanities Resource for (Computational) Linguistics},
booktitle = {Proceedings of the 10th International Conference on Language Resources
and Evaluation},
series = {LREC 2016},
islrn = {536-382-801-278-5},
location = {Portoro\v{z} (Slovenia)},
pdf = {http://www.texttechnologylab.org/wp-content/uploads/2016/04/lrec2016-ttgermacorp-final.pdf},
year = {2016}
}
2015
BibTeX
@book{Mehler:Luecking:Banisch:Blanchard:Frank-Job:2015,
editor = {Mehler, Alexander and Lücking, Andy and Banisch, Sven and Blanchard, Philippe
and Frank-Job, Barbara},
title = {Towards a Theoretical Framework for Analyzing Complex Linguistic Networks},
publisher = {Springer},
series = {Understanding Complex Systems},
adress = {Berlin and New York},
image = {https://www.texttechnologylab.org/wp-content/uploads/2015/09/UCS_17-2-tmp.png},
isbn = {978-36-662-47237-8},
year = {2015}
}
BibTeX
@article{Luecking:Pfeiffer:Rieser:2015,
author = {Lücking, Andy and Pfeiffer, Thies and Rieser, Hannes},
title = {Pointing and Reference Reconsidered},
journal = {Journal of Pragmatics},
volume = {77},
pages = {56-79},
abstract = {Current semantic theory on indexical expressions claims that demonstratively
used indexicals such as this lack a referent-determining meaning
but instead rely on an accompanying demonstration act like a pointing
gesture. While this view allows to set up a sound logic of demonstratives,
the direct-referential role assigned to pointing gestures has
never been scrutinized thoroughly in semantics or pragmatics.
We investigate the semantics and pragmatics of co-verbal pointing
from a foundational perspective combining experiments, statistical
investigation, computer simulation and theoretical modeling techniques
in a novel manner. We evaluate various referential hypotheses
with a corpus of object identification games set up in experiments
in which body movement tracking techniques have been extensively
used to generate precise pointing measurements. Statistical investigation
and computer simulations show that especially distal areas in
the pointing domain falsify the semantic direct-referential hypotheses
concerning pointing gestures. As an alternative, we propose that
reference involving pointing rests on a default inference which
we specify using the empirical data. These results raise numerous
problems for classical semantics–pragmatics interfaces: we argue
for pre-semantic pragmatics in order to account for inferential
reference in addition to classical post-semantic Gricean pragmatics.},
doi = {10.1016/j.pragma.2014.12.013},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Luecking_Pfeiffer_Rieser_Pointing_and_Reference_Reconsiderd.pdf},
website = {http://www.sciencedirect.com/science/article/pii/S037821661500003X},
year = {2015}
}
2014
BibTeX
@incollection{Mehler:vor:der:Brueck:Luecking:2014,
author = {Mehler, Alexander and vor der Brück, Tim and Lücking, Andy},
title = {Comparing Hand Gesture Vocabularies for HCI},
booktitle = {Proceedings of HCI International 2014, 22 - 27 June 2014, Heraklion, Greece},
publisher = {Springer},
address = {Berlin/New York},
abstract = {HCI systems are often equipped with gestural interfaces drawing
on a predefined set of admitted gestures. We provide an assessment
of the fitness of such gesture vocabularies in terms of their
learnability and naturalness. This is done by example of rivaling
gesture vocabularies of the museum information system WikiNect.
In this way, we do not only provide a procedure for evaluating
gesture vocabularies, but additionally contribute to design criteria
to be followed by the gestures.},
keywords = {wikinect},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Comparing-Gesture-Vocabularies-1_1.pdf},
website = {{http://link.springer.com/chapter/10.1007/978-3-319-07230-2_8#page-1}},
year = {2014}
}
BibTeX
@article{Mehler:Luecking:Abrami:2014,
author = {Mehler, Alexander and Lücking, Andy and Abrami, Giuseppe},
title = {{WikiNect}: Image Schemata as a Basis of Gestural Writing for
Kinetic Museum Wikis},
journal = {Universal Access in the Information Society},
pages = {1-17},
abstract = {This paper provides a theoretical assessment of gestures in the
context of authoring image-related hypertexts by example of the
museum information system WikiNect. To this end, a first implementation
of gestural writing based on image schemata is provided (Lakoff
in Women, fire, and dangerous things: what categories reveal about
the mind. University of Chicago Press, Chicago, 1987). Gestural
writing is defined as a sort of coding in which propositions are
only expressed by means of gestures. In this respect, it is shown
that image schemata allow for bridging between natural language
predicates and gestural manifestations. Further, it is demonstrated
that gestural writing primarily focuses on the perceptual level
of image descriptions (Hollink et al. in Int J Hum Comput Stud
61(5):601–626, 2004). By exploring the metaphorical potential
of image schemata, it is finally illustrated how to extend the
expressiveness of gestural writing in order to reach the conceptual
level of image descriptions. In this context, the paper paves
the way for implementing museum information systems like WikiNect
as systems of kinetic hypertext authoring based on full-fledged
gestural writing.},
doi = {10.1007/s10209-014-0386-8},
issn = {1615-5289},
keywords = {wikinect},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/art_10.1007_s10209-014-0386-8.pdf},
website = {http://dx.doi.org/10.1007/s10209-014-0386-8},
year = {2014}
}
2013
BibTeX
@misc{Mehler:Luecking:vor:der:Brueck:2013:a,
author = {Mehler, Alexander and Lücking, Andy and vor der Brück, Tim and Abrami, Giuseppe},
title = {WikiNect - A Kinetic Artwork Wiki for Exhibition Visitors},
howpublished = {Poster Presentation at the Scientific Computing and
Cultural Heritage 2013 Conference, Heidelberg},
keywords = {wikinect},
month = {11},
poster = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/SCCHPoster2013.pdf},
url = {http://scch2013.wordpress.com/},
year = {2013}
}
BibTeX
@misc{Luecking:2013:c,
author = {Lücking, Andy},
title = {Theoretische Bausteine für einen semiotischen Ansatz zum Einsatz
von Gestik in der Aphasietherapie},
howpublished = {Talk at the BKL workshop 2013, Bochum},
month = {05},
url = {http://www.bkl-ev.de/bkl_workshop/archiv/workshop13_programm.php},
year = {2013}
}
BibTeX
@misc{Luecking:2013:d,
author = {Lücking, Andy},
title = {Eclectic Semantics for Non-Verbal Signs},
howpublished = {Talk at the Conference on Investigating semantics:
Empirical and philosophical approaches, Bochum},
month = {10},
url = {http://www.ruhr-uni-bochum.de/phil-lang/investigating/index.html},
year = {2013}
}
BibTeX
@inproceedings{Luecking:2013:e,
author = {Lücking, Andy},
title = {Multimodal Propositions? From Semiotic to Semantic Considerations
in the Case of Gestural Deictics},
booktitle = {Poster Abstracts of the Proceedings of the 17th Workshop on the
Semantics and Pragmatics of Dialogue},
editor = {Fernandez, Raquel and Isard, Amy},
series = {SemDial 2013},
pages = {221-223},
address = {Amsterdam},
month = {12},
poster = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/dialdam2013.pdf},
year = {2013}
}
BibTeX
@article{Luecking:Mehler:2013:a,
author = {Lücking, Andy and Mehler, Alexander},
title = {On Three Notions of Grounding of Artificial Dialog Companions},
journal = {Science, Technology \& Innovation Studies},
volume = {10},
number = {1},
pages = {31-36},
abstract = {We provide a new, theoretically motivated evaluation grid for
assessing the conversational achievements of Artificial Dialog
Companions (ADCs). The grid is spanned along three grounding problems.
Firstly, it is argued that symbol grounding in general has to
be instrinsic. Current approaches in this context, however, are
limited to a certain kind of expression that can be grounded in
this way. Secondly, we identify three requirements for conversational
grounding, the process leading to mutual understanding. Finally,
we sketch a test case for symbol grounding in the form of the
philosophical grounding problem that involves the use of modal
language. Together, the three grounding problems provide a grid
that allows us to assess ADCs’ dialogical performances and to
pinpoint future developments on these grounds.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/STI-final-badge.pdf},
website = {http://www.sti-studies.de/ojs/index.php/sti/article/view/143},
year = {2013}
}
BibTeX
@inproceedings{Luecking:2013:b,
author = {Lücking, Andy},
title = {Interfacing Speech and Co-Verbal Gesture: Exemplification},
booktitle = {Proceedings of the 35th Annual Conference of the German Linguistic Society},
series = {DGfS 2013},
pages = {284-286},
address = {Potsdam, Germany},
year = {2013}
}
BibTeX
@book{Luecking:2013,
author = {Lücking, Andy},
title = {Ikonische Gesten. Grundzüge einer linguistischen Theorie},
publisher = {De Gruyter},
address = {Berlin and Boston},
note = {Zugl. Diss. Univ. Bielefeld (2011)},
abstract = {Nicht-verbale Zeichen, insbesondere sprachbegleitende Gesten,
spielen eine herausragende Rolle in der menschlichen Kommunikation.
Um eine Analyse von Gestik innerhalb derjenigen Disziplinen, die
sich mit der Erforschung und Modellierung von Dialogen besch{\"a}ftigen,
zu ermöglichen, bedarf es einer entsprechenden linguistischen
Rahmentheorie. „Ikonische Gesten“ bietet einen ersten zeichen-
und wahrnehmungstheoretisch motivierten Rahmen an, in dem eine
grammatische Analyse der Integration von Sprache und Gestik möglich
ist. Ausgehend von einem Abriss semiotischer Zug{\"a}nge zu ikonischen
Zeichen wird der vorherrschende {\"A}hnlichkeitsansatz unter Rückgriff
auf Wahrnehmungstheorien zugunsten eines Exemplifikationsansatzes
verworfen. Exemplifikation wird im Rahmen einer unifikationsbasierten
Grammatik umgesetzt. Dort werden u.a. multimodale Wohlgeformtheit,
Synchronie und multimodale Subkategorisierung als neue Gegenst{\"a}nde
linguistischer Forschung eingeführt und im Rahmen einer integrativen
Analyse von Sprache und Gestik modelliert.},
image = {https://www.texttechnologylab.org/wp-content/uploads/2015/09/ikonischeGesten.jpg},
year = {2013}
}
BibTeX
@article{Luecking:Bergmann:Hahn:Kopp:Rieser:2012,
author = {Lücking, Andy and Bergman, Kirsten and Hahn, Florian and Kopp, Stefan
and Rieser, Hannes},
title = {Data-based Analysis of Speech and Gesture: The Bielefeld Speech
and Gesture Alignment Corpus (SaGA) and its Applications},
journal = {Journal of Multimodal User Interfaces},
volume = {7},
number = {1-2},
pages = {5-18},
abstract = {Communicating face-to-face, interlocutors frequently produce multimodal
meaning packages consisting of speech and accompanying gestures.
We discuss a systematically annotated speech and gesture corpus
consisting of 25 route-and-landmark-description dialogues, the
Bielefeld Speech and Gesture Alignment corpus (SaGA), collected
in experimental face-to-face settings. We first describe the primary
and secondary data of the corpus and its reliability assessment.
Then we go into some of the projects carried out using SaGA demonstrating
the wide range of its usability: on the empirical side, there
is work on gesture typology, individual and contextual parameters
influencing gesture production and gestures’ functions for dialogue
structure. Speech-gesture interfaces have been established extending
unification-based grammars. In addition, the development of a
computational model of speech-gesture alignment and its implementation
constitutes a research line we focus on.},
doi = {10.1007/s12193-012-0106-8},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/MMUI-SaGA-revision2.pdf},
website = {http://www.springerlink.com/content/a547448u86h3116x/?MUD=MP},
year = {2013}
}
2012
BibTeX
@inproceedings{Mehler:Luecking:2012:d,
author = {Mehler, Alexander and Lücking, Andy},
title = {Pathways of Alignment between Gesture and Speech: Assessing Information
Transmission in Multimodal Ensembles},
booktitle = {Proceedings of the International Workshop on Formal and Computational
Approaches to Multimodal Communication under the auspices of ESSLLI
2012, Opole, Poland, 6-10 August},
editor = {Gianluca Giorgolo and Katya Alahverdzhieva},
abstract = {We present an empirical account of multimodal ensembles based
on Hjelmslev’s notion of selection. This is done to get measurable
evidence for the existence of speech-and-gesture ensembles. Utilizing
information theory, we show that there is an information transmission
that makes a gestures’ representation technique predictable when
merely knowing its lexical affiliate – in line with the notion
of the primacy of language. Thus, there is evidence for a one-way
coupling – going from words to gestures – that leads to speech-and-gesture
alignment and underlies the constitution of multimodal ensembles.},
keywords = {wikinect},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2016/06/Mehler_Luecking_FoCoMC2012-2.pdf},
website = {http://www.researchgate.net/publication/268368670_Pathways_of_Alignment_between_Gesture_and_Speech_Assessing_Information_Transmission_in_Multimodal_Ensembles},
year = {2012}
}
BibTeX
@inproceedings{Luecking:2012,
author = {Lücking, Andy},
title = {Towards a Conceptual, Unification-based Speech-Gesture Interface},
booktitle = {Proceedings of the International Workshop on Formal and Computational
Approaches to Multimodal Communication under the auspices of ESSLLI
2012, Opole, Poland, 6-10 August},
editor = {Gianluca Giorgolo and Katya Alahverdzhieva},
abstract = {A framework for grounding the semantics of co-verbal iconic gestures
is presented. A resemblance account to iconicity is discarded
in favor of an exemplification approach. It is sketched how exemplification
can be captured within a unification-based grammar that provides
a conceptual interface. Gestures modeled as vector sequences are
the exemplificational base. Some hypotheses that follow from the
general account are pointed at and remaining challenges are discussed.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/FoCoMoC2012-1.pdf},
year = {2012}
}
BibTeX
@inproceedings{Mehler:Luecking:2012:c,
author = {Mehler, Alexander and Lücking, Andy},
title = {WikiNect: Towards a Gestural Writing System for Kinetic Museum Wikis},
booktitle = {Proceedings of the International Workshop On User Experience in
e-Learning and Augmented Technologies in Education (UXeLATE 2012)
in Conjunction with ACM Multimedia 2012, 29 October- 2 November,
Nara, Japan},
pages = {7-12},
abstract = {We introduce WikiNect as a kinetic museum information system that
allows museum visitors to give on-site feedback about exhibitions.
To this end, WikiNect integrates three approaches to Human-Computer
Interaction (HCI): games with a purpose, wiki-based collaborative
writing and kinetic text-technologies. Our aim is to develop kinetic
technologies as a new paradigm of HCI. They dispense with classical
interfaces (e.g., keyboards) in that they build on non-contact
modes of communication like gestures or facial expressions as
input displays. In this paper, we introduce the notion of gestural
writing as a kinetic text-technology that underlies WikiNect to
enable museum visitors to communicate their feedback. The basic
idea is to explore sequences of gestures that share the semantic
expressivity of verbally manifested speech acts. Our task is to
identify such gestures that are learnable on-site in the usage
scenario of WikiNect. This is done by referring to so-called transient
gestures as part of multimodal ensembles, which are candidate
gestures of the desired functionality.},
keywords = {wikinect},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/UXeLATE2012-copyright.pdf},
website = {http://www.researchgate.net/publication/262319200_WikiNect_towards_a_gestural_writing_system_for_kinetic_museum_wikis},
year = {2012}
}
BibTeX
@incollection{Luecking:Ptock:Bergmann:2012,
author = {Lücking, Andy and Ptock, Sebastian and Bergmann, Kirsten},
title = {Assessing Agreement on Segmentations by Means of Staccato, the
Segmentation Agreement Calculator according to Thomann},
booktitle = {Gesture and Sign Language in Human-Computer Interaction and Embodied
Communication},
publisher = {Springer},
editor = {Eleni Efthimiou and Georgios Kouroupetroglou and Stavroula-Evita Fotina},
volume = {7206},
series = {Lecture Notes in Artificial Intelligence},
pages = {129-138},
address = {Berlin and Heidelberg},
abstract = {Staccato, the Segmentation Agreement Calculator According to Thomann
, is a software tool for assessing the degree of agreement of
multiple segmentations of some time-related data (e.g., gesture
phases or sign language constituents). The software implements
an assessment procedure developed by Bruno Thomann and will be
made publicly available. The article discusses the rationale of
the agreement assessment procedure and points at future extensions
of Staccato.},
booksubtitle = {9th International Gesture Workshop, GW 2011, Athens,
Greece, May 2011, Revised Selected Papers},
website = {http://link.springer.com/chapter/10.1007/978-3-642-34182-3_12},
year = {2012}
}
BibTeX
@article{Mehler:Luecking:Menke:2012,
author = {Mehler, Alexander and Lücking, Andy and Menke, Peter},
title = {Assessing Cognitive Alignment in Different Types of Dialog by
means of a Network Model},
journal = {Neural Networks},
volume = {32},
pages = {159-164},
abstract = {We present a network model of dialog lexica, called TiTAN (Two-layer
Time-Aligned Network) series. TiTAN series capture the formation
and structure of dialog lexica in terms of serialized graph representations.
The dynamic update of TiTAN series is driven by the dialog-inherent
timing of turn-taking. The model provides a link between neural,
connectionist underpinnings of dialog lexica on the one hand and
observable symbolic behavior on the other. On the neural side,
priming and spreading activation are modeled in terms of TiTAN
networking. On the symbolic side, TiTAN series account for cognitive
alignment in terms of the structural coupling of the linguistic
representations of dialog partners. This structural stance allows
us to apply TiTAN in machine learning of data of dialogical alignment.
In previous studies, it has been shown that aligned dialogs can
be distinguished from non-aligned ones by means of TiTAN -based
modeling. Now, we simultaneously apply this model to two types
of dialog: task-oriented, experimentally controlled dialogs on
the one hand and more spontaneous, direction giving dialogs on
the other. We ask whether it is possible to separate aligned dialogs
from non-aligned ones in a type-crossing way. Starting from a
recent experiment (Mehler, Lücking, \& Menke, 2011a), we show
that such a type-crossing classification is indeed possible. This
hints at a structural fingerprint left by alignment in networks
of linguistic items that are routinely co-activated during conversation.},
doi = {10.1016/j.neunet.2012.02.013},
website = {http://www.sciencedirect.com/science/article/pii/S0893608012000421},
year = {2012}
}
BibTeX
@incollection{Luecking:Pfeiffer:2012,
author = {Lücking, Andy and Pfeiffer, Thies},
title = {Framing Multimodal Technical Communication. With Focal Points
in Speech-Gesture-Integration and Gaze Recognition},
booktitle = {Handbook of Technical Communication},
publisher = {De Gruyter Mouton},
editor = {Alexander Mehler and Laurent Romary and Dafydd Gibbon},
volume = {8},
series = {Handbooks of Applied Linguistics},
chapter = {18},
pages = {591-644},
website = {http://www.degruyter.com/view/books/9783110224948/9783110224948.591/9783110224948.591.xml},
year = {2012}
}
BibTeX
@incollection{Kubina:Abramov:Luecking:2012,
author = {Kubina, Petra and Abramov, Olga and Lücking, Andy},
title = {Barrier-free Communication},
booktitle = {Handbook of Technical Communication},
publisher = {De Gruyter Mouton},
editor = {Alexander Mehler and Laurent Romary},
volume = {8},
series = {Handbooks of Applied Linguistics},
chapter = {19},
pages = {645-706},
address = {Berlin and Boston},
editora = {Dafydd Gibbon},
editoratype = {collaborator},
website = {http://www.degruyter.com/view/books/9783110224948/9783110224948.645/9783110224948.645.xml},
year = {2012}
}
BibTeX
@inproceedings{Luecking:Mehler:2012,
author = {Lücking, Andy and Mehler, Alexander},
title = {What's the Scope of the Naming Game? Constraints on Semantic Categorization},
booktitle = {Proceedings of the 9th International Conference on the Evolution of Language},
pages = {196-203},
address = {Kyoto, Japan},
abstract = {The Naming Game (NG) has become a vivid research paradigm for
simulation studies on language evolution and the establishment
of naming conventions. Recently, NGs were used for reconstructing
the creation of linguistic categories, most notably for color
terms. We recap the functional principle of NGs and the latter
Categorization Games (CGs) and evaluate them in the light of semantic
data of linguistic categorization outside the domain of colors.
This comparison reveals two specifics of the CG paradigm: Firstly,
the emerging categories draw basically on the predefined topology
of the learning domain. Secondly, the kind of categories that
can be learnt in CGs is bound to context-independent intersective
categories. This suggests that the NG and the CG focus on a special
aspect of natural language categorization, which disregards context-sensitive
categories used in a non-compositional manner.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Evolang2012-AL_AM.pdf},
url = {http://kyoto.evolang.org/},
website = {https://www.researchgate.net/publication/267858061_WHAT'S_THE_SCOPE_OF_THE_NAMING_GAME_CONSTRAINTS_ON_SEMANTIC_CATEGORIZATION},
year = {2012}
}
2011
BibTeX
@article{Luecking:Mehler:2011,
author = {Lücking, Andy and Mehler, Alexander},
title = {A Model of Complexity Levels of Meaning Constitution in Simulation
Models of Language Evolution},
journal = {International Journal of Signs and Semiotic Systems},
volume = {1},
number = {1},
pages = {18-38},
abstract = {Currently, some simulative accounts exist within dynamic or evolutionary
frameworks that are concerned with the development of linguistic
categories within a population of language users. Although these
studies mostly emphasize that their models are abstract, the paradigm
categorization domain is preferably that of colors. In this paper,
the authors argue that color adjectives are special predicates
in both linguistic and metaphysical terms: semantically, they
are intersective predicates, metaphysically, color properties
can be empirically reduced onto purely physical properties. The
restriction of categorization simulations to the color paradigm
systematically leads to ignoring two ubiquitous features of natural
language predicates, namely relativity and context-dependency.
Therefore, the models for simulation models of linguistic categories
are not able to capture the formation of categories like perspective-dependent
predicates ‘left’ and ‘right’, subsective predicates like ‘small’
and ‘big’, or predicates that make reference to abstract objects
like ‘I prefer this kind of situation’. The authors develop a
three-dimensional grid of ascending complexity that is partitioned
according to the semiotic triangle. They also develop a conceptual
model in the form of a decision grid by means of which the complexity
level of simulation models of linguistic categorization can be
assessed in linguistic terms.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/luecking_mehler_article_IJSSS.pdf},
year = {2011}
}
BibTeX
@inproceedings{Luecking:Ptock:Bergmann:2011,
author = {Lücking, Andy and Ptock, Sebastian and Bergmann, Kirsten},
title = {Staccato: Segmentation Agreement Calculator},
booktitle = {Gesture in Embodied Communication and Human-Computer Interaction.
Proceedings of the 9th International Gesture Workshop},
editor = {Eleni Efthimiou and Georgios Kouroupetroglou},
series = {GW 2011},
pages = {50--53},
address = {Athens, Greece},
publisher = {National and Kapodistrian University of Athens},
month = {5},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/LueckingEA_final.pdf},
year = {2011}
}
BibTeX
@inproceedings{Mehler:Luecking:2011,
author = {Mehler, Alexander and Lücking, Andy},
title = {A Graph Model of Alignment in Multilog},
booktitle = {Proceedings of IEEE Africon 2011},
series = {IEEE Africon},
address = {Zambia},
organization = {IEEE},
month = {9},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/africon2011-paper-Alexander_Mehler_Andy_Luecking.pdf},
website = {https://www.researchgate.net/publication/267941012_A_Graph_Model_of_Alignment_in_Multilog},
year = {2011}
}
BibTeX
@inproceedings{Mehler:Luecking:Menke:2011,
author = {Mehler, Alexander and Lücking, Andy and Menke, Peter},
title = {From Neural Activation to Symbolic Alignment: A Network-Based
Approach to the Formation of Dialogue Lexica},
booktitle = {Proceedings of the International Joint Conference on Neural Networks
(IJCNN 2011), San Jose, California, July 31 -- August 5},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/neural-align-final.pdf},
website = {{http://dx.doi.org/10.1109/IJCNN.2011.6033266}},
year = {2011}
}
BibTeX
@inproceedings{Luecking:Abramov:Mehler:Menke:2011,
author = {Lücking, Andy and Abramov, Olga and Mehler, Alexander and Menke, Peter},
title = {The Bielefeld Jigsaw Map Game (JMG) Corpus},
booktitle = {Abstracts of the Corpus Linguistics Conference 2011},
series = {CL2011},
address = {Birmingham},
pdf = {http://www.birmingham.ac.uk/documents/college-artslaw/corpus/conference-archives/2011/Paper-137.pdf},
website = {http://www.birmingham.ac.uk/research/activity/corpus/publications/conference-archives/2011-birmingham.aspx},
year = {2011}
}
BibTeX
@inproceedings{Mehler:Luecking:Menke:2011:a,
author = {Mehler, Alexander and Lücking, Andy and Menke, Peter},
title = {Assessing Lexical Alignment in Spontaneous Direction Dialogue
Data by Means of a Lexicon Network Model},
booktitle = {Proceedings of 12th International Conference on Intelligent Text
Processing and Computational Linguistics (CICLing), February 20--26,
Tokyo},
series = {CICLing'11},
pages = {368-379},
address = {Berlin/New York},
publisher = {Springer},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/titan-cicling-camera-ready.pdf},
website = {http://www.springerlink.com/content/g7p2250025u20010/},
year = {2011}
}
BibTeX
@inproceedings{Ries:Luecking:2011,
author = {Ries, Veronika and Lücking, Andy},
booktitle = {Multilingual Resources and Multilingual Applications: Proceedings
of the German Society for Computational Linguistics 2011},
year = {2011},
pages = {207--210},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Ries_Luecking.pdf},
poster = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/SoSaBiEC-poster.pdf}
}
2010
BibTeX
@article{Mehler:Weiss:Luecking:2010:a,
author = {Mehler, Alexander and Lücking, Andy and Wei{\ss}, Petra},
title = {A Network Model of Interpersonal Alignment},
journal = {Entropy},
volume = {12},
number = {6},
pages = {1440-1483},
abstract = {In dyadic communication, both interlocutors adapt to each other
linguistically, that is, they align interpersonally. In this article,
we develop a framework for modeling interpersonal alignment in
terms of the structural similarity of the interlocutors’ dialog
lexica. This is done by means of so-called two-layer time-aligned
network series, that is, a time-adjusted graph model. The graph
model is partitioned into two layers, so that the interlocutors’
lexica are captured as subgraphs of an encompassing dialog graph.
Each constituent network of the series is updated utterance-wise.
Thus, both the inherent bipartition of dyadic conversations and
their gradual development are modeled. The notion of alignment
is then operationalized within a quantitative model of structure
formation based on the mutual information of the subgraphs that
represent the interlocutor’s dialog lexica. By adapting and further
developing several models of complex network theory, we show that
dialog lexica evolve as a novel class of graphs that have not
been considered before in the area of complex (linguistic) networks.
Additionally, we show that our framework allows for classifying
dialogs according to their alignment status. To the best of our
knowledge, this is the first approach to measuring alignment in
communication that explores the similarities of graph-like cognitive
representations.},
doi = {10.3390/e12061440},
pdf = {http://www.mdpi.com/1099-4300/12/6/1440/pdf},
website = {http://www.mdpi.com/1099-4300/12/6/1440/},
year = {2010}
}
BibTeX
@misc{Luecking:Bergmann:2010,
author = {Andy L\"{u}cking and Kirsten Bergmann},
title = {Introducing the {B}ielefeld {SaGA} Corpus},
howpublished = {Talk given at \textit{Gesture: Evolution, Brain, and
Linguistic Structures.} 4th Conference of the
International Society for Gesture Studies (ISGS).
Europa Universit\"{a}t Viadrina Frankfurt/Oder},
abstract = {People communicate multimodally. Most prominently, they co-produce
speech and gesture. How do they do that? Studying the interplay
of both modalities has to be informed by empirically observed
communication behavior. We present a corpus built of speech and
gesture data gained in a controlled study. We describe 1) the
setting underlying the data; 2) annotation of the data; 3) reliability
evalution methods and results; and 4) applications of the corpus
in the research domain of speech and gesture alignment.},
address = {Europa Universit{\"a}t Viadrina Frankfurt/Oder},
day = {28},
month = {07},
year = {2010}
}
BibTeX
@inproceedings{Luecking:2010,
author = {Lücking, Andy},
title = {A Semantic Account for Iconic Gestures},
booktitle = {Gesture: Evolution, Brain, and Linguistic Structures},
pages = {210},
address = {Europa Universit{\"a}t Viadrina Frankfurt/Oder},
organization = {4th Conference of the International Society for
Gesture Studies (ISGS)},
keywords = {own},
month = {7},
pdf = {https://pub.uni-bielefeld.de/download/2318565/2319962},
website = {http://pub.uni-bielefeld.de/publication/2318565},
year = {2010}
}
BibTeX
@inproceedings{Luecking:et:al:2010,
author = {Lücking, Andy and Bergmann, Kirsten and Hahn, Florian and Kopp, Stefan
and Rieser, Hannes},
title = {The Bielefeld Speech and Gesture Alignment Corpus (SaGA)},
booktitle = {Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality},
pages = {92--98},
address = {Malta},
organization = {7th International Conference for Language Resources
and Evaluation (LREC 2010)},
abstract = {People communicate multimodally. Most prominently, they co-produce
speech and gesture. How do they do that? Studying the interplay
of both modalities has to be informed by empirically observed
communication behavior. We present a corpus built of speech and
gesture data gained in a controlled study. We describe 1) the
setting underlying the data; 2) annotation of the data; 3) reliability
evalution methods and results; and 4) applications of the corpus
in the research domain of speech and gesture alignment.},
keywords = {own},
month = {5},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/saga-corpus.pdf},
website = {http://pub.uni-bielefeld.de/publication/2001935},
year = {2010}
}
BibTeX
@inproceedings{Mehler:Weiss:Menke:Luecking:2010,
author = {Mehler, Alexander and Wei{\ss}, Petra and Menke, Peter and Lücking, Andy},
title = {Towards a Simulation Model of Dialogical Alignment},
booktitle = {Proceedings of the 8th International Conference on the Evolution
of Language (Evolang8), 14-17 April 2010, Utrecht},
pages = {238-245},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Alexander_Mehler_Petra_Weiss_Peter_Menke_Andy_Luecking.pdf},
website = {http://www.let.uu.nl/evolang2010.nl/},
year = {2010}
}
2009
BibTeX
@inproceedings{Mehler:Luecking:2009,
author = {Mehler, Alexander and Lücking, Andy},
title = {A Structural Model of Semiotic Alignment: The Classification of
Multimodal Ensembles as a Novel Machine Learning Task},
booktitle = {Proceedings of IEEE Africon 2009, September 23-25, Nairobi, Kenya},
publisher = {IEEE},
abstract = {In addition to the well-known linguistic alignment processes in
dyadic communication – e.g., phonetic, syntactic, semantic alignment
– we provide evidence for a genuine multimodal alignment process,
namely semiotic alignment. Communicative elements from different
modalities 'routinize into' cross-modal 'super-signs', which we
call multimodal ensembles. Computational models of human communication
are in need of expressive models of multimodal ensembles. In this
paper, we exemplify semiotic alignment by means of empirical examples
of the building of multimodal ensembles. We then propose a graph
model of multimodal dialogue that is expressive enough to capture
multimodal ensembles. In line with this model, we define a novel
task in machine learning with the aim of training classifiers
that can detect semiotic alignment in dialogue. This model is
in support of approaches which need to gain insights into realistic
human-machine communication.},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/mehler_luecking_2009.pdf},
website = {http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?reload=true&arnumber=5308098},
year = {2009}
}
2008
BibTeX
@inproceedings{Luecking:Mehler:Menke:2008,
author = {Lücking, Andy and Mehler, Alexander and Menke, Peter},
title = {Taking Fingerprints of Speech-and-Gesture Ensembles: Approaching
Empirical Evidence of Intrapersonal Alignment in Multimodal Communication},
booktitle = {LONDIAL 2008: Proceedings of the 12th Workshop on the Semantics
and Pragmatics of Dialogue (SEMDIAL)},
pages = {157–164},
address = {King's College London},
month = {June 2–4},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/luecking_mehler_menke_2008.pdf},
website = {https://www.researchgate.net/publication/237305375_Taking_Fingerprints_of_Speech-and-Gesture_Ensembles_Approaching_Empirical_Evidence_of_Intrapersonal_Alignment_in_Multimodal_Communication},
year = {2008}
}
2007
BibTeX
@article{Borr:Luecking:Hierlscher:2007,
author = {Borr, Christiane and Hielscher-Fastabend, Martina and Lücking, Andy},
title = {Reliability and Validity of Cervical Auscultation},
journal = {Dysphagia},
volume = {22},
pages = {225--234},
abstract = {We conducted a two-part study that contributes to the discussion
about cervical auscultation (CA) as a scientifically justifiable
and medically useful tool to identify patients with a high risk
of aspiration/penetration. We sought to determine (1) acoustic
features that mark a deglutition act as dysphagic; (2) acoustic
changes in healthy older deglutition profiles compared with those
of younger adults; (3) the correctness and concordance of rater
judgments based on CA; and (4) if education in CA improves individual
reliability. The first part of the study focused on a comparison
of the swallow morphology of dysphagic as opposed to healthy subjects
deglutition in terms of structure properties of the pharyngeal
phase of deglutition. We obtained the following results. The duration
of deglutition apnea is significantly higher in the older group
than in the younger one. Comparing the younger group and the dysphagic
group we found significant differences in duration of deglutition
apnea, onset time, and number of gulps. Just one parameter, number
of gulps, distinguishes significantly between the older and the
dysphagic groups. The second part of the study aimed at evaluating
the reliability of CA in detecting dysphagia measured as the concordance
and the correctness of CA experts in classifying swallowing sounds.
The interrater reliability coefficient AC1 resulted in a value
of 0.46, which is to be interpreted as fair agreement. Furthermore,
we found that comparison with radiologically defined aspiration/penetration
for the group of experts (speech and language therapists) yielded
70\% specificity and 94\% sensitivity. We conclude that the swallowing
sounds contain audible cues that should, in principle, permit
reliable classification and view CA as an early warning system
for identifying patients with a high risk of aspiration/penetration;
however, it is not appropriate as a stand-alone tool.},
doi = {10.1007/s00455-007-9078-3},
issue = {3},
pdf = {http://www.shkim.eu/cborr/ca5manuscript.pdf},
publisher = {Springer New York},
url = {http://dx.doi.org/10.1007/s00455-007-9078-3},
website = {http://www.springerlink.com/content/c45578u74r38m4v7/},
year = {2007}
}
BibTeX
@misc{Kranstedt:et:al:2007,
author = {Kranstedt, Alfred and Lücking, Andy and Pfeiffer, Thies and Rieser, Hannes
and Staudacher, Marc},
title = {Locating Objects by Pointing},
howpublished = {3rd International Conference of the International
Society for Gesture Studies. Evanston, IL, USA},
keywords = {own},
month = {6},
year = {2007}
}
2006
BibTeX
@inproceedings{Kranstedt:et:al:2006:c,
author = {Kranstedt, Alfred and Lücking, Andy and Pfeiffer, Thies and Rieser, Hannes
and Staudacher, Marc},
title = {Measuring and Reconstructing Pointing in Visual Contexts},
booktitle = {brandial '06 -- Proceedings of the 10th Workshop on the Semantics
and Pragmatics of Dialogue},
editor = {David Schlangen and Raquel Fernández},
pages = {82--89},
address = {Potsdam},
publisher = {Universit{\"a}tsverlag Potsdam},
abstract = {We describe an experiment to gather original data on geometrical
aspects of pointing. In particular, we are focusing upon the concept
of the pointing cone, a geometrical model of a pointing’s extension.
In our setting we employed methodological and technical procedures
of a new type to integrate data from annotations as well as from
tracker recordings. We combined exact information on position
and orientation with rater’s classifications. Our first results
seem to challenge classical linguistic and philosophical theories
of demonstration in that they advise to separate pointings from
reference.},
keywords = {own},
month = {9},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/measure.pdf},
website = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.8472},
year = {2006}
}
BibTeX
@inproceedings{Luecking:Rieser:Staudacher:2006:a,
author = {Lücking, Andy and Rieser, Hannes and Staudacher, Marc},
title = {Multi-modal Integration for Gesture and Speech},
booktitle = {brandial '06 -- Proceedings of the 10th Workshop on the Semantics
and Pragmatics of Dialogue},
editor = {David Schlangen and Raquel Fernández},
pages = {106--113},
address = {Potsdam},
publisher = {Universit{\"a}tsverlag Potsdam},
abstract = {Demonstratives, in particular gestures that 'only' accompany speech,
are not a big issue in current theories of grammar. If we deal
with gestures, fixing their function is one big problem, the other
one is how to integrate the representations originating from different
channels and, ultimately, how to determine their composite meanings.
The growing interest in multi-modal settings, computer simulations,
human-machine interfaces and VR-applications increases the need
for theories of multi-modal structures and events. In our workshop-contribution
we focus on the integration of multi-modal contents and investigate
different approaches dealing with this problem such as Johnston
et al. (1997) and Johnston (1998), Johnston and Bangalore (2000),
Chierchia (1995), Asher (2005), and Rieser (2005).},
keywords = {own},
month = {9},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/mm-int-brandial-final.pdf},
year = {2006}
}
BibTeX
@incollection{Kranstedt:et:al:2006:b,
author = {Kranstedt, Alfred and Lücking, Andy and Pfeiffer, Thies and Rieser, Hannes
and Wachsmuth, Ipke},
title = {Deictic Object Reference in Task-oriented Dialogue},
booktitle = {Situated Communication},
publisher = {De Gruyter Mouton},
editor = {Gert Rickheit and Ipke Wachsmuth},
pages = {155--207},
address = {Berlin},
abstract = {This chapter presents an original approach towards a detailed
understanding of the usage of pointing gestures accompanying referring
expressions. This effort is undertaken in the context of human-machine
interaction integrating empirical studies, theory of grammar and
logics, and simulation techniques. In particular, we take steps
to classify the role of pointing in deictic expressions and to
model the focussed area of pointing gestures, the so-called pointing
cone. This pointing cone serves as a central concept in a formal
account of multi-modal integration at the linguistic speech-gesture
interface as well as in a computational model of processing multi-modal
deictic expressions.},
keywords = {own},
website = {http://pub.uni-bielefeld.de/publication/1894485},
year = {2006}
}
BibTeX
@incollection{Kranstedt:et:al:2006:a,
author = {Kranstedt, Alfred and Lücking, Andy and Pfeiffer, Thies and Rieser, Hannes
and Wachsmuth, Ipke},
title = {Deixis: How to Determine Demonstrated Objects Using a Pointing Cone},
booktitle = {Gesture in Human-Computer Interaction and Simulation},
publisher = {Springer},
editor = {Sylvie Gibet and Nicolas Courty and Jean-Francois Kamp},
pages = {300--311},
address = {Berlin},
abstract = {We present a collaborative approach towards a detailed understanding
of the usage of pointing gestures accompanying referring expressions.
This effort is undertaken in the context of human-machine interaction
integrating empirical studies, theory of grammar and logics, and
simulation techniques. In particular, we attempt to measure the
precision of the focussed area of a pointing gesture, the so-called
pointing cone. The pointing cone serves as a central concept in
a formal account of multi-modal integration at the linguistic
speech-gesture interface as well as in a computational model of
processing multi-modal deictic expressions.},
anote = {6th International Gesture Workshop, Berder Island,
France, 2005, Revised Selected Papers},
keywords = {own},
website = {http://www.springerlink.com/content/712036hp5v2q8408/},
year = {2006}
}
BibTeX
@inproceedings{Pfeiffer:Kranstedt:Luecking:2006,
author = {Pfeiffer, Thies and Kranstedt, Alfred and Lücking, Andy},
title = {Sprach-Gestik Experimente mit IADE, dem Interactive Augmented Data Explorer},
booktitle = {Proceedings: Dritter Workshop Virtuelle und Erweiterte Realit{\"a}t
der GI-Fachgruppe VR/AR},
address = {Koblenz},
abstract = {Für die empirische Erforschung natürlicher menschlicher Kommunikation
sind wir auf die Akquise und Auswertung umfangreicher Daten angewiesen.
Die Modalit{\"a}ten, über die sich Menschen ausdrücken können,
sind sehr unterschiedlich - und genauso verschieden sind die Repr{\"a}sentationen,
mit denen sie für die Empirie verfügbar gemacht werden können.
Für eine Untersuchung des Zeigeverhaltens bei der Referenzierung
von Objekten haben wir mit IADE ein Framework für die Aufzeichnung,
Analyse und Resimulation von Sprach-Gestik Daten entwickelt. Mit
dessen Hilfe können wir für unsere Forschung entscheidende Fortschritte
in der linguistischen Experimentalmethodik machen.},
keywords = {own},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Pfeiffer-Kranstedt-Luecking-IADE.pdf},
website = {http://pub.uni-bielefeld.de/publication/2426853},
year = {2006}
}
BibTeX
@inproceedings{Luecking:Rieser:Stauchdacher:2006:b,
author = {Lücking, Andy and Rieser, Hannes and Staudacher, Marc},
title = {SDRT and Multi-modal Situated Communication},
booktitle = {brandial '06 -- Proceedings of the 10th Workshop on the Semantics
and Pragmatics of Dialogue},
editor = {David Schlangen and Raquel Fernández},
pages = {72--79},
publisher = {Universit{\"a}tsverlag Potsdam},
keywords = {own},
month = {9},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/sdrt-sitcomm-brandial-final.pdf},
year = {2006}
}
2005
BibTeX
@techreport{Luecking:Stegmann:2005,
author = {Andy L\"{u}cking and Jens Stegmann},
title = {Assessing Reliability on Annotations (2): Statistical Results
for the \textsc{DeiKon} Scheme},
institution = {SFB 360},
year = {2005},
number = {3},
address = {Universit\"{a}t Bielefeld},
url = {http://www.sfb360.uni-bielefeld.de/reports/2005/2005-03.html}
}
BibTeX
@techreport{Stegmann:Luecking:2005,
author = {Jens Stegmann and Andy L\"{u}cking},
title = {Assessing Reliability on Annotations (1): Theoretical Considerations},
institution = {SFB 360},
year = {2005},
number = {2},
address = {Universit\"{a}t Bielefeld},
url = {http://www.sfb360.uni-bielefeld.de/reports/2005/2005-02.html}
}
2004
BibTeX
@inproceedings{Luecking:Rieser:Stegmann:2004,
author = {Lücking, Andy and Rieser, Hannes and Stegmann, Jens},
title = {Statistical Support for the Study of Structures in Multi-Modal
Dialogue: Inter-Rater Agreement and Synchronization},
booktitle = {Catalog '04---Proceedings of the Eighth Workshop on the Semantics
and Pragmatics of Dialogue},
editor = {Jonathan Ginzburg and Enric Vallduví},
pages = {56--63},
address = {Barcelona},
organization = {Department of Translation and Philology, Universitat
Pompeu Fabra},
abstract = {We present a statistical approach to assess relations that hold
among speech and pointing gestures in and between turns in task-oriented
dialogue. The units quantified over are the time-stamps of the
XML-based annotation of the digital video data. It was found that,
on average, gesture strokes do not exceed, but are freely distributed
over the time span of their linguistic affiliates. Further, the
onset of the affiliate was observed to occur earlier than gesture
initiation. Moreover, we found that gestures do obey certain appropriateness
conditions and contribute semantic content ('gestures save words')
as well. Gestures also seem to play a functional role wrt dialogue
structure: There is evidence that gestures can contribute to the
bundle of features making up a turn-taking signal. Some statistical
results support a partitioning of the domain, which is also reflected
in certain rating difficulties. However, our evaluation of the
applied annotation scheme generally resulted in very good agreement},
keywords = {own},
pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/08-lucking-etal.pdf},
year = {2004}
}