Research

Possible questions in this regard include: Can HCI, health or ergonomic applications be used as experimental gesture study settings? Which computational methods enable big gesture data analysis? Are there already resources that can be used in this regard? What phenomena are studied in semantics and dialogue theory at all? Finally: how do gesture data analyses, digital human modelling applications and semantic/pragmatic gesture research combine methodologically?

The session cover, but is not limited to, topics such as the following:

– phenomena under discussion: past, present, future
– big gesture data
– creation and exploitation of multimodal corpora
– avatars as experimental setting
– cross-modal tracking
– data-based multimodal analysis
– detecting gestalts
– automatic annotation
– multimodal networks

We want to emphasize that conceptual contributions are highly welcome! By this we mean contributions that reflect on, or propose steps towards, the individual thematic priority with respect to “behavioromics”.

Last but not least, the conference session provides a platform for bringing together semanticists, computer scientists and researchers from related fields that deal with multimodal interaction. Since we all work on virtually the same topic but from different angles, there should be opportunities to get in touch: to see what others are doing and to approach some of the above-outlined, methodological challenges.

References for quotations:

Clark, Herbert H. and Adrian Bangerter (2004). “Changing Ideas about Reference.” In: Experimental Pragmatics. Ed. by Ira A. Noveck and Dan Sperber. Palgrave Studies in Pragmatics, Language and Cognition. Basingstoke and New York: Palgrave Macmillan. Chap. 2, pp. 25–49.

Goodwin, Charles (2003). “Pointing as Situated Practice.” In: Pointing: Where Language, Culture, and Cognition Meet. Ed. by Sotaro Kita. Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc. Chap. 2, pp. 217–241.