Giuseppe Abrami
M.Sc. Intelligent Systems
B.Sc. Computer Science
Scientific Assistant
Goethe-Universität Frankfurt am Main
Robert-Mayer-Straße 10
Room 402
D-60325 Frankfurt am Main
D-60054 Frankfurt am Main (use for package delivery)
Postfach / P.O. Box: 154
Phone: +49 69-798-28926
Fax: +49 69-798-28931
Follow me on ResearchGate
ContactAbout meInterestsShort CVProjectsPublications
I studied Computer Science at the University of Applied Sciences in Frankfurt (FH) from 2005 until 2009. In 2009 I joint the masters program, Intelligent Systems, again at the same University of Applied Sciences, and I completed this in September 2011.
From February 2012 to July 2019 I worked in the Text Technology Lab of the Goethe-University Frankfurt as a scientific staff member
Since July 2019 I have been working in the Text Technology Lab of the Goethe-University Frankfurt as scientific assistant.
Machine learning, especially neural networks and learning-classifier systems, artificial intelligence, graph theory, Semantic Web, data privacy, programming…
- 2005 – 2009
- University of Applied Sciences (FH), Frankfurt: Bachelor of Science in Computer Science
- 2009 – September 2011
- University of Applied Sciences (FH), Frankfurt: Master of Science in Intelligent Systems
- February 2012 – present
- Goethe University of Frankfurt, Institute of Informatics and Mathematics: PhD student and scientific staff member in the Text Technology Lab; since July 2019 scientific assistant.
Total: 45
2023 (5)
-
![[PDF]](https://www.texttechnologylab.org/wp-content/plugins/papercite/img/pdf.png)
![[https://doi.org/10.1145/3603163.3609079]](https://www.texttechnologylab.org/wp-content/plugins/papercite/img/external.png)
![[DOI]](https://www.texttechnologylab.org/wp-content/plugins/papercite/img/doi.png)
S. Babbili, K. Bönisch, Y. Heinrich, P. Stephan, G. Abrami, and A. Mehler, “Viki LibraRy: A Virtual Reality Library for Collaborative Browsing and Navigation through Hypertext,” in Proceedings of the 34th ACM Conference on Hypertext and Social Media, New York, NY, USA, 2023.
[Abstract] [BibTeX]We present Viki LibraRy, a virtual-reality-based system for generating and exploring online information as a spatial hypertext. It creates a virtual library based on Wikipedia in which Rooms are used to make data available via a RESTful backend. In these Rooms, users can browse through all articles of the corresponding Wikipedia category in the form of Books. In addition, users can access different Rooms, through virtual portals. Beyond that, the explorations can be done alone or collaboratively, using Ubiq.@inproceedings{Babbili:et:al:2023, author = {Babbili, Shaduan and B\"{o}nisch, Kevin and Heinrich, Yannick and Stephan, Philipp and Abrami, Giuseppe and Mehler, Alexander}, title = {Viki LibraRy: A Virtual Reality Library for Collaborative Browsing and Navigation through Hypertext}, year = {2023}, isbn = {9798400702327}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3603163.3609079}, doi = {10.1145/3603163.3609079}, abstract = {We present Viki LibraRy, a virtual-reality-based system for generating and exploring online information as a spatial hypertext. It creates a virtual library based on Wikipedia in which Rooms are used to make data available via a RESTful backend. In these Rooms, users can browse through all articles of the corresponding Wikipedia category in the form of Books. In addition, users can access different Rooms, through virtual portals. Beyond that, the explorations can be done alone or collaboratively, using Ubiq.}, booktitle = {Proceedings of the 34th ACM Conference on Hypertext and Social Media}, articleno = {6}, numpages = {3}, keywords = {virtual reality simulation, virtual reality, virtual hypertext, virtual museum}, location = {Rome, Italy}, series = {HT '23}, pdf = {https://dl.acm.org/doi/pdf/10.1145/3603163.3609079} } -
J. Gagel, J. Hustedt, T. Lüttig, T. Berg, G. Abrami, and A. Mehler, “News in Time and Space: Global Event Exploration in Virtual Reality,” in Proceedings of the 34th ACM Conference on Hypertext and Social Media, New York, NY, USA, 2023.
[Abstract] [BibTeX]We present News in Time and Space (NiTS), a virtual reality application for visualization, filtering and interaction with geo-referenced events based on GDELT. It can be used both via VR glasses and as a desktop solution for shared use by multiple users with Ubiq. The aim of NiTS is to provide overviews of global events and trends in order to create a resource for their monitoring and analysis.@inproceedings{Gagel:et:al:2023, author = {Gagel, Julian and Hustedt, Jasper and L\"{u}ttig, Timo and Berg, Theresa and Abrami, Giuseppe and Mehler, Alexander}, title = {News in Time and Space: Global Event Exploration in Virtual Reality}, year = {2023}, isbn = {9798400702327}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3603163.3609080}, doi = {10.1145/3603163.3609080}, abstract = {We present News in Time and Space (NiTS), a virtual reality application for visualization, filtering and interaction with geo-referenced events based on GDELT. It can be used both via VR glasses and as a desktop solution for shared use by multiple users with Ubiq. The aim of NiTS is to provide overviews of global events and trends in order to create a resource for their monitoring and analysis.}, booktitle = {Proceedings of the 34th ACM Conference on Hypertext and Social Media}, articleno = {7}, numpages = {3}, keywords = {virtual hypertext, human data interaction, spatial computing, virtual reality simulation, geographic information systems, virtual reality}, location = {Rome, Italy}, series = {HT '23}, pdf = {https://dl.acm.org/doi/pdf/10.1145/3603163.3609080} } -
G. Abrami, A. Mehler, M. Bagci, P. Schrottenbacher, A. Henlein, C. Spiekermann, J. Engel, and J. Schreiber, “Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in Virtual Reality and Its Potential Fields of Application,” in Proceedings of the 34th ACM Conference on Hypertext and Social Media, New York, NY, USA, 2023.
[Abstract] [BibTeX]During the last thirty years a variety of hypertext approaches and virtual environments -- some virtual hypertext environments -- have been developed and discussed. Although the development of virtual and augmented reality technologies is rapid and improving, and many technologies can be used at affordable conditions, their usability for hypertext systems has not yet been explored. At the same time, even for virtual three-dimensional virtual and augmented environments, there is no generally accepted concept that is similar or nearly as elegant as hypertext. This gap will have to be filled in the next years and a good concept should be developed; in this article we aim to contribute in this direction and also introduce a prototype for a possible implementation of criteria for virtual hypertext simulations.@inproceedings{Abrami:et:al:2023, author = {Abrami, Giuseppe and Mehler, Alexander and Bagci, Mevl\"{u}t and Schrottenbacher, Patrick and Henlein, Alexander and Spiekermann, Christian and Engel, Juliane and Schreiber, Jakob}, title = {Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in Virtual Reality and Its Potential Fields of Application}, year = {2023}, isbn = {9798400702327}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3603163.3609076}, doi = {10.1145/3603163.3609076}, abstract = {During the last thirty years a variety of hypertext approaches and virtual environments -- some virtual hypertext environments -- have been developed and discussed. Although the development of virtual and augmented reality technologies is rapid and improving, and many technologies can be used at affordable conditions, their usability for hypertext systems has not yet been explored. At the same time, even for virtual three-dimensional virtual and augmented environments, there is no generally accepted concept that is similar or nearly as elegant as hypertext. This gap will have to be filled in the next years and a good concept should be developed; in this article we aim to contribute in this direction and also introduce a prototype for a possible implementation of criteria for virtual hypertext simulations.}, booktitle = {Proceedings of the 34th ACM Conference on Hypertext and Social Media}, articleno = {22}, numpages = {9}, keywords = {virtual hypertext, virtual reality, virtual reality simulation, authoring system}, location = {Rome, Italy}, series = {HT '23}, pdf = {https://dl.acm.org/doi/pdf/10.1145/3603163.3609076} } -
A. Mehler, M. Bagci, A. Henlein, G. Abrami, C. Spiekermann, P. Schrottenbacher, M. Konca, A. Lücking, J. Engel, M. Quintino, J. Schreiber, K. Saukel, and O. Zlatkin-Troitschanskaia, “A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab,” in Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management, Cham, 2023, pp. 539-565.
[Abstract] [BibTeX]Simulation-based learning is a method in which learners learn to master real-life scenarios and tasks from simulated application contexts. It is particularly suitable for the use of VR technologies, as these allow immersive experiences of the targeted scenarios. VR methods are also relevant for studies on online learning, especially in groups, as they provide access to a variety of multimodal learning and interaction data. However, VR leads to a trade-off between technological conditions of the observability of such data and the openness of learner behavior. We present Va.Si.Li-Lab, a VR-L ab for Simulation-based Learn ing developed to address this trade-off. Va.Si.Li-Lab uses a graph-theoretical model based on hypergraphs to represent the data diversity of multimodal learning and interaction. We develop this data model in relation to mono- and multimodal, intra- and interpersonal data and interleave it with ISO-Space to describe distributed multiple documents from the perspective of their interactive generation. The paper adds three use cases to motivate the broad applicability of Va.Si.Li-Lab and its data model.@inproceedings{Mehler:et:al:2023:a, abstract = {Simulation-based learning is a method in which learners learn to master real-life scenarios and tasks from simulated application contexts. It is particularly suitable for the use of VR technologies, as these allow immersive experiences of the targeted scenarios. VR methods are also relevant for studies on online learning, especially in groups, as they provide access to a variety of multimodal learning and interaction data. However, VR leads to a trade-off between technological conditions of the observability of such data and the openness of learner behavior. We present Va.Si.Li-Lab, a VR-L ab for Simulation-based Learn ing developed to address this trade-off. Va.Si.Li-Lab uses a graph-theoretical model based on hypergraphs to represent the data diversity of multimodal learning and interaction. We develop this data model in relation to mono- and multimodal, intra- and interpersonal data and interleave it with ISO-Space to describe distributed multiple documents from the perspective of their interactive generation. The paper adds three use cases to motivate the broad applicability of Va.Si.Li-Lab and its data model.}, address = {Cham}, author = {Mehler, Alexander and Bagci, Mevl{\"u}t and Henlein, Alexander and Abrami, Giuseppe and Spiekermann, Christian and Schrottenbacher, Patrick and Konca, Maxim and L{\"u}cking, Andy and Engel, Juliane and Quintino, Marc and Schreiber, Jakob and Saukel, Kevin and Zlatkin-Troitschanskaia, Olga}, booktitle = {Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management}, editor = {Duffy, Vincent G.}, isbn = {978-3-031-35741-1}, pages = {539--565}, publisher = {Springer Nature Switzerland}, title = {A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab}, year = {2023} } -
A. Henlein, A. Kett, Baumartz Daniel, G. Abrami, A. Mehler, J. Bastian, Y. Blecher, D. Budgenhagen, R. Christof, T. Ewald, T. Fauerbach, P. Masny, J. Mende, P. Schnüre, and M. Viel, “Semantic Scene Builder: Towards a context sensitive Text-to-3D Scene Framework,” in Semantic, artificial and computational interaction studies: Towards a behavioromics of multimodal communication, Held as Part of the 25rd HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23– 28, 2023, Proceedings, 2023. accepted
[BibTeX]@inproceedings{Henlein:et:al:2023b, author = {Henlein, Alexander and Kett, Attila and Baumartz, Daniel, and Abrami, Giuseppe and Mehler, Alexander and Bastian, Johannes and Blecher, Yannic and Budgenhagen, David and Christof, Roman and Ewald, Tim-Oliver and Fauerbach, Tim and Masny, Patrick and Mende, Julian and Schn{\"u}re, Paul and Viel, Marc}, booktitle = {Semantic, artificial and computational interaction studies: Towards a behavioromics of multimodal communication, Held as Part of the 25rd HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23-- 28, 2023, Proceedings}, note = {accepted}, organization = {Springer}, title = {Semantic Scene Builder: Towards a context sensitive Text-to-3D Scene Framework}, year = {2023} }
2022 (2)
-
G. Abrami, M. Bagci, L. Hammerla, and A. Mehler, “German Parliamentary Corpus (GerParCor),” in Proceedings of the Language Resources and Evaluation Conference, Marseille, France, 2022, pp. 1900-1906.
[Abstract] [Poster][BibTeX]Parliamentary debates represent a large and partly unexploited treasure trove of publicly accessible texts. In the German-speaking area, there is a certain deficit of uniformly accessible and annotated corpora covering all German-speaking parliaments at the national and federal level. To address this gap, we introduce the German Parliamentary Corpus (GerParCor). GerParCor is a genre-specific corpus of (predominantly historical) German-language parliamentary protocols from three centuries and four countries, including state and federal level data. In addition, GerParCor contains conversions of scanned protocols and, in particular, of protocols in Fraktur converted via an OCR process based on Tesseract. All protocols were preprocessed by means of the NLP pipeline of spaCy3 and automatically annotated with metadata regarding their session date. GerParCor is made available in the XMI format of the UIMA project. In this way, GerParCor can be used as a large corpus of historical texts in the field of political communication for various tasks in NLP.@InProceedings{Abrami:Bagci:Hammerla:Mehler:2022, author = {Abrami, Giuseppe and Bagci, Mevlüt and Hammerla, Leon and Mehler, Alexander}, title = {German Parliamentary Corpus (GerParCor)}, booktitle = {Proceedings of the Language Resources and Evaluation Conference}, month = {June}, year = {2022}, address = {Marseille, France}, publisher = {European Language Resources Association}, pages = {1900--1906}, abstract = {Parliamentary debates represent a large and partly unexploited treasure trove of publicly accessible texts. In the German-speaking area, there is a certain deficit of uniformly accessible and annotated corpora covering all German-speaking parliaments at the national and federal level. To address this gap, we introduce the German Parliamentary Corpus (GerParCor). GerParCor is a genre-specific corpus of (predominantly historical) German-language parliamentary protocols from three centuries and four countries, including state and federal level data. In addition, GerParCor contains conversions of scanned protocols and, in particular, of protocols in Fraktur converted via an OCR process based on Tesseract. All protocols were preprocessed by means of the NLP pipeline of spaCy3 and automatically annotated with metadata regarding their session date. GerParCor is made available in the XMI format of the UIMA project. In this way, GerParCor can be used as a large corpus of historical texts in the field of political communication for various tasks in NLP.}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2022/06/GerParCor_LREC_2022.pdf}, pdf = {http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.202.pdf} } -
A. Lücking, M. Stoeckel, G. Abrami, and A. Mehler, “I still have Time(s): Extending HeidelTime for German Texts,” in Proceedings of the Language Resources and Evaluation Conference, Marseille, France, 2022, pp. 4723-4728.
[Abstract] [Poster][BibTeX]HeidelTime is one of the most widespread and successful tools for detecting temporal expressions in texts. Since HeidelTime’s pattern matching system is based on regular expression, it can be extended in a convenient way. We present such an extension for the German resources of HeidelTime: HeidelTimeExt. The extension has been brought about by means of observing false negatives within real world texts and various time banks. The gain in coverage is 2.7 \% or 8.5 \%, depending on the admitted degree of potential overgeneralization. We describe the development of HeidelTimeExt, its evaluation on text samples from various genres, and share some linguistic observations. HeidelTimeExt can be obtained from https://github.com/texttechnologylab/heideltime.@InProceedings{Luecking:Stoeckel:Abrami:Mehler:2022, Author = {L\"{u}cking, Andy and Stoeckel, Manuel and Abrami, Giuseppe and Mehler, Alexander}, title = {I still have Time(s): Extending HeidelTime for German Texts}, booktitle = {Proceedings of the Language Resources and Evaluation Conference}, month = {June}, year = {2022}, address = {Marseille, France}, publisher = {European Language Resources Association}, pages = {4723--4728}, abstract = {HeidelTime is one of the most widespread and successful tools for detecting temporal expressions in texts. Since HeidelTime’s pattern matching system is based on regular expression, it can be extended in a convenient way. We present such an extension for the German resources of HeidelTime: HeidelTimeExt. The extension has been brought about by means of observing false negatives within real world texts and various time banks. The gain in coverage is 2.7 \% or 8.5 \%, depending on the admitted degree of potential overgeneralization. We describe the development of HeidelTimeExt, its evaluation on text samples from various genres, and share some linguistic observations. HeidelTimeExt can be obtained from https://github.com/texttechnologylab/heideltime.}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2022/06/HeidelTimeExt_LREC_2022.pdf}, pdf = {http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.505.pdf} }
2021 (5)
-
A. Henlein, G. Abrami, A. Kett, C. Spiekermann, and A. Mehler, “Digital Learning, Teaching and Collaboration in an Era of ubiquitous Quarantine,” in Remote Learning in Times of Pandemic – Issues, Implications and Best Practice, L. Daniela and A. Visvizin, Eds., Thames, Oxfordshire, England, UK: Routledge, 2021.
[BibTeX]@incollection{Henlein:et:al:2021, author = {Alexander Henlein and Giuseppe Abrami and Attila Kett and Christian Spiekermann and Alexander Mehler}, title = {Digital Learning, Teaching and Collaboration in an Era of ubiquitous Quarantine}, editor = "Linda Daniela and Anna Visvizin", booktitle = "Remote Learning in Times of Pandemic - Issues, Implications and Best Practice", publisher = "Routledge", address = "Thames, Oxfordshire, England, UK", year = 2021, chapter = 3 } -
A. Lücking, C. Driller, M. Stoeckel, G. Abrami, A. Pachzelt, and A. Mehler, “Multiple Annotation for Biodiversity: Developing an annotation framework among biology, linguistics and text technology,” Language Resources and Evaluation, 2021.
[BibTeX]@Article{Luecking:et:al:2021, author = {Andy Lücking and Christine Driller and Manuel Stoeckel and Giuseppe Abrami and Adrian Pachzelt and Alexander Mehler}, year = {2021}, journal = {Language Resources and Evaluation}, title = {Multiple Annotation for Biodiversity: Developing an annotation framework among biology, linguistics and text technology}, editor = {Nancy Ide and Nicoletta Calzolari}, doi = {10.1007/s10579-021-09553-5}, pdf = {https://link.springer.com/content/pdf/10.1007/s10579-021-09553-5.pdf} } -
P. Fischer, A. Smajic, G. Abrami, and A. Mehler, “Multi-Type-TD-TSR – Extracting Tables from Document Images using a Multi-stage Pipeline for Table Detection and Table Structure Recognition: from OCR to Structured Table Representations,” in Proceedings of the 44th German Conference on Artificial Intelligence, 2021.
[BibTeX]@InProceedings{Fischer:et:al:2021, Author = {Fischer, Pascal and Smajic, Alen and Abrami, Giuseppe and Mehler, Alexander}, Title = {Multi-Type-TD-TSR - Extracting Tables from Document Images using a Multi-stage Pipeline for Table Detection and Table Structure Recognition: from OCR to Structured Table Representations}, BookTitle = {Proceedings of the 44th German Conference on Artificial Intelligence}, Series = {KI2021}, location = {Berlin, Germany}, year = {2021}, url = {https://www.springerprofessional.de/multi-type-td-tsr-extracting-tables-from-document-images-using-a/19711570}, pdf = {https://arxiv.org/pdf/2105.11021.pdf} } -
G. Abrami, A. Henlein, A. Lücking, A. Kett, P. Adeberg, and A. Mehler, “Unleashing annotations with TextAnnotator: Multimedia, multi-perspective document views for ubiquitous annotation,” in Proceedings of the Seventeenth Joint ACL – ISO Workshop on Interoperable Semantic Annotation (ISA-17), 2021.
[BibTeX]@InProceedings{Abrami:et:al:2021, Author = {Abrami, Giuseppe and Henlein, Alexander and Lücking, Andy and Kett, Attila and Adeberg, Pascal and Mehler, Alexander}, Title = {Unleashing annotations with {TextAnnotator}: Multimedia, multi-perspective document views for ubiquitous annotation}, BookTitle = {Proceedings of the Seventeenth Joint ACL - ISO Workshop on Interoperable Semantic Annotation (ISA-17)}, Series = {ISA-17}, location = {Groningen, Netherlands}, month = {June}, year = {2021}, pdf = {https://iwcs2021.github.io/proceedings/isa/pdf/2021.isa-1.7.pdf} } -
A. Lücking, S. Brückner, G. Abrami, T. Uslu, and A. Mehler, “Computational linguistic assessment of textbooks and online texts by means of threshold concepts in economics,” Frontiers in Education, 2021.
[BibTeX]@article{Luecking:Brueckner:Abrami:Uslu:Mehler:2021, journal = {Frontiers in Education}, doi = {10.3389/feduc.2020.578475}, title = {Computational linguistic assessment of textbooks and online texts by means of threshold concepts in economics}, author = {L{\"u}cking, Andy and Br{\"u}ckner, Sebastian and Abrami, Giuseppe and Uslu, Tolga and Mehler, Alexander}, eid = {578475}, url = {https://www.frontiersin.org/articles/10.3389/feduc.2020.578475/}, year = {2021} }
2020 (9)
-
A. Lücking, S. Brückner, G. Abrami, T. Uslu, and A. Mehler, “Computational linguistic assessment of textbook and online learning media by means of threshold concepts in business education,” CoRR, vol. abs/2008.02096, 2020.
[BibTeX]@article{Luecking:et:al:2020, author = {Andy L{\"{u}}cking and Sebastian Br{\"{u}}ckner and Giuseppe Abrami and Tolga Uslu and Alexander Mehler}, title = {Computational linguistic assessment of textbook and online learning media by means of threshold concepts in business education}, journal = {CoRR}, volume = {abs/2008.02096}, year = {2020}, url = {https://arxiv.org/abs/2008.02096}, archivePrefix = {arXiv}, eprint = {2008.02096}, timestamp = {Fri, 07 Aug 2020 15:07:21 +0200}, biburl = {https://dblp.org/rec/journals/corr/abs-2008-02096.bib}, bibsource = {dblp computer science bibliography, https://dblp.org} } -
C. Driller, M. Koch, G. Abrami, W. Hemati, A. Lücking, A. Mehler, A. Pachzelt, and G. Kasperek, “Fast and Easy Access to Central European Biodiversity Data with BIOfid,” Biodiversity Information Science and Standards, vol. 4, p. e59157, 2020.
[Abstract] [BibTeX]The storage of data in public repositories such as the Global Biodiversity Information Facility (GBIF) or the National Center for Biotechnology Information (NCBI) is nowadays stipulated in the policies of many publishers in order to facilitate data replication or proliferation. Species occurrence records contained in legacy printed literature are no exception to this. The extent of their digital and machine-readable availability, however, is still far from matching the existing data volume (Thessen and Parr 2014). But precisely these data are becoming more and more relevant to the investigation of ongoing loss of biodiversity. In order to extract species occurrence records at a larger scale from available publications, one has to apply specialised text mining tools. However, such tools are in short supply especially for scientific literature in the German language.The Specialised Information Service Biodiversity Research*1 BIOfid (Koch et al. 2017) aims at reducing this desideratum, inter alia, by preparing a searchable text corpus semantically enriched by a new kind of multi-label annotation. For this purpose, we feed manual annotations into automatic, machine-learning annotators. This mixture of automatic and manual methods is needed, because BIOfid approaches a new application area with respect to language (mainly German of the 19th century), text type (biological reports), and linguistic focus (technical and everyday language).We will present current results of the performance of BIOfid’s semantic search engine and the application of independent natural language processing (NLP) tools. Most of these are freely available online, such as TextImager (Hemati et al. 2016). We will show how TextImager is tied into the BIOfid pipeline and how it is made scalable (e.g. extendible by further modules) and usable on different systems (docker containers).Further, we will provide a short introduction to generating machine-learning training data using TextAnnotator (Abrami et al. 2019) for multi-label annotation. Annotation reproducibility can be assessed by the implementation of inter-annotator agreement methods (Abrami et al. 2020). Beyond taxon recognition and entity linking, we place particular emphasis on location and time information. For this purpose, our annotation tag-set combines general categories and biology-specific categories (including taxonomic names) with location and time ontologies. The application of the annotation categories is regimented by annotation guidelines (Lücking et al. 2020). Within the next years, our work deliverable will be a semantically accessible and data-extractable text corpus of around two million pages. In this way, BIOfid is creating a new valuable resource that expands our knowledge of biodiversity and its determinants.@article{Driller:et:al:2020, author = {Christine Driller and Markus Koch and Giuseppe Abrami and Wahed Hemati and Andy Lücking and Alexander Mehler and Adrian Pachzelt and Gerwin Kasperek}, title = {Fast and Easy Access to Central European Biodiversity Data with BIOfid}, volume = {4}, number = {}, year = {2020}, doi = {10.3897/biss.4.59157}, publisher = {Pensoft Publishers}, abstract = {The storage of data in public repositories such as the Global Biodiversity Information Facility (GBIF) or the National Center for Biotechnology Information (NCBI) is nowadays stipulated in the policies of many publishers in order to facilitate data replication or proliferation. Species occurrence records contained in legacy printed literature are no exception to this. The extent of their digital and machine-readable availability, however, is still far from matching the existing data volume (Thessen and Parr 2014). But precisely these data are becoming more and more relevant to the investigation of ongoing loss of biodiversity. In order to extract species occurrence records at a larger scale from available publications, one has to apply specialised text mining tools. However, such tools are in short supply especially for scientific literature in the German language.The Specialised Information Service Biodiversity Research*1 BIOfid (Koch et al. 2017) aims at reducing this desideratum, inter alia, by preparing a searchable text corpus semantically enriched by a new kind of multi-label annotation. For this purpose, we feed manual annotations into automatic, machine-learning annotators. This mixture of automatic and manual methods is needed, because BIOfid approaches a new application area with respect to language (mainly German of the 19th century), text type (biological reports), and linguistic focus (technical and everyday language).We will present current results of the performance of BIOfid’s semantic search engine and the application of independent natural language processing (NLP) tools. Most of these are freely available online, such as TextImager (Hemati et al. 2016). We will show how TextImager is tied into the BIOfid pipeline and how it is made scalable (e.g. extendible by further modules) and usable on different systems (docker containers).Further, we will provide a short introduction to generating machine-learning training data using TextAnnotator (Abrami et al. 2019) for multi-label annotation. Annotation reproducibility can be assessed by the implementation of inter-annotator agreement methods (Abrami et al. 2020). Beyond taxon recognition and entity linking, we place particular emphasis on location and time information. For this purpose, our annotation tag-set combines general categories and biology-specific categories (including taxonomic names) with location and time ontologies. The application of the annotation categories is regimented by annotation guidelines (Lücking et al. 2020). Within the next years, our work deliverable will be a semantically accessible and data-extractable text corpus of around two million pages. In this way, BIOfid is creating a new valuable resource that expands our knowledge of biodiversity and its determinants.}, issn = {}, pages = {e59157}, URL = {https://doi.org/10.3897/biss.4.59157}, eprint = {https://doi.org/10.3897/biss.4.59157}, journal = {Biodiversity Information Science and Standards} } -
G. Abrami, A. Mehler, and M. Stoeckel, “TextAnnotator: A web-based annotation suite for texts,” in Proceedings of the Digital Humanities 2020, 2020.
[Abstract] [Poster][BibTeX]The TextAnnotator is a tool for simultaneous and collaborative annotation of texts with visual annotation support, integration of knowledge bases and, by pipelining the TextImager, a rich variety of pre-processing and automatic annotation tools. It includes a variety of modules for the annotation of texts, which contains the annotation of argumentative, rhetorical, propositional and temporal structures as well as a module for named entity linking and rapid annotation of named entities. Especially the modules for annotation of temporal, argumentative and propositional structures are currently unique in web-based annotation tools. The TextAnnotator, which allows the annotation of texts as a platform, is divided into a front- and a backend component. The backend is a web service based on WebSockets, which integrates the UIMA Database Interface to manage and use texts. Texts are made accessible by using the ResourceManager and the AuthorityManager, based on user and group access permissions. Different views of a document can be created and used depending on the scenario. Once a document has been opened, access is gained to the annotations stored within annotation views in which these are organized. Any annotation view can be assigned with access permissions and by default, each user obtains his or her own user view for every annotated document. In addition, with sufficient access permissions, all annotation views can also be used and curated. This allows the possibility to calculate an Inter-Annotator-Agreement for a document, which shows an agreement between the annotators. Annotators without sufficient rights cannot display this value so that the annotators do not influence each other. This contribution is intended to reflect the current state of development of TextAnnotator, demonstrate the possibilities of an instantaneous Inter-Annotator-Agreement and trigger a discussion about further functions for the community.@InProceedings{Abrami:Mehler:Stoeckel:2020, author = {Abrami, Giuseppe and Mehler, Alexander and Stoeckel, Manuel}, title = {{TextAnnotator}: A web-based annotation suite for texts}, booktitle = {Proceedings of the Digital Humanities 2020}, series = {DH 2020}, location = {Ottawa, Canada}, year = {2020}, url = {https://dh2020.adho.org/wp-content/uploads/2020/07/547_TextAnnotatorAwebbasedannotationsuitefortexts.html}, doi = {http://dx.doi.org/10.17613/tenm-4907}, abstract = {The TextAnnotator is a tool for simultaneous and collaborative annotation of texts with visual annotation support, integration of knowledge bases and, by pipelining the TextImager, a rich variety of pre-processing and automatic annotation tools. It includes a variety of modules for the annotation of texts, which contains the annotation of argumentative, rhetorical, propositional and temporal structures as well as a module for named entity linking and rapid annotation of named entities. Especially the modules for annotation of temporal, argumentative and propositional structures are currently unique in web-based annotation tools. The TextAnnotator, which allows the annotation of texts as a platform, is divided into a front- and a backend component. The backend is a web service based on WebSockets, which integrates the UIMA Database Interface to manage and use texts. Texts are made accessible by using the ResourceManager and the AuthorityManager, based on user and group access permissions. Different views of a document can be created and used depending on the scenario. Once a document has been opened, access is gained to the annotations stored within annotation views in which these are organized. Any annotation view can be assigned with access permissions and by default, each user obtains his or her own user view for every annotated document. In addition, with sufficient access permissions, all annotation views can also be used and curated. This allows the possibility to calculate an Inter-Annotator-Agreement for a document, which shows an agreement between the annotators. Annotators without sufficient rights cannot display this value so that the annotators do not influence each other. This contribution is intended to reflect the current state of development of TextAnnotator, demonstrate the possibilities of an instantaneous Inter-Annotator-Agreement and trigger a discussion about further functions for the community.}, poster = {https://hcommons.org/deposits/download/hc:31816/CONTENT/dh2020_textannotator_poster.pdf} } -
G. Abrami, M. Stoeckel, and A. Mehler, “TextAnnotator: A UIMA Based Tool for the Simultaneous and Collaborative Annotation of Texts,” in Proceedings of The 12th Language Resources and Evaluation Conference, Marseille, France, 2020, pp. 891-900.
[Abstract] [BibTeX]The annotation of texts and other material in the field of digital humanities and Natural Language Processing (NLP) is a common task of research projects. At the same time, the annotation of corpora is certainly the most time- and cost-intensive component in research projects and often requires a high level of expertise according to the research interest. However, for the annotation of texts, a wide range of tools is available, both for automatic and manual annotation. Since the automatic pre-processing methods are not error-free and there is an increasing demand for the generation of training data, also with regard to machine learning, suitable annotation tools are required. This paper defines criteria of flexibility and efficiency of complex annotations for the assessment of existing annotation tools. To extend this list of tools, the paper describes TextAnnotator, a browser-based, multi-annotation system, which has been developed to perform platform-independent multimodal annotations and annotate complex textual structures. The paper illustrates the current state of development of TextAnnotator and demonstrates its ability to evaluate annotation quality (inter-annotator agreement) at runtime. In addition, it will be shown how annotations of different users can be performed simultaneously and collaboratively on the same document from different platforms using UIMA as the basis for annotation.@InProceedings{Abrami:Stoeckel:Mehler:2020, author = {Abrami, Giuseppe and Stoeckel, Manuel and Mehler, Alexander}, title = {TextAnnotator: A UIMA Based Tool for the Simultaneous and Collaborative Annotation of Texts}, booktitle = {Proceedings of The 12th Language Resources and Evaluation Conference}, month = {May}, year = {2020}, address = {Marseille, France}, publisher = {European Language Resources Association}, pages = {891--900}, ISBN = "979-10-95546-34-4", abstract = {The annotation of texts and other material in the field of digital humanities and Natural Language Processing (NLP) is a common task of research projects. At the same time, the annotation of corpora is certainly the most time- and cost-intensive component in research projects and often requires a high level of expertise according to the research interest. However, for the annotation of texts, a wide range of tools is available, both for automatic and manual annotation. Since the automatic pre-processing methods are not error-free and there is an increasing demand for the generation of training data, also with regard to machine learning, suitable annotation tools are required. This paper defines criteria of flexibility and efficiency of complex annotations for the assessment of existing annotation tools. To extend this list of tools, the paper describes TextAnnotator, a browser-based, multi-annotation system, which has been developed to perform platform-independent multimodal annotations and annotate complex textual structures. The paper illustrates the current state of development of TextAnnotator and demonstrates its ability to evaluate annotation quality (inter-annotator agreement) at runtime. In addition, it will be shown how annotations of different users can be performed simultaneously and collaboratively on the same document from different platforms using UIMA as the basis for annotation.}, url = {https://www.aclweb.org/anthology/2020.lrec-1.112}, pdf = {http://www.lrec-conf.org/proceedings/lrec2020/pdf/2020.lrec-1.112.pdf} } -
G. Abrami, A. Henlein, A. Kett, and A. Mehler, “Text2SceneVR: Generating Hypertexts with VAnnotatoR as a Pre-processing Step for Text2Scene Systems,” in Proceedings of the 31st ACM Conference on Hypertext and Social Media, New York, NY, USA, 2020, p. 177–186.
[BibTeX]@InProceedings{Abrami:Henlein:Kett:Mehler:2020, author = {Abrami, Giuseppe and Henlein, Alexander and Kett, Attila and Mehler, Alexander}, title = {{Text2SceneVR}: Generating Hypertexts with VAnnotatoR as a Pre-processing Step for Text2Scene Systems}, booktitle = {Proceedings of the 31st ACM Conference on Hypertext and Social Media}, series = {HT ’20}, year = {2020}, location = {Virtual Event, USA}, isbn = {9781450370981}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3372923.3404791}, doi = {10.1145/3372923.3404791}, pages = {177–186}, numpages = {10}, pdf={https://dl.acm.org/doi/pdf/10.1145/3372923.3404791} } -
A. Mehler, B. Jussen, T. Geelhaar, A. Henlein, G. Abrami, D. Baumartz, T. Uslu, and W. Hemati, “The Frankfurt Latin Lexicon. From Morphological Expansion and Word Embeddings to SemioGraphs,” Studi e Saggi Linguistici, vol. 58, iss. 1, pp. 121-155, 2020.
[Abstract] [BibTeX]In this article we present the Frankfurt Latin Lexicon (FLL), a lexical resource for Medieval Latin that is used both for the lemmatization of Latin texts and for the post-editing of lemmatizations. We describe recent advances in the development of lemmatizers and test them against the Capitularies corpus (comprising Frankish royal edicts, mid-6th to mid-9th century), a corpus created as a reference for processing Medieval Latin. We also consider the post-correction of lemmatizations using a limited crowdsourcing process aimed at continuous review and updating of the FLL. Starting from the texts resulting from this lemmatization process, we describe the extension of the FLL by means of word embeddings, whose interactive traversing by means of SemioGraphs completes the digital enhanced hermeneutic circle. In this way, the article argues for a more comprehensive understanding of lemmatization, encompassing classical machine learning as well as intellectual post-corrections and, in particular, human computation in the form of interpretation processes based on graph representations of the underlying lexical resources.@article{Mehler:et:al:2020b, author={Mehler, Alexander and Jussen, Bernhard and Geelhaar, Tim and Henlein, Alexander and Abrami, Giuseppe and Baumartz, Daniel and Uslu, Tolga and Hemati, Wahed}, title={{The Frankfurt Latin Lexicon. From Morphological Expansion and Word Embeddings to SemioGraphs}}, journal={Studi e Saggi Linguistici}, doi={10.4454/ssl.v58i1.276}, year={2020}, volume={58}, number={1}, pages={121--155}, abstract={In this article we present the Frankfurt Latin Lexicon (FLL), a lexical resource for Medieval Latin that is used both for the lemmatization of Latin texts and for the post-editing of lemmatizations. We describe recent advances in the development of lemmatizers and test them against the Capitularies corpus (comprising Frankish royal edicts, mid-6th to mid-9th century), a corpus created as a reference for processing Medieval Latin. We also consider the post-correction of lemmatizations using a limited crowdsourcing process aimed at continuous review and updating of the FLL. Starting from the texts resulting from this lemmatization process, we describe the extension of the FLL by means of word embeddings, whose interactive traversing by means of SemioGraphs completes the digital enhanced hermeneutic circle. In this way, the article argues for a more comprehensive understanding of lemmatization, encompassing classical machine learning as well as intellectual post-corrections and, in particular, human computation in the form of interpretation processes based on graph representations of the underlying lexical resources.}, url={https://www.studiesaggilinguistici.it/index.php/ssl/article/view/276}, pdf={https://www.studiesaggilinguistici.it/index.php/ssl/article/download/276/219} } -
A. Henlein, G. Abrami, A. Kett, and A. Mehler, “Transfer of ISOSpace into a 3D Environment for Annotations and Applications,” in Proceedings of the 16th Joint ACL – ISO Workshop on Interoperable Semantic Annotation, Marseille, 2020, pp. 32-35.
[Abstract] [BibTeX]People's visual perception is very pronounced and therefore it is usually no problem for them to describe the space around them in words. Conversely, people also have no problems imagining a concept of a described space. In recent years many efforts have been made to develop a linguistic concept for spatial and spatial-temporal relations. However, the systems have not really caught on so far, which in our opinion is due to the complex models on which they are based and the lack of available training data and automated taggers. In this paper we describe a project to support spatial annotation, which could facilitate annotation by its many functions, but also enrich it with many more information. This is to be achieved by an extension by means of a VR environment, with which spatial relations can be better visualized and connected with real objects. And we want to use the available data to develop a new state-of-the-art tagger and thus lay the foundation for future systems such as improved text understanding for Text2Scene.@InProceedings{Henlein:et:al:2020, Author = {Henlein, Alexander and Abrami, Giuseppe and Kett, Attila and Mehler, Alexander}, Title = {Transfer of ISOSpace into a 3D Environment for Annotations and Applications}, booktitle = {Proceedings of the 16th Joint ACL - ISO Workshop on Interoperable Semantic Annotation}, month = {May}, year = {2020}, address = {Marseille}, publisher = {European Language Resources Association}, pages = {32--35}, abstract = {People's visual perception is very pronounced and therefore it is usually no problem for them to describe the space around them in words. Conversely, people also have no problems imagining a concept of a described space. In recent years many efforts have been made to develop a linguistic concept for spatial and spatial-temporal relations. However, the systems have not really caught on so far, which in our opinion is due to the complex models on which they are based and the lack of available training data and automated taggers. In this paper we describe a project to support spatial annotation, which could facilitate annotation by its many functions, but also enrich it with many more information. This is to be achieved by an extension by means of a VR environment, with which spatial relations can be better visualized and connected with real objects. And we want to use the available data to develop a new state-of-the-art tagger and thus lay the foundation for future systems such as improved text understanding for Text2Scene.}, url = {https://www.aclweb.org/anthology/2020.isa-1.4}, pdf = {http://www.lrec-conf.org/proceedings/lrec2020/workshops/ISA16/pdf/2020.isa-1.4.pdf} } -
V. Kühn, G. Abrami, and A. Mehler, “WikNectVR: A Gesture-Based Approach for Interacting in Virtual Reality Based on WikNect and Gestural Writing,” in Virtual, Augmented and Mixed Reality. Design and Interaction – 12th International Conference, VAMR 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19-24, 2020, Proceedings, Part I, 2020, pp. 299-312.
[BibTeX]@inproceedings{Kuehn:Abrami:Mehler:2020, author = {Vincent K{\"{u}}hn and Giuseppe Abrami and Alexander Mehler}, editor = {Jessie Y. C. Chen and Gino Fragomeni}, title = {WikNectVR: {A} Gesture-Based Approach for Interacting in Virtual Reality Based on WikNect and Gestural Writing}, booktitle = {Virtual, Augmented and Mixed Reality. Design and Interaction - 12th International Conference, {VAMR} 2020, Held as Part of the 22nd {HCI} International Conference, {HCII} 2020, Copenhagen, Denmark, July 19-24, 2020, Proceedings, Part {I}}, series = {Lecture Notes in Computer Science}, volume = {12190}, pages = {299--312}, publisher = {Springer}, year = {2020}, url = {https://doi.org/10.1007/978-3-030-49695-1_20}, doi = {10.1007/978-3-030-49695-1_20}, timestamp = {Tue, 14 Jul 2020 10:55:57 +0200}, biburl = {https://dblp.org/rec/conf/hci/KuhnAM20.bib}, bibsource = {dblp computer science bibliography, https://dblp.org} } -
G. Abrami, A. Mehler, C. Spiekermann, A. Kett, S. Lööck, and L. Schwarz, “Educational Technologies in the area of ubiquitous historical computing in virtual reality,” in New Perspectives on Virtual and Augmented Reality: Finding New Ways to Teach in a Transformed Learning Environment, L. Daniela, Ed., Taylor & Francis, 2020.
[Abstract] [BibTeX]At ever shorter intervals, new technologies are being developed that are opening up more and more areas of application. This regards, for example, Virtual Reality (VR) and Augmented Reality (AR) devices. In addition to the private sector, the public and education sectors, which already make intensive use of these devices, benefit from these technologies. However, especially in the field of historical education, there are not many frameworks for generating immersive virtual environments that can be used flexibly enough. This chapter addresses this gap by means of VAnnotatoR. VAnnotatoR is a versatile framework for the creation and use of virtual environments that serve to model historical processes in historical education. The paper describes the building blocks of VAnnotatoR and describes applications in historical education.@InBook{Abrami:et:al:2020, author="Abrami, Giuseppe and Mehler, Alexander and Spiekermann, Christian and Kett, Attila and L{\"o}{\"o}ck, Simon and Schwarz, Lukas", editor="Daniela, Linda", title="Educational Technologies in the area of ubiquitous historical computing in virtual reality", bookTitle="New Perspectives on Virtual and Augmented Reality: Finding New Ways to Teach in a Transformed Learning Environment", year="2020", publisher="Taylor \& Francis", abstract="At ever shorter intervals, new technologies are being developed that are opening up more and more areas of application. This regards, for example, Virtual Reality (VR) and Augmented Reality (AR) devices. In addition to the private sector, the public and education sectors, which already make intensive use of these devices, benefit from these technologies. However, especially in the field of historical education, there are not many frameworks for generating immersive virtual environments that can be used flexibly enough. This chapter addresses this gap by means of VAnnotatoR. VAnnotatoR is a versatile framework for the creation and use of virtual environments that serve to model historical processes in historical education. The paper describes the building blocks of VAnnotatoR and describes applications in historical education.", isbn={978-0-367-43211-9}, url={https://www.routledge.com/New-Perspectives-on-Virtual-and-Augmented-Reality-Finding-New-Ways-to-Teach/Daniela/p/book/9780367432119} }
2019 (5)
-
A. Mehler and G. Abrami, “VAnnotatoR: A framework for the multimodal reconstruction of historical situations and spaces,” in Proceedings of the Time Machine Conference, Dresden, Germany, October 10-11 2019.
[Poster][BibTeX]@inproceedings{Mehler:Abrami:2019, author = {Mehler, Alexander and Abrami, Giuseppe}, title = {{VAnnotatoR}: A framework for the multimodal reconstruction of historical situations and spaces}, booktitle = {Proceedings of the Time Machine Conference}, year = {2019}, date = {October 10-11}, address = {Dresden, Germany}, poster={https://www.texttechnologylab.org/wp-content/uploads/2019/09/TimeMachineConference.pdf} } -
G. Abrami, A. Mehler, A. Lücking, E. Rieb, and P. Helfrich, “TextAnnotator: A flexible framework for semantic annotations,” in Proceedings of the Fifteenth Joint ACL – ISO Workshop on Interoperable Semantic Annotation, (ISA-15), 2019.
[Abstract] [BibTeX]Modern annotation tools should meet at least the following general requirements: they can handle diverse data and annotation levels within one tool, and they support the annotation process with automatic (pre-)processing outcomes as much as possible. We developed a framework that meets these general requirements and that enables versatile and browser-based annotations of texts, the TextAnnotator. It combines NLP methods of pre-processing with methods of flexible post-processing. Infact, machine learning (ML) requires a lot of training and test data, but is usually far from achieving perfect results. Producing high-level annotations for ML and post-correcting its results are therefore necessary. This is the purpose of TextAnnotator, which is entirely implemented in ExtJS and provides a range of interactive visualizations of annotations. In addition, it allows for flexibly integrating knowledge resources, e.g. in the course of post-processing named entity recognition. The paper describes TextAnnotator’s architecture together with three use cases: annotating temporal structures, argument structures and named entity linking.@InProceedings{Abrami:et:al:2019, Author = {Abrami, Giuseppe and Mehler, Alexander and Lücking, Andy and Rieb, Elias and Helfrich, Philipp}, Title = {{TextAnnotator}: A flexible framework for semantic annotations}, BookTitle = {Proceedings of the Fifteenth Joint ACL - ISO Workshop on Interoperable Semantic Annotation, (ISA-15)}, Series = {ISA-15}, location = {Gothenburg, Sweden}, month = {May}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/TextAnnotator_IWCS_Göteborg.pdf}, year = 2019, abstract ="Modern annotation tools should meet at least the following general requirements: they can handle diverse data and annotation levels within one tool, and they support the annotation process with automatic (pre-)processing outcomes as much as possible. We developed a framework that meets these general requirements and that enables versatile and browser-based annotations of texts, the TextAnnotator. It combines NLP methods of pre-processing with methods of flexible post-processing. Infact, machine learning (ML) requires a lot of training and test data, but is usually far from achieving perfect results. Producing high-level annotations for ML and post-correcting its results are therefore necessary. This is the purpose of TextAnnotator, which is entirely implemented in ExtJS and provides a range of interactive visualizations of annotations. In addition, it allows for flexibly integrating knowledge resources, e.g. in the course of post-processing named entity recognition. The paper describes TextAnnotator’s architecture together with three use cases: annotating temporal structures, argument structures and named entity linking." } -
G. Abrami, A. Mehler, and C. Spiekermann, “Graph-based Format for Modeling Multimodal Annotations in Virtual Reality by Means of VAnnotatoR,” in Proceedings of the 21th International Conference on Human-Computer Interaction, HCII 2019, Cham, 2019, pp. 351-358.
[Abstract] [BibTeX]Projects in the field of Natural Language Processing (NLP), the Digital Humanities (DH) and related disciplines dealing with machine learning of complex relationships between data objects need annotations to obtain sufficiently rich training and test sets. The visualization of such data sets and their underlying Human Computer Interaction (HCI) are perennial problems of computer science. However, despite some success stories, the clarity of information presentation and the flexibility of the annotation process may decrease with the complexity of the underlying data objects and their relationships. In order to face this problem, the so-called VAnnotatoR was developed, as a flexible annotation tool using 3D glasses and augmented reality devices, which enables annotation and visualization in three-dimensional virtual environments. In addition, multimodal objects are annotated and visualized within a graph-based approach.@InProceedings{Abrami:Mehler:Spiekermann:2019, Author = {Abrami, Giuseppe and Mehler, Alexander and Spiekermann, Christian}, Title = {{Graph-based Format for Modeling Multimodal Annotations in Virtual Reality by Means of VAnnotatoR}}, BookTitle = {Proceedings of the 21th International Conference on Human-Computer Interaction, HCII 2019}, Series = {HCII 2019}, location = {Orlando, Florida, USA}, editor = {Stephanidis, Constantine and Antona, Margherita}, month = {July}, publisher="Springer International Publishing", address="Cham", pages="351--358", abstract="Projects in the field of Natural Language Processing (NLP), the Digital Humanities (DH) and related disciplines dealing with machine learning of complex relationships between data objects need annotations to obtain sufficiently rich training and test sets. The visualization of such data sets and their underlying Human Computer Interaction (HCI) are perennial problems of computer science. However, despite some success stories, the clarity of information presentation and the flexibility of the annotation process may decrease with the complexity of the underlying data objects and their relationships. In order to face this problem, the so-called VAnnotatoR was developed, as a flexible annotation tool using 3D glasses and augmented reality devices, which enables annotation and visualization in three-dimensional virtual environments. In addition, multimodal objects are annotated and visualized within a graph-based approach.", isbn="978-3-030-30712-7", pdf ={https://link.springer.com/content/pdf/10.1007%2F978-3-030-30712-7_44.pdf}, year = 2019 } -
G. Abrami, C. Spiekermann, and A. Mehler, “VAnnotatoR: Ein Werkzeug zur Annotation multimodaler Netzwerke in dreidimensionalen virtuellen Umgebungen,” in Proceedings of the 6th Digital Humanities Conference in the German-speaking Countries, DHd 2019, 2019.
[Poster][BibTeX]@InProceedings{Abrami:Spiekermann:Mehler:2019, Author = {Abrami, Giuseppe and Spiekermann, Christian and Mehler, Alexander}, Title = {{VAnnotatoR: Ein Werkzeug zur Annotation multimodaler Netzwerke in dreidimensionalen virtuellen Umgebungen}}, BookTitle = {Proceedings of the 6th Digital Humanities Conference in the German-speaking Countries, DHd 2019}, Series = {DHd 2019}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/Preprint_VAnnotatoR_DHd2019.pdf}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/DHDVAnnotatoRPoster.pdf}, location = {Frankfurt, Germany}, year = 2019 } -
W. Hemati, A. Mehler, T. Uslu, and G. Abrami, “Der TextImager als Front- und Backend für das verteilte NLP von Big Digital Humanities Data,” in Proceedings of the 6th Digital Humanities Conference in the German-speaking Countries, DHd 2019, 2019.
[Poster][BibTeX]@InProceedings{Hemati:Mehler:Uslu:Abrami:2019, Author = {Hemati, Wahed and Mehler, Alexander and Uslu, Tolga and Abrami, Giuseppe}, Title = {{Der TextImager als Front- und Backend für das verteilte NLP von Big Digital Humanities Data}}, BookTitle = {Proceedings of the 6th Digital Humanities Conference in the German-speaking Countries, DHd 2019}, Series = {DHd 2019}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/Der-TextImager-als-Fron-und-Backend.pdf}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/DHD19_TextImager.pdf}, location = {Frankfurt, Germany}, year = 2019 }
2018 (11)
-
G. Abrami, A. Mehler, P. Helfrich, and E. Rieb, “TextAnnotator: A Browser-based Framework for Annotating Textual Data in Digital Humanities,” in Proceedings of the Digital Humanities Austria 2018, 2018.
[BibTeX]@InProceedings{Abrami:et:al:2018, Author = {Giuseppe Abrami and Alexander Mehler and Philipp Helfrich and Elias Rieb}, Title = {{TextAnnotator}: A Browser-based Framework for Annotating Textual Data in Digital Humanities}, BookTitle = {Proceedings of the Digital Humanities Austria 2018}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2019/04/TA__A_Browser_based_Framework_for_Annotating_Textual_Data_in_Digital_Humanities.pdf}, location = {Salzburg, Austria}, year = 2018 } -
C. Weiland, C. Driller, M. Koch, M. Schmidt, G. Abrami, S. Ahmed, A. Mehler, A. Pachzelt, G. Kasperek, A. Hausinger, and T. Hörnschemeyer, “BioFID, a platform to enhance accessibility of biodiversity data,” in Proceedings of the 10th International Conference on Ecological Informatics, 2018.
[BibTeX]@inproceedings{Weiland:et:al:2018, author = {Claus Weiland and Christine Driller and Markus Koch and Marco Schmidt and Giuseppe Abrami and Sajawel Ahmed and Alexander Mehler and Adrian Pachzelt and Gerwin Kasperek and Angela Hausinger and Thomas Hörnschemeyer}, title = {{BioFID}, a platform to enhance accessibility of biodiversity data}, BookTitle = {Proceedings of the 10th International Conference on Ecological Informatics}, year = {2018}, url={https://www.researchgate.net/profile/Marco_Schmidt3/publication/327940813_BIOfid_a_Platform_to_Enhance_Accessibility_of_Biodiversity_Data/links/5bae3e3e92851ca9ed2cd60f/BIOfid-a-Platform-to-Enhance-Accessibility-of-Biodiversity-Data.pdf?origin=publication_detail}, location = {Jena, Germany} } -
A. Kett, G. Abrami, A. Mehler, and C. Spiekermann, “Resources2City Explorer: A System for Generating Interactive Walkable Virtual Cities out of File Systems,” in Proceedings of the 31st ACM User Interface Software and Technology Symposium, 2018.
[Abstract] [Poster][BibTeX]We present Resources2City Explorer (R2CE), a tool for representing file systems as interactive, walkable virtual cities. R2CE visualizes file systems based on concepts of spatial, 3D information processing. For this purpose, it extends the range of functions of conventional file browsers considerably. Visual elements in a city generated by R2CE represent (relations of) objects of the underlying file system. The paper describes the functional spectrum of R2CE and illustrates it by visualizing a sample of 940 files.@InProceedings{Kett:et:al:2018, Author = {Attila Kett and Giuseppe Abrami and Alexander Mehler and Christian Spiekermann}, Title = {{Resources2City Explorer}: A System for Generating Interactive Walkable Virtual Cities out of File Systems}, BookTitle = {Proceedings of the 31st ACM User Interface Software and Technology Symposium}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2018/10/UIST2018Final.pdf}, location = {Berlin, Germany}, abstract = {We present Resources2City Explorer (R2CE), a tool for representing file systems as interactive, walkable virtual cities. R2CE visualizes file systems based on concepts of spatial, 3D information processing. For this purpose, it extends the range of functions of conventional file browsers considerably. Visual elements in a city generated by R2CE represent (relations of) objects of the underlying file system. The paper describes the functional spectrum of R2CE and illustrates it by visualizing a sample of 940 files.}, year = 2018 } -
C. Driller, M. Koch, M. Schmidt, C. Weiland, T. Hörnschemeyer, T. Hickler, G. Abrami, S. Ahmed, R. Gleim, W. Hemati, T. Uslu, A. Mehler, A. Pachzelt, J. Rexhepi, T. Risse, J. Schuster, G. Kasperek, and A. Hausinger, “Workflow and Current Achievements of BIOfid, an Information Service Mobilizing Biodiversity Data from Literature Sources,” Biodiversity Information Science and Standards, vol. 2, p. e25876, 2018.
[Abstract] [BibTeX]BIOfid is a specialized information service currently being developed to mobilize biodiversity data dormant in printed historical and modern literature and to offer a platform for open access journals on the science of biodiversity. Our team of librarians, computer scientists and biologists produce high-quality text digitizations, develop new text-mining tools and generate detailed ontologies enabling semantic text analysis and semantic search by means of user-specific queries. In a pilot project we focus on German publications on the distribution and ecology of vascular plants, birds, moths and butterflies extending back to the Linnaeus period about 250 years ago. The three organism groups have been selected according to current demands of the relevant research community in Germany. The text corpus defined for this purpose comprises over 400 volumes with more than 100,000 pages to be digitized and will be complemented by journals from other digitization projects, copyright-free and project-related literature. With TextImager (Natural Language Processing & Text Visualization) and TextAnnotator (Discourse Semantic Annotation) we have already extended and launched tools that focus on the text-analytical section of our project. Furthermore, taxonomic and anatomical ontologies elaborated by us for the taxa prioritized by the project’s target group - German institutions and scientists active in biodiversity research - are constantly improved and expanded to maximize scientific data output. Our poster describes the general workflow of our project ranging from literature acquisition via software development, to data availability on the BIOfid web portal (http://biofid.de/), and the implementation into existing platforms which serve to promote global accessibility of biodiversity data.@article{Driller:et:al:2018, author = {Christine Driller and Markus Koch and Marco Schmidt and Claus Weiland and Thomas Hörnschemeyer and Thomas Hickler and Giuseppe Abrami and Sajawel Ahmed and Rüdiger Gleim and Wahed Hemati and Tolga Uslu and Alexander Mehler and Adrian Pachzelt and Jashar Rexhepi and Thomas Risse and Janina Schuster and Gerwin Kasperek and Angela Hausinger}, title = {Workflow and Current Achievements of BIOfid, an Information Service Mobilizing Biodiversity Data from Literature Sources}, volume = {2}, number = {}, year = {2018}, doi = {10.3897/biss.2.25876}, publisher = {Pensoft Publishers}, abstract = {BIOfid is a specialized information service currently being developed to mobilize biodiversity data dormant in printed historical and modern literature and to offer a platform for open access journals on the science of biodiversity. Our team of librarians, computer scientists and biologists produce high-quality text digitizations, develop new text-mining tools and generate detailed ontologies enabling semantic text analysis and semantic search by means of user-specific queries. In a pilot project we focus on German publications on the distribution and ecology of vascular plants, birds, moths and butterflies extending back to the Linnaeus period about 250 years ago. The three organism groups have been selected according to current demands of the relevant research community in Germany. The text corpus defined for this purpose comprises over 400 volumes with more than 100,000 pages to be digitized and will be complemented by journals from other digitization projects, copyright-free and project-related literature. With TextImager (Natural Language Processing & Text Visualization) and TextAnnotator (Discourse Semantic Annotation) we have already extended and launched tools that focus on the text-analytical section of our project. Furthermore, taxonomic and anatomical ontologies elaborated by us for the taxa prioritized by the project’s target group - German institutions and scientists active in biodiversity research - are constantly improved and expanded to maximize scientific data output. Our poster describes the general workflow of our project ranging from literature acquisition via software development, to data availability on the BIOfid web portal (http://biofid.de/), and the implementation into existing platforms which serve to promote global accessibility of biodiversity data.}, issn = {}, pages = {e25876}, URL = {https://doi.org/10.3897/biss.2.25876}, eprint = {https://doi.org/10.3897/biss.2.25876}, journal = {Biodiversity Information Science and Standards} } -
A. Mehler, G. Abrami, C. Spiekermann, and M. Jostock, “VAnnotatoR: A Framework for Generating Multimodal Hypertexts,” in Proceedings of the 29th ACM Conference on Hypertext and Social Media, New York, NY, USA, 2018.
[BibTeX]@InProceedings{Mehler:Abrami:Spiekermann:Jostock:2018, author = {Mehler, Alexander and Abrami, Giuseppe and Spiekermann, Christian and Jostock, Matthias}, title = {{VAnnotatoR}: {A} Framework for Generating Multimodal Hypertexts}, booktitle = {Proceedings of the 29th ACM Conference on Hypertext and Social Media}, series = {Proceedings of the 29th ACM Conference on Hypertext and Social Media (HT '18)}, year = {2018}, location = {Baltimore, Maryland}, publisher = {ACM}, address = {New York, NY, USA}, pdf = {http://delivery.acm.org/10.1145/3210000/3209572/p150-mehler.pdf} } -
W. Hemati, A. Mehler, T. Uslu, D. Baumartz, and G. Abrami, “Evaluating and Integrating Databases in the Area of NLP,” in International Quantitative Linguistics Conference (QUALICO 2018), 2018.
[Poster][BibTeX]@inproceedings{Hemati:Mehler:Uslu:Baumartz:Abrami:2018, author={Wahed Hemati and Alexander Mehler and Tolga Uslu and Daniel Baumartz and Giuseppe Abrami}, title={Evaluating and Integrating Databases in the Area of {NLP}}, booktitle={International Quantitative Linguistics Conference (QUALICO 2018)}, year={2018}, pdf={https://www.texttechnologylab.org/wp-content/uploads/2018/04/Hemat-Mehler-Uslu-Baumartz-Abrami-Qualico-2018.pdf}, poster={https://www.texttechnologylab.org/wp-content/uploads/2018/10/qualico2018_databases_poster_hemati_mehler_uslu_baumartz_abrami.pdf}, location={Wroclaw, Poland} } -
G. Abrami, G. Boden, and L. Gleiß, “World of the Khwe Bushmen: Accessing Khwe Cultural Heritage data by means of a digital ontology based on OWLnotator,” in Proceedings of the Digital Humanities 2018, 2018.
[BibTeX]@InProceedings{Abrami:Boden:Gleiss:2018, Author = {Abrami, Giuseppe and Boden, Gertrud and Glei\ss{}, Lisa}, Title = {{World of the Khwe Bushmen: Accessing Khwe Cultural Heritage data by means of a digital ontology based on OWLnotator}}, BookTitle = {Proceedings of the Digital Humanities 2018}, Series = {DH2018}, location = {Mexico City, Mexico}, year = 2018 } -
C. Spiekermann, G. Abrami, and A. Mehler, “VAnnotatoR: a Gesture-driven Annotation Framework for Linguistic and Multimodal Annotation,” in Proceedings of the Annotation, Recognition and Evaluation of Actions (AREA 2018) Workshop, 2018.
[BibTeX]@InProceedings{Spiekerman:Abrami:Mehler:2018, Author = {Christian Spiekermann and Giuseppe Abrami and Alexander Mehler}, Title = {{VAnnotatoR}: a Gesture-driven Annotation Framework for Linguistic and Multimodal Annotation}, BookTitle = {Proceedings of the Annotation, Recognition and Evaluation of Actions (AREA 2018) Workshop}, Series = {AREA}, location = {Miyazaki, Japan}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/VAnnotatoR.pdf}, year = 2018 } -
P. Helfrich, E. Rieb, G. Abrami, A. Lücking, and A. Mehler, “TreeAnnotator: Versatile Visual Annotation of Hierarchical Text Relations,” in Proceedings of the 11th edition of the Language Resources and Evaluation Conference, May 7 – 12, Miyazaki, Japan, 2018.
[BibTeX]@InProceedings{Helfrich:et:al:2018, Author = {Philipp Helfrich and Elias Rieb and Giuseppe Abrami and Andy L{\"u}cking and Alexander Mehler}, Title = {TreeAnnotator: Versatile Visual Annotation of Hierarchical Text Relations}, BookTitle = {Proceedings of the 11th edition of the Language Resources and Evaluation Conference, May 7 - 12}, Series = {LREC 2018}, Address = {Miyazaki, Japan}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/TreeAnnotator.pdf}, year = 2018 } -
G. Abrami and A. Mehler, “A UIMA Database Interface for Managing NLP-related Text Annotations,” in Proceedings of the 11th edition of the Language Resources and Evaluation Conference, May 7 – 12, Miyazaki, Japan, 2018.
[BibTeX]@InProceedings{Abrami:Mehler:2018, Author = {Giuseppe Abrami and Alexander Mehler}, Title = {A UIMA Database Interface for Managing NLP-related Text Annotations}, BookTitle = {Proceedings of the 11th edition of the Language Resources and Evaluation Conference, May 7 - 12}, Series = {LREC 2018}, Address = {Miyazaki, Japan}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2018/03/UIMA-DI.pdf}, year = 2018 } -
G. Abrami, S. Ahmed, R. Gleim, W. Hemati, A. Mehler, and U. Tolga, Natural Language Processing and Text Mining for BIOfid, 2018.
[BibTeX]@misc{Abrami:et:al:2018b, author = {Abrami, Giuseppe and Ahmed, Sajawel and Gleim, R{\"u}diger and Hemati, Wahed and Mehler, Alexander and Uslu Tolga}, title = {{Natural Language Processing and Text Mining for BIOfid}}, howpublished = {Presentation at the 1st Meeting of the Scientific Advisory Board of the BIOfid Project}, adress = {Goethe-University, Frankfurt am Main, Germany}, year = {2018}, month = {March}, day = {08}, pdf = {} }
2017 (1)
-
A. Mehler, G. Abrami, S. Bruendel, L. Felder, T. Ostertag, and C. Spiekermann, “Stolperwege: An App for a Digital Public History of the Holocaust,” in Proceedings of the 28th ACM Conference on Hypertext and Social Media, New York, NY, USA, 2017, pp. 319-320.
[Abstract] [Poster][BibTeX]We present the Stolperwege app, a web-based framework for ubiquitous modeling of historical processes. Starting from the art project Stolpersteine of Gunter Demnig, it allows for virtually connecting these stumbling blocks with information about the biographies of victims of Nazism. According to the practice of public history, the aim of Stolperwege is to deepen public knowledge of the Holocaust in the context of our everyday environment. Stolperwege uses an information model that allows for modeling social networks of agents starting from information about portions of their life. The paper exemplifies how Stolperwege is informationally enriched by means of historical maps and 3D animations of (historical) buildings.@InProceedings{Mehler:et:al:2017:a, Author = {Alexander Mehler and Giuseppe Abrami and Steffen Bruendel and Lisa Felder and Thomas Ostertag and Christian Spiekermann}, Title = {{Stolperwege:} An App for a Digital Public History of the {Holocaust}}, BookTitle = {Proceedings of the 28th ACM Conference on Hypertext and Social Media}, Series = {HT '17}, Pages = {319--320}, Address = {New York, NY, USA}, Publisher = {ACM}, abstract = {We present the Stolperwege app, a web-based framework for ubiquitous modeling of historical processes. Starting from the art project Stolpersteine of Gunter Demnig, it allows for virtually connecting these stumbling blocks with information about the biographies of victims of Nazism. According to the practice of public history, the aim of Stolperwege is to deepen public knowledge of the Holocaust in the context of our everyday environment. Stolperwege uses an information model that allows for modeling social networks of agents starting from information about portions of their life. The paper exemplifies how Stolperwege is informationally enriched by means of historical maps and 3D animations of (historical) buildings.}, acmid = {3078748}, doi = {10.1145/3078714.3078748}, isbn = {978-1-4503-4708-2}, keywords = {3d, geocaching, geotagging, historical maps, historical processes, public history of the holocaust, ubiquitous computing}, location = {Prague, Czech Republic}, numpages = {2}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2017/07/poster_ht2017.pdf}, url = {http://doi.acm.org/10.1145/3078714.3078748}, year = 2017 }
2015 (3)
-
G. Abrami, A. Mehler, and S. Zeunert, “Ontologiegestütze geisteswissenschaftliche Annotationen mit dem OWLnotator,” in Proceedings of the Jahrestagung der Digital Humanities im deutschsprachigen Raum, 2015.
[BibTeX]@InProceedings{Abrami:Mehler:Zeunert:2015:a, Author = {Abrami, Giuseppe and Mehler, Alexander and Zeunert, Susanne}, Title = {Ontologiegestütze geisteswissenschaftliche Annotationen mit dem OWLnotator}, BookTitle = {Proceedings of the Jahrestagung der Digital Humanities im deutschsprachigen Raum}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/Abrami_Mehler_Zeunert_DHd_2015_abstract.pdf}, year = 2015 } -
G. Abrami, A. Mehler, and D. Pravida, “Fusing Text and Image Data with the Help of the OWLnotator,” in Human Interface and the Management of Information. Information and Knowledge Design, S. Yamamoto, Ed., Springer International Publishing, 2015, vol. 9172, pp. 261-272.
[BibTeX]@InCollection{Abrami:Mehler:Pravida:2015:b, Author = {Abrami, Giuseppe and Mehler, Alexander and Pravida, Dietmar}, Title = {Fusing Text and Image Data with the Help of the OWLnotator}, BookTitle = {Human Interface and the Management of Information. Information and Knowledge Design}, Publisher = {Springer International Publishing}, Editor = {Yamamoto, Sakae}, Volume = {9172}, Series = {Lecture Notes in Computer Science}, Pages = {261-272}, doi = {10.1007/978-3-319-20612-7_25}, isbn = {978-3-319-20611-0}, language = {English}, website = {http://dx.doi.org/10.1007/978-3-319-20612-7_25}, year = 2015 } -
G. Abrami, M. Freiberg, and P. Warner, “Managing and Annotating Historical Multimodal Corpora with the eHumanities Desktop – An outline of the current state of the LOEWE project Illustrations of Goethe s Faust,” in Historical Corpora, 2015, pp. 353-363.
[Abstract] [BibTeX]Text corpora are structured sets of text segments that can be annotated or interrelated. Expanding on this, we can define a database of images as an iconographic multimodal corpus with annotated images and the relations between images as well as between images and texts. The Goethe-Museum in Frankfurt holds a significant collection of art work and texts relating to Goethe’s Faust from the early 19th century until the present. In this project we create a database containing digitized items from this collection, and extend a tool, the ImageDB in the eHumanities Desktop, to annotate and provide relations between resources. This article gives an overview of the project and provides some technical details. Furthermore we show newly implemented features, explain the challenge of creating an ontology on multimodal corpora and give a forecast for future work.@InProceedings{Abrami:Freiberg:Warner:2015, Author = {Abrami, Giuseppe and Freiberg, Michael and Warner, Paul}, Title = {Managing and Annotating Historical Multimodal Corpora with the eHumanities Desktop - An outline of the current state of the LOEWE project Illustrations of Goethe s Faust}, BookTitle = {Historical Corpora}, Pages = {353 - 363}, abstract = {Text corpora are structured sets of text segments that can be annotated or interrelated. Expanding on this, we can define a database of images as an iconographic multimodal corpus with annotated images and the relations between images as well as between images and texts. The Goethe-Museum in Frankfurt holds a significant collection of art work and texts relating to Goethe’s Faust from the early 19th century until the present. In this project we create a database containing digitized items from this collection, and extend a tool, the ImageDB in the eHumanities Desktop, to annotate and provide relations between resources. This article gives an overview of the project and provides some technical details. Furthermore we show newly implemented features, explain the challenge of creating an ontology on multimodal corpora and give a forecast for future work.}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/AbramiFreibergWarner_HC_2012.pdf}, website = {http://www.narr-shop.de/historical-corpora.html}, year = 2015 }
2014 (2)
-
G. Abrami, A. Mehler, D. Pravida, and S. Zeunert, “Rubrik: Neues aus dem Netz,” Kunstchronik, vol. 12, p. 623, 2014.
[BibTeX]@Article{Abrami:Mehler:Pravida:Zeunert:2014, Author = {Abrami, Giuseppe and Mehler, Alexander and Pravida, Dietmar and Zeunert, Susanne}, Title = {Rubrik: Neues aus dem Netz}, Journal = {Kunstchronik}, Volume = {12}, Pages = {623}, address = {München}, month = {12}, publisher = {Zentralinstitut für Kunstgeschichte}, website = {http://www.zikg.eu/publikationen/laufende-publikationen/kunstchronik}, year = 2014 } -
A. Mehler, A. Lücking, and G. Abrami, “WikiNect: Image Schemata as a Basis of Gestural Writing for Kinetic Museum Wikis,” Universal Access in the Information Society, pp. 1-17, 2014.
[Abstract] [BibTeX]This paper provides a theoretical assessment of gestures in the context of authoring image-related hypertexts by example of the museum information system WikiNect. To this end, a first implementation of gestural writing based on image schemata is provided (Lakoff in Women, fire, and dangerous things: what categories reveal about the mind. University of Chicago Press, Chicago, 1987). Gestural writing is defined as a sort of coding in which propositions are only expressed by means of gestures. In this respect, it is shown that image schemata allow for bridging between natural language predicates and gestural manifestations. Further, it is demonstrated that gestural writing primarily focuses on the perceptual level of image descriptions (Hollink et al. in Int J Hum Comput Stud 61(5):601–626, 2004). By exploring the metaphorical potential of image schemata, it is finally illustrated how to extend the expressiveness of gestural writing in order to reach the conceptual level of image descriptions. In this context, the paper paves the way for implementing museum information systems like WikiNect as systems of kinetic hypertext authoring based on full-fledged gestural writing.@Article{Mehler:Luecking:Abrami:2014, Author = {Mehler, Alexander and Lücking, Andy and Abrami, Giuseppe}, Title = {{WikiNect}: Image Schemata as a Basis of Gestural Writing for Kinetic Museum Wikis}, Journal = {Universal Access in the Information Society}, Pages = {1-17}, abstract = {This paper provides a theoretical assessment of gestures in the context of authoring image-related hypertexts by example of the museum information system WikiNect. To this end, a first implementation of gestural writing based on image schemata is provided (Lakoff in Women, fire, and dangerous things: what categories reveal about the mind. University of Chicago Press, Chicago, 1987). Gestural writing is defined as a sort of coding in which propositions are only expressed by means of gestures. In this respect, it is shown that image schemata allow for bridging between natural language predicates and gestural manifestations. Further, it is demonstrated that gestural writing primarily focuses on the perceptual level of image descriptions (Hollink et al. in Int J Hum Comput Stud 61(5):601–626, 2004). By exploring the metaphorical potential of image schemata, it is finally illustrated how to extend the expressiveness of gestural writing in order to reach the conceptual level of image descriptions. In this context, the paper paves the way for implementing museum information systems like WikiNect as systems of kinetic hypertext authoring based on full-fledged gestural writing.}, doi = {10.1007/s10209-014-0386-8}, issn = {1615-5289}, keywords = {wikinect}, pdf = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/art_10.1007_s10209-014-0386-8.pdf}, website = {http://dx.doi.org/10.1007/s10209-014-0386-8}, year = 2014 }
2013 (1)
-
A. Mehler, A. Lücking, T. vor der Brück, and G. Abrami, WikiNect – A Kinetic Artwork Wiki for Exhibition Visitors, 2013.
[Poster][BibTeX]@Misc{Mehler:Luecking:vor:der:Brueck:2013:a, Author = {Mehler, Alexander and Lücking, Andy and vor der Brück, Tim and Abrami, Giuseppe}, Title = {WikiNect - A Kinetic Artwork Wiki for Exhibition Visitors}, HowPublished = {Poster Presentation at the Scientific Computing and Cultural Heritage 2013 Conference, Heidelberg}, keywords = {wikinect}, month = {11}, poster = {https://www.texttechnologylab.org/wp-content/uploads/2015/08/SCCHPoster2013.pdf}, url = {http://scch2013.wordpress.com/}, year = 2013 }
2011 (1)
-
G. Doeben-Henisch, G. Abrami, M. Pfaff, and M. Struwe, “Conscious learning semiotics systems to assist human persons (CLS2H),” in AFRICON, 2011, 2011, pp. 1-7.
[Abstract] [BibTeX]Challenged by the growing societal demand for Ambient Assistive Living (AAL) technologies, we are dedicated to develop intelligent technical devices which are able to communicate with human persons in a truly human-like manner. The core of the project is a simulation environment which enables the development of conscious learning semiotic agents which will be able to assist human persons in their daily life. We are reporting first results and future perspectives.@InProceedings{Doebenhenisch:Abrami:Pfaff:Struwe:2011, Author = {Doeben-Henisch, Gerd and Abrami, Giuseppe and Pfaff, Marcus and Struwe, Marvin}, Title = {Conscious learning semiotics systems to assist human persons (CLS2H)}, BookTitle = {AFRICON, 2011}, Volume = {}, Number = {}, Pages = {1 -7}, abstract = {Challenged by the growing societal demand for Ambient Assistive Living (AAL) technologies, we are dedicated to develop intelligent technical devices which are able to communicate with human persons in a truly human-like manner. The core of the project is a simulation environment which enables the development of conscious learning semiotic agents which will be able to assist human persons in their daily life. We are reporting first results and future perspectives.}, doi = {10.1109/AFRCON.2011.6072043}, issn = {2153-0025}, keywords = {ambient assistive living;conscious learning semiotic agents;conscious learning semiotics systems;human persons;intelligent technical devices;simulation environment;learning (artificial intelligence);multi-agent systems;}, month = {sept.}, pdf = {http://www.doeben-henisch.de/gdhnp/csg/africon2011.pdf}, website = {http://www.researchgate.net/publication/261451874_Conscious_Learning_Semiotics_Systems_to_Assist_Human_Persons_(CLS(2)H)}, year = 2011 }