Alle Publikationen
- <<
- <
- 1
2019
-
(2019): Systematic literature review of hand gestures used in human computer interaction interfaces. In: International Journal of Human-Computer Studies 129, S. 74-94. DOI: 10.1016/j.ijhcs.2019.03.011
DOI: https://doi.org/10.1016/j.ijhcs.2019.03.011 Abstract: Gestures, widely accepted as a humans’ natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence. (PsycINFO Database Record (c) 2019 APA, all rights reserved)
2018
-
(2018): ROBIN, a Telepresence Robot to Support Older Users Monitoring and Social Inclusion: Development and Evaluation. In: Telemedicine journal and e-health : the official journal of the American Telemedicine Association 24 (2), S. 145-154. DOI: 10.1089/tmj.2016.0258
DOI: https://doi.org/10.1089/tmj.2016.0258 Abstract: INTRODUCTION This article describes an enhanced telepresence robot named ROBIN, part of a telecare system derived from the GIRAFFPLUS project for supporting and monitoring older adults at home. ROBIN is integrated in a sensor-rich environment that aims to continuously monitor physical and psychological wellbeing of older persons living alone. The caregivers (formal/informal) can communicate through it with their assisted persons. Long-term trials in real houses highlighted several user requirements that inspired improvements on the robotic platform. The enhanced telepresence robot was assessed by users to test its suitability to support social interaction and provide motivational feedback on health-related aspects. METHODS Twenty-five users (n = 25) assessed the new multimodal interaction capabilities and new communication services. A psychophysiological approach was adopted to investigate aspects like engagement, usability, and affective impact, as well as the possible role of individual differences on the quality of human-robot interaction. RESULTS ROBIN was overall judged usable, the interaction with/through it resulted pleasant and the required workload was limited, thus supporting the idea of using it as a central component for remote assistance and social participation. Open-minded users tended to have a more positive interaction with it. CONCLUSIONS This work describes an enabling technology for remote assistance and social communication. It highlights the importance of being compliant with users' needs to develop solutions easy to use and able to foster their social connections. The role of personality appeared to be relevant for the interaction, underscoring a clear role of the service personalization.
2017
-
(2017): Real‐time gesture–based communication using possibility theory–based hidden Markov model. In: Computational Intelligence 33 (4), S. 843-862. DOI: 10.1111/coin.12116
DOI: https://doi.org/10.1111/coin.12116 Abstract: Exploring correct patterns from low‐frequency time‐series data is challenging. For resolving this problem, the concept of possibility theory–based hidden Markov model (PTBHMM) has been proposed. In this article, all three fundamental problems (evaluation, decoding, and learning) of conventional HMM have been addressed using possibility theory. For handling uncertainty, we have used an axiomatic approach of possibility theory proposed by Zadeh. The time complexity of existing solutions of HMM (forward, backward, Viterbi, and Baum Welch) and proposed possibility‐based solutions has been calculated and compared. From the comparison result, it has been found that PTBHMM has lesser time complexity and hence will be more suitable for real‐time gesture–based communication. (PsycINFO Database Record (c) 2018 APA, all rights reserved)
2016
-
(2016): Iconic gestures for robot avatars, recognition and integration with speech. In: Frontiers in psychology 7
Abstract: Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances. (PsycINFO Database Record (c) 2019 APA, all rights reserved)
2012
-
(2012) : Children’s adaptation in multi-session interaction with a humanoid robot: 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication: Paris, France: IEEE, S. 351-357
DOI: https://doi.org/10.1109/ROMAN.2012.6343778 Abstract: This work presents preliminary observations from a study of children (N=19, age 5-12) interacting in multiple sessions with a humanoid robot in a scenario involving game activities. The main purpose of the study was to see how their perception of the robot, their engagement, and their enjoyment of the robot as a companion evolve across multiple interactions, separated by one-two weeks. However, an interesting phenomenon was observed during the experiment: most of the children soon adapted to the behaviors of the robot, in terms of speech timing, speed and tone, verbal input formulation, nodding, gestures, etc. We describe the experimental setup and the system, and our observations and preliminary analysis results, which open interesting questions for further research.
Keywords: children adaptation, game activities, Game Theory, Games, Gestures, Humanoid Robot, Humanoid Robots, human-robot interaction, Humans, ieee xplore, Künstliche Intelligenz, medical robotics, multisession interaction, nodding, speech, speech timing, speed-and-tone, Syntactics, timing, verbal input formulation 2011
-
(2011): Verhaltenskoordination, Mimikry und sprachbegleitende Gestik in der Interaktion. In: Psychotherapie Wissenschaft 1 (1), S. 56-64
Abstract: This article provides a summary of some of the key findings in behavior coordination, including both verbal and nonverbal coordination. Subsequently, the author gives a short introduction to the phenomenon of co-speech gesture. She then describes behavior coordination in the gestural modality. The focus is on a recent experimental study on gestural mimicry by the author and her collaborator and the functions it may serve in conversational interaction. The final part of the article maps out how these findings may be relevant to currently on-going and future research on gesture in health-related and clinical contexts. Ergebnisse im Bereich der Verhaltenskoordinationsforschung (fur verbales und nonverbales Verhalten) werden zusammengefasst und eine kurze Einfuhrung zum Phanomen der sprachbegleitenden Gestik wird gegeben. Dann wird die Verhaltenskoordination in der gestlichen Modalitat besprochen. Dabei wird Bezug genommen auf eine Studie der Autorin und ihrer Mitarbeiterin zur gestlichen Mimikry und assoziierten Funktionen in der Interaktion. Der letzte Teil des Artikels bezieht sich auf die potentielle Relevanz dieser Ergebnisse fur momentan laufende und zukunftige Studien zur Gestik in gesundheitsbezogenen und klinischen Kontexten.
2005
-
(2005): Explorations in engagement for humans and robots. In: Artificial Intelligence 166 (1), S. 140-164. DOI: 10.1016/j.artint.2005.03.005
DOI: https://doi.org/10.1016/j.artint.2005.03.005 Abstract: This paper explores the concept of engagement, the process by which individuals in an interaction start, maintain and end their perceived connection to one another. The paper reports on one aspect of engagement among human interactors—the effect of tracking faces during an interaction. It also describes the architecture of a robot that can participate in conversational, collaborative interactions with engagement gestures. Finally, the paper reports on findings of experiments with human participants who interacted with a robot when it either performed or did not perform engagement gestures. Results of the human–robot studies indicate that people become engaged with robots: they direct their attention to the robot more often in interactions where engagement gestures are present, and they find interactions more appropriate when engagement gestures are present than when they are not.
- <<
- <
- 1