Sensors for the Senses: Meaning-making via self-active entertainment experiences
Journal Title: EAI Endorsed Transactions on e-Learning - Year 2015, Vol 2, Issue 8
Abstract
In his ACM Computers in Entertainment article, titled "Artist and Audience: Emerging the Nano-entertainment experience", the author posited on how Inhabited Information Spaces, created as core catalyst of research, may be questioned as a multisensory future virtual work of art. This themed Human-Computer Interaction for Entertainment contribution for the EAI INTETAIN 2015 conference builds upon the earlier work by questioning meaning making from such self-active entertainment experiences. Contextually, self-active relates to actor empowerment via ICT, whilst entertainment refers to HCI paradigms that are fun, engaging, and enjoyable. Conceptualizing, designing and realizing alternative digital media entertainment situations in stage performance, interactive installations and exhibitions at leading Museums for Modern Art, National and International major events, contributed to development of a sensor-based system conceived as a platform to investigate meaning making having societal impact beyond art. The system involves arrays of selectable sensor profiles mixed and matched according to requirements. Sensing of human input can be through worn (biosignal e.g. EEG, ECG, EMG, GSR), held, and/or non-worn sensors (volumetric, linear and planar interface profiles). Mapping of sourced human data is to a variety of digital content including art-based (music making, digital painting, lighting effects), video games, Virtual Reality and robotic devices. System adaptability promotes participant profile matching e.g. according to desired outcome. All ages and abilities are potential users. Preceding the commonly known camera-based game controllers such as EyeToy, Wii, and Kinect; the SoundScapes Virtual Interactive Space system has been used in institutes, hospitals and clinics to empower people with impairment to unconsciously push their limits of functionality via creative and playful expression. Rehabilitation is less mundane and boring, where variety of ICT-based intervention motivates whilst offering creative opportunities for facilitators. Additionally, in a randomized intervention study with frail elderly patients, Hagedorn and Holm reported significant clinical rehabilitation impact up to 400% in the ICT feedback training specific performance. This work highlights how co-informing paradigms between computer and human science and art, games and healthcare, can result in societal impact as well as commercial patented product and industry start-ups. At the core of the research is a rethinking in the way a human interacts with ICT. Current research explores a concept of dynamic air and alternative physical-virtual environments. Conclusions introduce a suggested need of increased researcher awareness of post-research effect following intervention/trials within healthcare and rehabilitation.
Authors and Affiliations
Anthony Brooks
A Methodological Approach to User Evaluation and Assessment of a Virtual Environment Hangout
Innovation in virtual reality and motion sensing devices is pushing the development of virtual communication platforms towards completely immersive scenarios, which require full user interaction and create complex sensor...
A few thoughts on the Flipped Classroom
There are many ways educators can enhance their curriculum and experiment with new pedagogical models to engage students. There have been numerous studies that have shown improvement as well as the potential for addi...
Using arcade games to engage students in the learning of foreign and mother languages
It is imperative to continue thinking about and reinventing education because mobile technologies and the Web are redefining where, when and from whom we learn. Authors from different study fields have recognised the mul...
Blended learning for developing effective virtual teams: a proposed intervention format
The aim of this exploratory study was to develop a blended learning approach to fostering the skills and competencies required by leaders and members of international virtual teams. Three levels of analysis were brought...
A survey of the benefits and issues arising from the deployment of physical artefacts in computer science teaching
This paper describes the introduction of the use of physical artefacts in the teaching of the curriculum in the Department of Computer Science at Middlesex University. The rationale for the change is discussed, together...