A core matter of our research community is that multimedia data contributes to the user experience in a rich and meaningful manner. The topics organized in the “Experience” theme are concerned with innovative uses of multimedia to enhance the user experience, how this experience is manifested in specific domains, and metrics for qualitatively and quantitatively measuring that experience in useful and meaningful ways. We aim to explore novel paradigms of interacting and exploring multimedia in all facets and the interaction designs that drive and foster novel multimedia systems, services, and interfaces.
In recent years, various applications in multimedia systems and services have seen tremendous developments. However, as has been discussed by many multimedia research publications, one area that still requires further investigations is how different forms of multimedia applications and experiences impact users. Studies focusing user perception of multimedia systems and applications are important as they are directly associated with users’ acceptance of new multimedia services and systems. As an emerging area, “Perceptual Multimedia” is focusing in on the broad view of multimedia perception and its growing design space for the creation of new multimedia systems and services. This area will especially focus on incorporating users’ perceptions into their system designs, for example, a customized and adaptive system developed to accommodate both right and left-handed users based on their perceptions and incorporate users’ multisensory perceptions during the design process.
Topics of interest
Digital Multimedia Perception and Design space
Perceptual Systems in Multimedia
Perceptual semantics and classifications
Quality of experience in perceptual multimedia
Perceptual multimedia and user requirements
Multi-modal interaction techniques and impact on perceptual multimedia
Ubiquitous, Wearable and Mobile technologies for perceptual multimedia
Novel sensorial media including haptic, taste, smell, etc.
Perceptual multimedia in virtual, augmented and mixed realities
Brain-computer interface in perceptual multimedia
Safety, Ethics, Trust, Privacy and Security Aspects of perceptual multimedia
Human-factor studies, field studies and user studies of perceptual multimedia
Measuring user experience with regards to human perception
The term ubiquitous multimedia reflects the concept of multimedia services and applications becoming deeply ingrained in the fabric of day-to-day life and activities, to the point where on the go access to rich and interactive multimedia becomes the default user expectation in any context. Clearly this new paradigm will change the way in which we interact not only with multimedia content but with the world around us and other humans. In this theme, we are inviting submissions on novel multimedia processing, multimedia systems and applications that demonstrate the potential to push the community towards realizing the vision of ubiquitous multimedia.
Topics of interest
“Multimedia in the Wild”, incl. novel interface paradigms for interacting with multimedia applications and services while on-the-go e.g. on mobile and wearable devices or in vehicles
Ubiquitous multimedia at home, embedded systems for multimedia, Internet of Things and multimedia
Mobile and ubiquitous multimedia applications, services and systems
Virtual, mixed and Augmented Reality multimedia services and applications
Multimedia games, entertainment and advertising that demonstrate novel ways of interacting with the environment or others
Wearables, tangible and embodied interaction, physical computing
Mobile multimedia services and applications
Context-aware and location-based mobile and ubiquitous multimedia
User studies in ubiquitous multimedia (qualitative and quantitative)
User-centric models and design of ubiquitous multimedia services and applications
Multimedia content today is created, consumed and shared everywhere on a multitude of different devices in a networked world. A central challenge for creating more positive and compelling user experiences is to let users interact with multimedia with techniques that go beyond classic search and retrieval methods. Novel interaction paradigms and techniques are needed that provide intuitive and effective interaction with multimedia content in a pervasive manner. Interaction should be designed to seamlessly adapt to different contexts, devices and user intentions. Contributions in this area will be concerned with inventing, designing, implementing and evaluating interfaces for novel and pervasive interactions with multimedia from a user-centered perspective.
Topics of interest
Ambient multimedia interfaces
Brain-computer interfaces for multimedia applications
Context-aware and migratory interfaces
Gesture- and motion-based interaction
Intelligent user interfaces for multimedia content
Interacting with public displays
Interaction with intelligent personal assistants
Interaction with multimedia games, entertainment and advertising
Interaction with multimedia in AR and VR applications
Mobile interaction for sharing multimedia content
Novel interactions with home entertainment
Pervasive interaction with real-world embedded multimedia
Physiological interfaces
Proximity-based interaction and adaptation
Sensor-based and tangible interaction with TV
Tangible UI for interacting with multimedia
Toolkits and software for novel multimedia interfaces
A lot of multimedia systems capture human behavior, and in particular, social and emotional signals. These systems would therefore benefit from the ability to automatically interpret and react to the social and emotional context. The interpretation, analysis, and synthesis of social and emotional signals requires a different expertise that draws from a combination of signal processing, machine learning, pattern recognition, behavioral and social psychology and cognitive science. Analyzing multimedia content, where humans spontaneously express and respond to social or affect signals, helps to attribute meaning to users’ attitudes, preferences, relationships, feelings, personality, etc., as well as to understand the social and affective context of activities occurring in people’s everyday life.
This area focuses on the analysis of emotional, cognitive (e.g. brain-based) and interactive social behavior in the spectrum of individual to small group settings. It calls for novel contributions with a strong human-centered focus specializing in supporting or developing automated techniques for analyzing, processing, interpreting, synthesizing, or exploiting human social, affective and cognitive signals for multimedia applications. Special emphasis is put on multimodal approaches leveraging multiple streams when analyzing the verbal and/or non-verbal social and emotional signals during interactions. These interactions could be remote or co-located, and can include e.g. interactions between multiple people, humans with computer systems/robots, or humans with conversational agents.
Topics of interest
Human social, emotional, and/or affective cue extraction
Cross-media and/or multimodal fusion of interactive social and/or affective signals
The analysis of social and/or emotional behavior
Novel methods for the interpretation of interactive social and/or affective signals
Novel methods for the classification and representation of interactive social and/or emotional signals
Real-time processing of interactive social and emotional signals for interactive/assistive multimedia systems
This area addresses two interrelated fields within the creative sector, namely the curation of artistic exhibitions, collections, or archives, and interactive storytelling. Both fields make use of various media, request complex and creative authoring processes, and result in narration oriented end products. The related communities are interdisciplinary and highly dynamic, covering narrative studies, computer science, interactive and immersive technologies, the arts, and creativity. They converge to develop new expressive forms in various of domains.
We welcome contributions from a large range of fields and disciplines related to interactive storytelling, including computational narrative, computer science, human-computer interaction, media studies and media production, game studies, game design and development, museum science, edutainment, virtual and augmented reality, cognitive science, digital humanities, interactive arts, and transmedia studies. We encourage original contributions presenting new scientific results, innovative theories, novel technological implementations, case studies, creative artistic projects, and possible applications in different domains.
Topics of interest
Technologies that help curators in selecting content
Services and technologies to search for content
Tools for exhibition design (virtual or real)
Tools for exhibition and collection design
Creativity support for curators
Case studies for large virtual curated collections
Human-computer interaction with narrative technologies
Approaches in content production technology
Collaborative storytelling environments and multi-user systems
Social, ubiquitous and mobile storytelling
Cinematic hypermedia, VR, and game technologies for interactive storytelling
Interactive cinema and television
Interactive non-fiction and interactive documentaries
Interactive narratives as tools for learning in teaching, e-learning, training, and edutainment
Interactive storytelling in role-play, larps, theatre, and improvisation
Hypermedia authoring and playback
Authoring tools for interactive digital storytelling, including collaborative authoring story/world generation and experience management
Quality of experience in multimedia storytelling
Narrative-related affect and emotion
Methods/frameworks for testing user experience in interactive storytelling
Methods/frameworks for testing story development
Normative evaluation of interactive storytelling applications
Computational understanding, analysis, and summarization of narratives, including natural language processing and computer vision
Area: Multimedia for Collaboration and Public Spaces
The experience gap between being present in a meeting and participating remotely has not narrowed much in the last four decades, other than in terms of higher definition video. It is time for multimedia based collaboration to go beyond video-conferencing. Immersive and tangible technologies may be considered, and there is a quest for novel software based multimedia solutions for both synchronous and asynchronous collaboration. What applies to multimedia for distributed meetings also applies to other kinds of cooperative settings and to multimedia in public spaces. Different modalities must be further explored in the interface for groups and their members, whether they cooperate tightly, loosely, or even in passing such as in public. As to public spaces, multimedia has started to move out into the wild and to be present in many public areas, covered and open; more and more, multimedia content is publicly presented or shared and used with larger communities in urban and community spaces. This field, too, calls for novel approaches and disruptive concepts.
Topics of interest
Gesture- and tangible-based interaction for remote collaboration
Immersive multimedia interaction in public spaces
Interaction techniques for sync and async collaboration
Novel interactions with multimedia in-the-wild
Mobile collaborative techniques
Multimedia-based interaction techniques for remote assistance
Immersive multimedia experiences
Enabling technologies and novel modalities for remote collaborations through multimedia
Field trials, user studies and quality of experience in remote collaboration
Augmented reality enhancing remote collaboration
Collaborative environments enhanced with (large) interactive surfaces and devices
Integration of interactive surfaces and devices for immersive remote collaboration
Multi-device interaction for remote collaboration
Multi-sensory remote collaboration including touch, smell, taste, etc.
Experience
Program Chair
University of Oldenburg
Experience
A core matter of our research community is that multimedia data contributes to the user experience in a rich and meaningful manner. The topics organized in the “Experience” theme are concerned with innovative uses of multimedia to enhance the user experience, how this experience is manifested in specific domains, and metrics for qualitatively and quantitatively measuring that experience in useful and meaningful ways. We aim to explore novel paradigms of interacting and exploring multimedia in all facets and the interaction designs that drive and foster novel multimedia systems, services, and interfaces.
Areas
Perceptual multimedia
Ubiquituous multimedia
Novel Interactions with Multimedia
Social, emotional and affective multimedia
Multimedia Storytelling and Curation
Multimedia for Collaboration and Public Spaces
TPC Members
TBD
Area: Perceptual multimedia
Area Chairs
University of Modena
EPFL
National University of Singapore
In recent years, various applications in multimedia systems and services have seen tremendous developments. However, as has been discussed by many multimedia research publications, one area that still requires further investigations is how different forms of multimedia applications and experiences impact users. Studies focusing user perception of multimedia systems and applications are important as they are directly associated with users’ acceptance of new multimedia services and systems. As an emerging area, “Perceptual Multimedia” is focusing in on the broad view of multimedia perception and its growing design space for the creation of new multimedia systems and services. This area will especially focus on incorporating users’ perceptions into their system designs, for example, a customized and adaptive system developed to accommodate both right and left-handed users based on their perceptions and incorporate users’ multisensory perceptions during the design process.
Topics of interest
Area: Ubiquituous multimedia
Area Chairs
Telefonica Research Spain
Utrecht University Netherlands
DCU, Ireland
The term ubiquitous multimedia reflects the concept of multimedia services and applications becoming deeply ingrained in the fabric of day-to-day life and activities, to the point where on the go access to rich and interactive multimedia becomes the default user expectation in any context. Clearly this new paradigm will change the way in which we interact not only with multimedia content but with the world around us and other humans. In this theme, we are inviting submissions on novel multimedia processing, multimedia systems and applications that demonstrate the potential to push the community towards realizing the vision of ubiquitous multimedia.
Topics of interest
Area: Novel Interactions with Multimedia
Area Chairs
University of Stuttgart
University of Duisburg Essen
Multimedia content today is created, consumed and shared everywhere on a multitude of different devices in a networked world. A central challenge for creating more positive and compelling user experiences is to let users interact with multimedia with techniques that go beyond classic search and retrieval methods. Novel interaction paradigms and techniques are needed that provide intuitive and effective interaction with multimedia content in a pervasive manner. Interaction should be designed to seamlessly adapt to different contexts, devices and user intentions. Contributions in this area will be concerned with inventing, designing, implementing and evaluating interfaces for novel and pervasive interactions with multimedia from a user-centered perspective.
Topics of interest
Area: Social, emotional and affective multimedia
Area Chairs
University of Augsburg
University of Glasgow
A lot of multimedia systems capture human behavior, and in particular, social and emotional signals. These systems would therefore benefit from the ability to automatically interpret and react to the social and emotional context. The interpretation, analysis, and synthesis of social and emotional signals requires a different expertise that draws from a combination of signal processing, machine learning, pattern recognition, behavioral and social psychology and cognitive science. Analyzing multimedia content, where humans spontaneously express and respond to social or affect signals, helps to attribute meaning to users’ attitudes, preferences, relationships, feelings, personality, etc., as well as to understand the social and affective context of activities occurring in people’s everyday life.
This area focuses on the analysis of emotional, cognitive (e.g. brain-based) and interactive social behavior in the spectrum of individual to small group settings. It calls for novel contributions with a strong human-centered focus specializing in supporting or developing automated techniques for analyzing, processing, interpreting, synthesizing, or exploiting human social, affective and cognitive signals for multimedia applications. Special emphasis is put on multimodal approaches leveraging multiple streams when analyzing the verbal and/or non-verbal social and emotional signals during interactions. These interactions could be remote or co-located, and can include e.g. interactions between multiple people, humans with computer systems/robots, or humans with conversational agents.
Topics of interest
Area: Multimedia Storytelling and Curation
Area Chairs
University of Amsterdam
Centrum Wiskunde & Informatica
This area addresses two interrelated fields within the creative sector, namely the curation of artistic exhibitions, collections, or archives, and interactive storytelling. Both fields make use of various media, request complex and creative authoring processes, and result in narration oriented end products. The related communities are interdisciplinary and highly dynamic, covering narrative studies, computer science, interactive and immersive technologies, the arts, and creativity. They converge to develop new expressive forms in various of domains.
We welcome contributions from a large range of fields and disciplines related to interactive storytelling, including computational narrative, computer science, human-computer interaction, media studies and media production, game studies, game design and development, museum science, edutainment, virtual and augmented reality, cognitive science, digital humanities, interactive arts, and transmedia studies. We encourage original contributions presenting new scientific results, innovative theories, novel technological implementations, case studies, creative artistic projects, and possible applications in different domains.
Topics of interest
Area: Multimedia for Collaboration and Public Spaces
Area Chairs
TU Darmstadt
Deutsche Bank
The experience gap between being present in a meeting and participating remotely has not narrowed much in the last four decades, other than in terms of higher definition video. It is time for multimedia based collaboration to go beyond video-conferencing. Immersive and tangible technologies may be considered, and there is a quest for novel software based multimedia solutions for both synchronous and asynchronous collaboration. What applies to multimedia for distributed meetings also applies to other kinds of cooperative settings and to multimedia in public spaces. Different modalities must be further explored in the interface for groups and their members, whether they cooperate tightly, loosely, or even in passing such as in public. As to public spaces, multimedia has started to move out into the wild and to be present in many public areas, covered and open; more and more, multimedia content is publicly presented or shared and used with larger communities in urban and community spaces. This field, too, calls for novel approaches and disruptive concepts.
Topics of interest