Program Chair

Susanne Boll
University of Oldenburg


A core matter of our research community is that multimedia data contributes to the user experience in a rich and meaningful manner. The topics organized in the “Experience” theme are concerned with innovative uses of multimedia to enhance the user experience, how this experience is manifested in specific domains, and metrics for qualitatively and quantitatively measuring that experience in useful and meaningful ways. We aim to explore novel paradigms of interacting and exploring multimedia in all facets and the interaction designs that drive and foster novel multimedia systems, services, and interfaces.


Perceptual multimedia
Ubiquituous multimedia
Novel Interactions with Multimedia
Social, emotional and affective multimedia
Multimedia Storytelling and Curation
Multimedia for Collaboration and Public Spaces

TPC Members


Area: Perceptual multimedia

Area Chairs

Rita Cucchiara
University of Modena
Nimesha Ranasinghe
National University of Singapore

In recent years, various applications in multimedia systems and services have seen tremendous developments. However, as has been discussed by many multimedia research publications, one area that still requires further investigations is how different forms of multimedia applications and experiences impact users. Studies focusing user perception of multimedia systems and applications are important as they are directly associated with users’ acceptance of new multimedia services and systems. As an emerging area, “Perceptual Multimedia” is focusing in on the broad view of multimedia perception and its growing design space for the creation of new multimedia systems and services. This area will especially focus on incorporating users’ perceptions into their system designs, for example, a customized and adaptive system developed to accommodate both right and left-handed users based on their perceptions and incorporate users’ multisensory perceptions during the design process.

Topics of interest

  • Digital Multimedia Perception and Design space
  • Perceptual Systems in Multimedia
  • Perceptual semantics and classifications
  • Quality of experience in perceptual multimedia
  • Perceptual multimedia and user requirements
  • Multi-modal interaction techniques and impact on perceptual multimedia
  • Ubiquitous, Wearable and Mobile technologies for perceptual multimedia
  • Novel sensorial media including haptic, taste, smell, etc.
  • Perceptual multimedia in virtual, augmented and mixed realities
  • Brain-computer interface in perceptual multimedia
  • Safety, Ethics, Trust, Privacy and Security Aspects of perceptual multimedia
  • Human-factor studies, field studies and user studies of perceptual multimedia
  • Measuring user experience with regards to human perception

Area: Ubiquituous multimedia

Area Chairs

Nuria Oliver
Telefonica Research Spain
Wolfgang Huerst
Utrecht University Netherlands
Noel O Connor
DCU, Ireland

The term ubiquitous multimedia reflects the concept of multimedia services and applications becoming deeply ingrained in the fabric of day-to-day life and activities, to the point where on the go access to rich and interactive multimedia becomes the default user expectation in any context. Clearly this new paradigm will change the way in which we interact not only with multimedia content but with the world around us and other humans. In this theme, we are inviting submissions on novel multimedia processing, multimedia systems and applications that demonstrate the potential to push the community towards realizing the vision of ubiquitous multimedia.

Topics of interest

  • “Multimedia in the Wild”, incl. novel interface paradigms for interacting with multimedia applications and services while on-the-go e.g. on mobile and wearable devices or in vehicles
  • Ubiquitous multimedia at home, embedded systems for multimedia, Internet of Things and multimedia
  • Mobile and ubiquitous multimedia applications, services and systems
  • Virtual, mixed and Augmented Reality multimedia services and applications
  • Multimedia games, entertainment and advertising that demonstrate novel ways of interacting with the environment or others
  • Wearables, tangible and embodied interaction, physical computing
  • Mobile multimedia services and applications
  • Context-aware and location-based mobile and ubiquitous multimedia
  • User studies in ubiquitous multimedia (qualitative and quantitative)
  • User-centric models and design of ubiquitous multimedia services and applications

Area: Novel Interactions with Multimedia

Area Chairs

Niels Henze
University of Stuttgart
Jürgen Ziegler
University of Duisburg Essen

Multimedia content today is created, consumed and shared everywhere on a multitude of different devices in a networked world. A central challenge for creating more positive and compelling user experiences is to let users interact with multimedia with techniques that go beyond classic search and retrieval methods. Novel interaction paradigms and techniques are needed that provide intuitive and effective interaction with multimedia content in a pervasive manner. Interaction should be designed to seamlessly adapt to different contexts, devices and user intentions. Contributions in this area will be concerned with inventing, designing, implementing and evaluating interfaces for novel and pervasive interactions with multimedia from a user-centered perspective.

Topics of interest

  • Ambient multimedia interfaces
  • Brain-computer interfaces for multimedia applications
  • Context-aware and migratory interfaces
  • Gesture- and motion-based interaction
  • Intelligent user interfaces for multimedia content
  • Interacting with public displays
  • Interaction with intelligent personal assistants
  • Interaction with multimedia games, entertainment and advertising
  • Interaction with multimedia in AR and VR applications
  • Mobile interaction for sharing multimedia content
  • Novel interactions with home entertainment
  • Pervasive interaction with real-world embedded multimedia
  • Physiological interfaces
  • Proximity-based interaction and adaptation
  • Sensor-based and tangible interaction with TV
  • Tangible UI for interacting with multimedia
  • Toolkits and software for novel multimedia interfaces

Area: Social, emotional and affective multimedia

Area Chairs

Elisabeth André
University of Augsburg
Alessandro Vinciarelli
University of Glasgow

A lot of multimedia systems capture human behavior, and in particular, social and emotional signals. These systems would therefore benefit from the ability to automatically interpret and react to the social and emotional context. The interpretation, analysis, and synthesis of social and emotional signals requires a different expertise that draws from a combination of signal processing, machine learning, pattern recognition, behavioral and social psychology and cognitive science. Analyzing multimedia content, where humans spontaneously express and respond to social or affect signals, helps to attribute meaning to users’ attitudes, preferences, relationships, feelings, personality, etc., as well as to understand the social and affective context of activities occurring in people’s everyday life.

This area focuses on the analysis of emotional, cognitive (e.g. brain-based) and interactive social behavior in the spectrum of individual to small group settings. It calls for novel contributions with a strong human-centered focus specializing in supporting or developing automated techniques for analyzing, processing, interpreting, synthesizing, or exploiting human social, affective and cognitive signals for multimedia applications. Special emphasis is put on multimodal approaches leveraging multiple streams when analyzing the verbal and/or non-verbal social and emotional signals during interactions. These interactions could be remote or co-located, and can include e.g. interactions between multiple people, humans with computer systems/robots, or humans with conversational agents.

Topics of interest

  • Human social, emotional, and/or affective cue extraction
  • Cross-media and/or multimodal fusion of interactive social and/or affective signals
  • The analysis of social and/or emotional behavior
  • Novel methods for the interpretation of interactive social and/or affective signals
  • Novel methods for the classification and representation of interactive social and/or emotional signals
  • Real-time processing of interactive social and emotional signals for interactive/assistive multimedia systems
  • Emotionally and socially aware dialogue modeling
  • Affective (emotionally sensitive) interfaces
  • Socially interactive and/or emotional multimedia content tagging
  • Social interactions and/or affective behavior for quality of delivery of multimedia systems
  • Collecting large scale affective and/or social signal data
  • Multimedia tools for affective or interactive social behavior
  • Facilitating and understanding ecological validity for emotionally and socially aware multimedia
  • Annotation, evaluation measures, and benchmarking
  • Dyadic or small-group interaction analysis in multimedia

Area: Multimedia Storytelling and Curation

Area Chairs

Frank Nack
University of Amsterdam
Britta Meixner
Centrum Wiskunde & Informatica

This area addresses two interrelated fields within the creative sector, namely the curation of artistic exhibitions, collections, or archives, and interactive storytelling. Both fields make use of various media, request complex and creative authoring processes, and result in narration oriented end products. The related communities are interdisciplinary and highly dynamic, covering narrative studies, computer science, interactive and immersive technologies, the arts, and creativity. They converge to develop new expressive forms in various of domains.

We welcome contributions from a large range of fields and disciplines related to interactive storytelling, including computational narrative, computer science, human-computer interaction, media studies and media production, game studies, game design and development, museum science, edutainment, virtual and augmented reality, cognitive science, digital humanities, interactive arts, and transmedia studies. We encourage original contributions presenting new scientific results, innovative theories, novel technological implementations, case studies, creative artistic projects, and possible applications in different domains.

Topics of interest

  • Technologies that help curators in selecting content
  • Services and technologies to search for content
  • Tools for exhibition design (virtual or real)
  • Tools for exhibition and collection design
  • Creativity support for curators
  • Case studies for large virtual curated collections
  • Human-computer interaction with narrative technologies
  • Approaches in content production technology
  • Collaborative storytelling environments and multi-user systems
  • Social, ubiquitous and mobile storytelling
  • Cinematic hypermedia, VR, and game technologies for interactive storytelling
  • Interactive cinema and television
  • Interactive non-fiction and interactive documentaries
  • Interactive narratives as tools for learning in teaching, e-learning, training, and edutainment
  • Interactive storytelling in role-play, larps, theatre, and improvisation
  • Hypermedia authoring and playback
  • Authoring tools for interactive digital storytelling, including collaborative authoring story/world generation and experience management
  • Quality of experience in multimedia storytelling
  • Narrative-related affect and emotion
  • Methods/frameworks for testing user experience in interactive storytelling
  • Methods/frameworks for testing story development
  • Normative evaluation of interactive storytelling applications
  • Computational understanding, analysis, and summarization of narratives, including natural language processing and computer vision

Area: Multimedia for Collaboration and Public Spaces

Area Chairs

Max Mühlhäuser
TU Darmstadt

The experience gap between being present in a meeting and participating remotely has not narrowed much in the last four decades, other than in terms of higher definition video. It is time for multimedia based collaboration to go beyond video-conferencing. Immersive and tangible technologies may be considered, and there is a quest for novel software based multimedia solutions for both synchronous and asynchronous collaboration. What applies to multimedia for distributed meetings also applies to other kinds of cooperative settings and to multimedia in public spaces. Different modalities must be further explored in the interface for groups and their members, whether they cooperate tightly, loosely, or even in passing such as in public. As to public spaces, multimedia has started to move out into the wild and to be present in many public areas, covered and open; more and more, multimedia content is publicly presented or shared and used with larger communities in urban and community spaces. This field, too, calls for novel approaches and disruptive concepts.

Topics of interest

  • Gesture- and tangible-based interaction for remote collaboration
  • Immersive multimedia interaction in public spaces
  • Interaction techniques for sync and async collaboration
  • Novel interactions with multimedia in-the-wild
  • Mobile collaborative techniques
  • Multimedia-based interaction techniques for remote assistance
  • Immersive multimedia experiences
  • Enabling technologies and novel modalities for remote collaborations through multimedia
  • Field trials, user studies and quality of experience in remote collaboration
  • Augmented reality enhancing remote collaboration
  • Collaborative environments enhanced with (large) interactive surfaces and devices
  • Integration of interactive surfaces and devices for immersive remote collaboration
  • Multi-device interaction for remote collaboration
  • Multi-sensory remote collaboration including touch, smell, taste, etc.