(Apologies for multiple postings) -------------------------------------------------------------------------------------------------- 13th International Summer Workshop on Multimodal Interfaces (eNTERFACE'17) July 03-28, 2017, Porto, Portugal. http://artes.ucp.pt/enterface17 Call for Participation Extended Submission Deadline: May 07, 2017(Firm) -------------------------------------------------------------------------------------------------- The Digital Creativity Centre (CCD), Universidade Catolica Portuguesa - School of Arts (Porto, Portugal) invites researchers from all over the world to join eNTERFACE'17, the 13th one-month Summer Workshop on Multimodal Interfaces. During this workshop, senior project leaders, researchers, and students gather in one single place to work in teams on pre-specified challenges for 4 weeks long. Each team has a project defined and will address specific challenges. Senior researchers, PhD students, or undergraduate students interested in participating to the Workshop should send their application by emailing before 7th of May 2017(extended) to enterface17(a)porto.ucp.pt (Guidelines for researchers applying to a project<http://artes.ucp.pt/enterface17/authors-kit/Guidelines.for.researchers.applying.to.a.project_eNTERFACE17.html>). Participants must procure their own travel and accommodation expenses. Information about the venue location and stay are provided on the eNTERFACE'17 website. Note that although no scholarships are available for PhD students, there are no application fees. The list of projects that participants can choose from is the following. How to Catch A Werewolf, Exploring Multi-Party Game-Situated Human-Robot Interaction Lead-Organizers: Catharine Oertel, KTH (PI), Samuel Mascarenhas, INESC-ID, Zofia Malisz, KTH, José Lopes, KTH, Joakim Gustafson, KTH In this project we will focus on the implementation of the roles of the "villager" and the "werewolves" using the IrisTK dialogue framework and the robot head Furhat. To be more precise, the aim of this project is to use multi-modal cues in order to inform the theory of mind model to drive the robot's decision making process. Theory of mind is a concept that is related to empathy and it refers to the cognitive ability of modeling and understanding that others have different beliefs and intentions than our own. In lay terms, it can be described as "to put oneself into another's shoes" and it is a crucial skill to properly play a deception game like "Werewolf". Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Proposal_Catharine.Oertel.pdf> KING'S SPEECH Foreign language: pronounce with style! Principal investigators: Georgios Athanasopoulos*, Céline Lucas* and Benoit Macq* (ICTEAM-ELEN - Université Catholique de Louvain, Belgium) The principal investigators are developing the GRAAL1 project which is concerned with developing a set of tools to facilitate self-training on foreign language pronunciation, with the first target being learning French. The goal of KING'S SPEECH is to develop new interaction modalities and evaluate them in combination with existing functionality aiming to better personalize GRAAL to the taste and specificities of each learner. This personalization will rely on a machine learning approach and an experimental set-up to be developed during eNTERFACE'17. The eNTERFACE'17 developments could be based on a karaoke scenario where the song is replaced by some authentic sentences (extracts of news, films, publicities, etc.). Applications like SingStar (Sony) or JustSing (Ubisoft) could also serve as a source of inspiration, e.g., using a smartphone as a microphone while interacting with avatars. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Project_King's%20speech.pdf> The RAPID-MIX API: a toolkit for fostering innovation in the creative industries with Multimodal, Interactive and eXpressive (MIX) technology Principal Investigators Francisco Bernardo, Michael Zbyszynski, Rebecca Fiebrink, Mick Grierson (EAVI - Embodied AudioVisual Interaction group, Goldsmiths University of London, Computing), Team Candidates Sebastian Mealla , Panos Papiotis (MTG/UPF - Music Technology Group, Universitat Pompeu Fabra), Carles Julia, Frederic Bevilacqua , Joseph Larralde (IRCAM - Institut de Recherche et Coordination Acoustique/Musique) Members of the RAPID-MIX project are building a toolkit that includes a software API for interactive machine learning (IML),digital signal processing (DSP), sensor hardware, and cloud-based repositories for storing and visualizing audio, visual, and multimodal data. This API provides a comprehensive set of software components for rapid prototyping and integration of new sensor technologies into products, prototypes and performances. We aim to investigate how developers employ and appropriate this toolkit so we can improve it based on their feedback. We intend to kickstart the online community around this toolkit with eNTERFACE participants as power users and core members, and to integrate their projects as demonstrators for the toolkit. Participants will explore and use the RAPID-MIX toolkit for their creative projects and learn workflows for using embodied interaction with sensors Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Project_RAPID-MIX.pdf> Prynth Principal investigator: Ivan Franco (IDMIL / McGill University) Prynth is a technical framework for building self-contained programmable synthesizers, developed by Ivan Franco at the Input Devices and Music Interaction Lab (IDMIL) of McGill University. The goal of this new framework is to support the rapid development of a new breed of digital synthesizers and their respective interaction models. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Proposal_prynth.pdf> End-to-End Listening Agent for Audio-Visual Emotional and Naturalistic Interactions Principal Investigators: Kevin El Haddad (TCTS Lab - numediart institute - University of Mons, Belgium), Yelin Kim (Inspire Lab - University at Albany, State University of New York, USA), Hüseyin Çakmak (TCTS Lab - numediart institute - University of Mons, Belgium) In this project, we aim at building a listening agent that would react with a naturalistic and human-like behavior and using nonverbal expressions to a user. The agent's behavior will be modeled by and built on three main components: recognizing and synthesizing emotional and nonverbal expressions, and predicting the next expression to synthesize based on the currently recognized expressions. Its behavior will be rendered on a previously developed avatar which will also be improved during this workshop. At the end we should obtain functioning and efficient modules which ideally should work in real-time. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Proposal_listening%20agent.pdf> Cloud-based Toolbox for Computer Vision Principal investigator: Dr. Sidi Ahmed MAHMOUDI from the Faculty of Engineering at the University of Mons. Belgium. Candidates: Dr. Fabian LECRON, PhD, Faculty of Engineering at the University of Mons. Belgium, Mohammed Amin BELARBI, PhD Student, Faculty of Exact sciences and Mathematics, University of Mostaganem, Algeria, Mohammed EL ADOUI, PhD Student, Faculty of Engineering, University of Mons, Belgium, Abdelhamid DERRAR, Student in Master University of Lyon, France, Pr. Mohammed BENJELLOUN, PhD, Faculty of Engineering, University of Mons, Belgium, Pr. Said MAHMOUDI, PhD, Faculty of Engineering, University of Mons, Belgium. Nowadays, images and videos have been present everywhere, they can come directly from camera, mobile devices or from other peoples that share their images and videos. The latter are used to present and illustrate different objects in a large number of situations (public areas, airports, hospitals, football games, etc.). This makes from image and video processing algorithms a very important tool used for various domains related to computer vision such as video surveillance, human behavior understanding, medical imaging and database (images and videos) indexation methods. The goal of this project is develop an extension of our cloud platform (MOVACP) developed in the previous edition of eNTERFACE'16 workshop. The latter integrated several image and video processing applications. The users of this platform can use these methods without having to download, install and configure the corresponding software. Each user can select the required application, load its data and retrieve results, with an environment similar to desktop. Within eNTERFAC'17 workshop, we would like to improve and develop four main tools for our platform: 1. Integration of the major image and video processing algorithms that could be used by guests to perform their own applications. 2. Integration of machine learning methods (used for images and videos indexation) that exploit the uploaded data of users (is they accept of course) in order to improve the results precision. 3. Fast treatment of data acquired from IOT systems. 4. Development of an online 3D viewer that could be used for the visualization of 3D reconstructed medical images. 4. Fast treatment of data acquired from distant IoT systems. Keywords cloud computing, image and video processing, video surveillance, medical imaging. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Project_CMP.pdf> Across the virtual bridge Project Coordinators: Thierry RAVET (software design, motion signal processing, machine learning), Fabien GRISARD (software design, human-computer interface), Ambroise MOREAU (computer vision, software design), Pierre-Henri DE DEKEN (software design, game engine) - Numediart Institute, University of Mons, Belgium. The goal of the project is to explore different ways of creating interactions between people evolving in the real world (local players) and people evolving in a virtual representation of the same world (remote players). This latter one will be explored thanks to a virtual reality headset while local players will be geo-located through an app on a mobile device. Actions executed by remote players will be perceived by local players in the form of a sound or visual content and actions performed by local players will impact the virtual world as well. Local players and remote players will be able to exchange information with each other. Keywords: Virtual world, mixed reality, computer-mediated communication . Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Project_AcrossTheVirtualBridge.pdf> ePHoRt project: A telerehabilitation system for reeducation after hip replacement surgery Principal investigators: Yves Rybarczyk (Nova University of Lisbon, Portugal), Arián Aladro (Universidad de las Américas, Ecuador), Mario Gonzalez (Health and Sport Science from University of Zaragoza - Spain), Santiago Villarreal (Universidad de las Américas - Quito, Ecuador), Jan Kleine Detersa (University of Twente in Human Media Interaction) This project aims to develop a web-based system for the remote monitoring of rehabilitation exercises in patients after hip replacement surgery. The tool intends to facilitate and enhance the motor recovery, due to the fact that the patients will be able to perform the therapeutic movements at home and at any time. As in any case of rehabilitation program, the time required to recover is significantly diminished when the individual has the opportunity to practice the exercises regularly and frequently. However, the condition of such patients prohibits transportations to and from medical centres and many of them cannot afford a private physiotherapist. Thus, low-cost technologies will be used to develop the platform, with the aim to democratize its access. For instance, the motion capture system will be based on the Kinect camera that provides a good compromise between accuracy and price. The project will be divided into four main stages. First, the architecture of the web-based system will be designed. Three different user interfaces will be necessary: (i) one to record quantitative and qualitative data from the patient, (ii) another for the therapist consulting the patient's performance and adapting the exercises accordingly, and (iii) for the physician having a medical supervision of the recovery process. Second, it will be essential to develop a module that performs an automatic assessment and validation of the rehabilitation activities, in order to provide a real-time feedback to the patient regarding the correctness of the executed movements. Third, we also intend to make use of a serious game and affective computing approaches, with the intention of motivating the user to perform the exercises for a sustainable period of time. Finally, an ergonomic study will be carried out, in order to evaluate the usability of the system. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Proposal_Full_proposal_YR.pdf> Big Brother can you find, classify, detect and track us ? Principal investigators: Marc Décombas, Jean Benoit Delbrouck (TCTS Lab - University of Mons, Belgium) In this project, we will build a system that can detect, recognize objects or humans and describe them as much as possible on video. Objects may be moving as well as the people coming in and out of the visual field of the camera(s). Our project will be split into three main tasks : detection and tracking, people re-identification, image/video captioning The system should work in real time and should be able to detect people and follow them, re-identify them when they come back in the field and give a textual description of what each people is doing. Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.Final%20Proposal_BigBrother.pdf> Networked Creative Coding Environments Principal investigator: Andrew Blanton, Digital Media Art at San Jose State University As a part of ongoing research Andrew Blanton will present a workshop using Amazon Web Servers for the creation of networked art. The workshop will demonstrate sending data from Max/MSP to a Unix based Amazon Web Server and receiving data into a p5.js via websockets. The workshop will explore the critical discourse surrounding data as a borderless medium and the ideas and potentials of using a medium that can have global reach . Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.FinalProposal_NCCE.pdf> AUDIOVISUALY EXPERIENCE THROUGH IMAGE HOLOGRAPHY Principal investigator: Maria Isabel Azevedo ( ID+ Research Institute for Design, Media and Culture, University of Aveiro), Elizabeth Sandford-Richardson ( University of the Arts, Central Saint Martins College of Art and Design Today in interactive art, there are not only representations that speak of the body but actions and behaviours that involve the body. In digital holography, the image appears and disappears from the observer's vision field; because the holographic image is light, we can see multidimensional spaces, shapes and colours existing on the same time, presence and absence of the image on the holographic plate. And the image can be flowing in front of the plate that sometimes people try touching it with his hands. That means, to the viewer will be interactive events, with no beginning or end that can be perceived in any direction, forward or backward, depending on the relative position and the time the viewer spends in front of the hologram. In this workshop we are proposing an audiovisual interactive installation composed by four digital holograms and spatial soundscape. When viewers move in front of each hologram, different sources of sound are trigger. The outcome will be presented in the last week of July with an invited performer. We are looking for sound designers and interaction programmers. Keywords: Digital holographic image, holographic performance, sound spatialization, motion capture Full Project Description<http://artes.ucp.pt/enterface17/proposals/02.FinalProposal_holo.pdf> Study of the reality level of VR simulations Principal investigators: Andre Perrotta, UCP/CITAR We propose to develop a VR simulation based on 360o video, spatialized audio and force feedback using fans and motors, of near collision experiences of large vehicles on a first person perspective, to be experienced by users wearing head-mounted stereoscopic VR gear in a MOCAP (motion capture) enabled environment that enables a one-to-one relationship between real and virtual worlds. ............................................................ AVISO DE CONFIDENCIALIDADE Esta mensagem (incluindo quaisquer anexos) pode conter informação confidencial ou legalmente protegida para uso exclusivo do destinatário. Se não for o destinatário pretendido da mesma, não deverá fazer uso, copiar, distribuir ou revelar o seu conteúdo (incluindo quaisquer anexos) a terceiros, sem a devida autorização. Se recebeu esta mensagem por engano, por favor informe o emissor, por e-mail, e elimine-a imediatamente. Obrigado. ............................................................ CONFIDENTIALITY NOTICE This message may contain confidential information or privileged material, and is intended only for the individual(s) named. If you are not the named addressee, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. Thank you.