in|situ| is both an INRIA project and a LRI/CNRS (University of Paris-Sud) research team. Faculty members are then from several affiliations.

Head

Wendy Mackay
Research Director (DR1) at INRIA

Faculty Members

Caroline Appert
Research Scientist (CR2) at CNRS

Michel Beaudouin-Lafon
Professor at Univ Paris-Sud

Anastasia Bezerianos
Assistant Professor at Univ Paris-Sud

Olivier Chapuis
Research Scientist (CR1) at CNRS

Stéphane Huot
Associate Professor at Univ Paris-Sud

Theophanis Tsandilas
Research Scientist (CR2) at INRIA

Alexandra Merlin, Administrative Assistant

Post-Doctoral Fellows and Engineers

• Lora Oehlberg, Post-Doc at INRIA
• Halla Olafsdottir, Post-Doc at Univ Paris-Sud
• Romain Primet, Research Engineer at INRIA
• Monireh Sanaei? , Engineer at INRIA
• Daniel Spelmezan, Post-Doc at INRIA

Graduate Students

PhD

• David Bonnet (PhD, Univ Paris-Sud -- MENRT)
• Jérémie Garcia (PhD, Univ Paris-Sud -- MENRT)
• Can Liu (PhD, DigiCosme -- INRIA, Univ Paris-Sud & CNRS)
• Cyprien Pindat (PhD, Univ Paris-Sud -- MENRT)
• Daniel Strazzulla (PhD, INRIA -- CORDI)

Intern

• Jessalyn Alvina? (Intern, Univ Paris Sud)
• Stephan Delarue? (Intern, Univ Paris Sud)
• Evanthia Dimara? (Intern, Inria)
• Magdalini Grammatikou? (Intern, Inria)
• Thibaut Jacob? (Intern, Inria)
• Ghita Jalal? (Intern, Inria)
• Antoine Ponsard? (Intern, Inria)

Master

• Olivier de Cramer? (Master student, Univ. Paris Sud)
• Mickaël Guilbeaud? (Master student, Univ. Paris Sud)

Visiting Scientists

• Karla Felix Navarro (University of Technology, Sydney) - nov-dec 2011
• Audrey Girouard (Tufts University, USA) - sept-nov 2008
• Rob Jacob (Tufts University, USA) - feb-june 2008
• Clemens Nylandsted Klokmose (Univ. of Aarhus, Denmark) - nov 2007 - apr 2008
• Danielle Lottridge (Univ. of Toronto, Canada) - january-july 2006
• Andy Cockburn (Univ. of Canterbury, New Zealand) - sept-oct 2006
• Catherine Plaisant (Univ. of Maryland, USA) - oct 2006
• Ravin Balakrishnan (Univ. of Toronto, Canada) - june-july 2006
• Evelyn Eastmond (MIT, USA) - 2006
• Jacob Eisenstein (MIT, USA) - 2005
• Wolfgang Stürzlinger (York University, Canada) - feb 2005
• Saul Greenberg (Univ. of Calgary, Canada) - sept-oct 2003
• Martin Tomitsch (TU Vienna, Austria) - may-june, sept-nov 2003
• Shumin Zhai (IBM Almaden Research Center, USA) - june-aug 2002
• Dennis Pasveer (Univ. Catholique de Nijmegen, Netherlands) - jan-aug 2002

Alumni

• María Jesús Lobo Günther? (Master student, Pontificia Universidad Catolica de Chile & INRIA)
• Julie Wagner (PhD, INRIA -- CORDI)
• Mathieu Nancel (PhD, Univ Paris-Sud -- Digiteo)
• Emilien Ghomi (PhD, Univ Paris-Sud -- MENRT)
• Jerônimo Barbosa (Intern INRIA)
• Lei Chen (Intern INRIA)
• Stelios Frantzeskakis (Intern INRIA)
• Emmanuel Pietriga (Research Scientist (CR1) at INRIA)
• Claude Puech (Professor at Univ Paris-Sud)
• Rodrigo Andrade de Almeida (Engineer at INRIA)
• Arjit Gupta (Engineer at INRIA)
• Ilaria Liccardi, Post-Doc at INRIA
• Guillaume Faure (PhD, Univ Paris-Sud -- MENRT)
• Clément Pillias (Research Engineer at INRIA)
• Pierre Rossines (MSc, Univ Paris-Sud)
• Julien Altieri (Intern, Ecole Polytechnique)
• Philippe Laulheret (Intern, Supélec)
• James R Eagan, (Post-Doc, Univ Paris-Sud)
• Clemens Nylandsted Klokmose, (Post-Doc, Univ Paris-Sud)
• Guillaume Besacier (PhD, 2010)
• Quentin Roy (MSc, Univ Paris-Sud)
• Olivier Bau (PhD, 2010)
• Tony Gjerlufsen (PhD, Univ. of Aarhus)
• Benjamin Bach (Intern, INRIA)
• Joao Soares De Oliveira Neto (PhD, Univ. )
• Aurélien Tabard (PhD, 2009)
• Catherine Letondal (Expert Engineer, ENAC)
• Nicolas Roussel (Research Director, INRIA)
• Sofiane Gueddana (PhD, 2009)
• Nicolas Masson (PhD, 2009)
• Rémi Cardona (Engineer)
• François Forest (Engineer)
• Audrey Girouard (PhD, Tufts University)
• Danielle Lottridge (PhD, Univ. of Toronto)
• Yuan Sheng Qiong (PhD, Wuhan Univ., China)
• Jérôme Lard (PhD, 2008)
• Yann Riche (PhD, 2008)
• Jean-Baptiste Labrune (PhD, 2008)
• Jean-Daniel Fekete (Research Director, INRIA)
• The Nhan Luong (Engineer)
• Nathalie Henry (PhD, 2007)
• Emmanuel Nars (PhD, 2007)
• Renaud Blanch (PhD, 2005)
• Jean-René Courtois (Engineer)

• Computer Aided Composition

Publications

Welcome to in|situ|

Version française...

Directions to the lab

See the Contact page on this site.

To arrive by public transit, take the RER B to Le Guichet. Head to the north exit for the train station, and turn right, and then right again at the intersection. To the left there's a walking ramp that goes down to the bus station. From here you can catch a #9 bus which will take you to the Pôle d'Ingénierie.

ViaNavigo is a good site for helping you plan your trip to and from PCRI.

You will need

Access Badge

You should pick up your Access badge from Alexandra on your first day (it's a nondescript white RFID card in a plastic case). This card will get you into the building and through the walkways between the North and South buildings.

Door Access Codes

The doors at PCRI generally have one of two access codes. Doors can be kept unlocked by typing the code followed by a press on F before turning the door knob. Pressing F a second time will lock it again. If you are the last one to leave a room, please close and lock the door behind you.

Cantine Card

Alexandra will give you a form which you need to sign and give to the cashier at the Cantine (called the CESFO restaurant) on your first day (along with 20€). You will then receive a card attached to an account used to pay your lunches. You can fund this account by credit card here or by cash directly to the cashier.

Computer Account (LRI & INRIA)

Talk to Stéphane about getting access to this wiki. This allows you to access in|situ| internal resources (such as this wiki). Talk to Alexandra about getting a login for INRIA Saclay accounts -- this allows you to access your @lri.fr email account, and the INRIA Saclay intranet site.

Email Account

You should be able to login to INRIA's Zimbra system using your INRIA Saclay account information (see above). In the Preferences section, you can also change the language of the system to English (if you would rather interact in English instead of French).

You can access to your LRI webmail using your LRI account information.

Setting up Printers

There is one color laser printer in the printing lounge across from Alexandra's office. You need to download the drivers (available for all systems). The printer name is TOSHIBA e-STUDIO3040C-07588010. When adding the printer in your system, please make sure that the Saddle Stitch Finisher is activated. This will let you choose the "Stapling" option that appears in the printing dialog in the "Printer Features" section. Note that, in order to be able to print, you need to be connected to the PCRI local ethernet network.

You will find other printers (for posters) and printing furnitures in room 259. More information is available on this page.

Accessing Online Digital Libraries

Set up a proxy for your browser for: http://istpac.inrialpes.fr/pac/sac.pac

Also, some publishers' content is only available through the INRIA portal.

Bienvenue à in|situ|

English version...

Event Builder - Creating a tool to ease the design of effective gesture recognizers

Internship proposal at in|situ|

Advisors: Caroline Appert and David Bonnet

Presentation slides

Description

User events, that we define as recognized user activity, are one of the buildings bricks of human-computer interaction. They are produced by recognition algorithms and are used to trigger commands. They can be grouped into vocabulary of events in which they need to be mutually compatible, both for the user (he must be able to consciously perform the actions for each event) and the system (it needs to distinguish the different user actions to produce the adequate event).

As discrete sensors (buttons, keys, switches, etc.) offer little ambiguity regarding the event to produce, this is not the case for continuous sensors which are predominant on mobile devices (touchscreen, accelerometer, gyroscope, microphone, camera, compass, light sensor, pressure sensor, etc.) as their range of values can capture a large amount of user actions and thus make the creation of appropriate recognizers very challenging.

The goal of this internship is to participate in building a tool (code-named Event Builder) that will ease the design of effective recognizers. By effective, we mean that it will not confound the newly introduced user action with existing ones and that it will not need any user training nor calibration.

Among the main features, this tool will allow the visualization of live and recorded sensor data and provide a quick iteration process where the testing and calibration phases are merged and done in real-time. Another interesting aspect of this tool is that it will only be operated by direct manipulation through either mouse or touch input. Therefore, algorithms are not written textually by hand but extracted from the captured data through visual transformations. Finally, to handle the support of different platforms and to provide maximum flexibility, its development will target web browsers and leverage all the expressivity they provide.

Depending on the profile and the duration of the internship, it is possible to focus on one or several of the following aspects:

• a visualization part consisting in prototyping interesting representations of various data sensors ;
• a technical part that pushes the constraints of live editing and debugging across different devices ; and
• a design part in which a visual vocabulary and a user interface will be iteratively built.

Required skills

Motivated, open-minded, general knowledge about human-computer interaction, good programming habits, some experience in web development.

References

1. Victor, B. Learnable Programming: Designing a programming system for understanding programs. (2012)
2. Ashbrook, D. and Starner, T. MAGIC: a motion gesture design tool. Proc. CHI '10, ACM (2010), 2159–2168.
3. Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S.R. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. Proc. CHI '07, ACM (2007), 145–154.
4. Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton++: a customizable declarative multitouch framework. Proc. UIST '12, ACM (2012), 477–486.
5. Long, A.C., Landay, J.A., and Rowe, L.A. Quill: a gesture design tool for pen-based user interfaces. Technical Report, 2001.
6. Lü, H. and Li, Y. Gesture coder: a tool for programming multi-touch gestures by demonstration. Proc. CHI '12, ACM (2012), 2875–2884.
7. Williamson, J. and Murray-Smith, R. Rewarding the original: explorations in joint user-sensor motion spaces. Proc. CHI '12, ACM (2012), 1717–1726.

Event Builder - Réalisation d'un outil facilitant la création de reconnaisseurs de gestes efficaces

Proposition de stage à in|situ|

Encadrants: Caroline Appert et David Bonnet

Diapos de présentation

Description

Les événements utilisateur, que nous définissons comme la reconnaissance par le système d'une activité de l'utilisateur, constituent l'une des briques de base de l'interaction homme-machine. Ils sont produits par des algorithmes de reconnaissance et utilisés pour déclencher des commandes. Ils peuvent être regroupés en vocabulaires d'événements au sein desquels ils doivent être compatibles entre eux, à la fois pour l'utilisateur (il doit être capable de réaliser les actions correspondant à chaque événement) et le système (il doit pouvoir distinguer les différentes actions de l'utilisateur afin de produire l'événement correspondant).

Si les capteurs à entrée discrète (bouton, touche de clavier, switch, etc.) offrent que peu d'ambiguïté sur la nature de l'événement à produire, il en va autrement pour les capteurs à entrée continue qui sont prédominants sur les appareils mobiles (écran tactile, accéléromètre, gyroscope, microphone, caméra, boussole, capteur de luminosité, de pression, etc.), où l'espace de contrôle qu'ils proposent permet de capturer un très grand nombre d'actions rendant alors difficile la réalisation de systèmes de reconnaissance appropriés.

Le but de ce stage est de participer à la réalisation d'un outil (nom de code Event Builder) qui permet de faciliter la réalisation de systèmes de reconnaissance efficaces. Par efficace, nous entendons qu'il ne confondra pas l'action utilisateur nouvellement introduite pour lequel il a été construit par ceux existant déjà et qu'il ne nécessitera pas d'apprentissage ou de calibration de la part de l'utilisateur.

Les fonctions phares de cet outil concernent la visualisation de mesures provenant des capteurs, soit en direct ou à partir d'enregistrements, ainsi qu'un processus itératif où les phases de tests et d'ajustements sont fusionnéss et réaliséss en temps réel. Un autre aspect intéressant est que cet outil sera utilisé uniquement par manipulation directe à la souris ou au doigt. De ce fait, les algorithmes ne sont pas écrits textuellement à la main mais extraits depuis les mesures capturées au travers de transformations visuelles. Enfin, pour s'affranchir des contraintes de plateformes et obtenir un maximum de flexibilité, son développement visera les navigateurs web et tirera profit de toute l'expressivité qu'ils proposent.

En fonction du profil et de la durée du stage, il est possible de se focaliser sur un ou plusieurs des aspects suivants:

• une partie visualisation qui consiste à réaliser d'intéressantes représentations de mesures provenant de capteurs variés,
• une partie technique repoussant les contraintes de l'édition et du test en temps-réel sur plusieurs appareils, et
• une partie design où un vocabulaire visuel et une interface utilisateur sont conçues par itérations successives.

Compétences requises

Motivation, ouverture d'esprit, connaissances générales en interaction homme-machine, bonnes habitudes de programmation, quelques notions en développement web.

Références

1. Victor, B. Learnable Programming: Designing a programming system for understanding programs. (2012)
2. Ashbrook, D. and Starner, T. MAGIC: a motion gesture design tool. Proc. CHI '10, ACM (2010), 2159–2168.
3. Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S.R. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. Proc. CHI '07, ACM (2007), 145–154.
4. Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton++: a customizable declarative multitouch framework. Proc. UIST '12, ACM (2012), 477–486.
5. Long, A.C., Landay, J.A., and Rowe, L.A. Quill: a gesture design tool for pen-based user interfaces. Technical Report, 2001.
6. Lü, H. and Li, Y. Gesture coder: a tool for programming multi-touch gestures by demonstration. Proc. CHI '12, ACM (2012), 2875–2884.
7. Williamson, J. and Murray-Smith, R. Rewarding the original: explorations in joint user-sensor motion spaces. Proc. CHI '12, ACM (2012), 1717–1726.

If you are interested in a particular topic you would like to work on at in|situ|, do not hesitate to contact one of the faculty members directly by email.

Post-doc positions

"Multi-dimensional" gestures
Contact: Caroline Appert

For more details about post-doc positions, contact us. Note that we currently have fundings for 2 one-year post-doc positions.

Thèse / PhD

Engineering of Web applications
Advisor: Michel Beaudouin-Lafon (mbl@lri.fr)

La loi de Fitts en situation réelle et au laboratoire / Fitts' law in the wild and in the lab
Advisor: Olivier Chapuis (chapuis@lri.fr)

Stages de Master / Master Internships

Focus+Context representation and path following
Advisors: Caroline Appert and Olivier Chapuis

Linking visual perception and interactive tasks on wall displays
Advisors: Anastasia Bezerianos and Olivier Chapuis

Loi de Fitts pour des trajectoires non rectilignes / Fitts' law for non rectilinear trajectories
Advisor: Olivier Chapuis (chapuis@lri.fr)

Gestural commands for mobile devices
Advisor: Caroline Appert (appert@lri.fr) and Theophanis Tsandilas (fanis@lri.fr)

Hydrascope - From web applications to hyper applications
Advisor: Michel Beaudouin-Lafon

PointerGlide - Pointing by flying
Advisor: Michel Beaudouin-Lafon with Stéphane Huot and Pierre Dragicevic

Instrumental Interaction - Exploring a new interaction paradigm
Advisor: Michel Beaudouin-Lafon

HCID 252
14h-17h
Bldg 640
Room E 213

Instructor:

Lora Oehlberg

Schedule

Session 1 : Sketching, Mindmapping, Design Journals
Thursday, January 10

Reading:

"Mind Mapping", Rolf Faste Foundation
Sketching & Cartooning, Lora Oehlberg
"Sketching in 2-point perspective", Lora Oehlberg

Due in-class: Design Journal Mindmap

Session 2 : Portfolios & Improvisation
Thursday, January 17

Resources on Portfolios:

Reading on Improvisation:

"Use of Improvisational Drama Exercises in Design Education", Rolf Faste Foundation
"Using improvisation to enhance the effectiveness of brainstorming", Elizabeth Gerber. CHI 2009.
"Improvisation principles and techniques for design", Elizabeth Gerber. CHI 2007.
Improv Encyclopedia

Due in Class: Week 1 Reflection, Improv Glossary Presentation, Improv Exercise Introduction

Session 3 : Brainstorming & Critique
Thursday, January 24

"How to write an effective design brief", Clear Design "Writing a Design Brief", UK Design Council

Due in Class: Week 2 Reflection, Brainstorming prompts

Session 4: Graphic Design & Midterm "Show and Tell"
Thursday, January 31

Session 5 : Graphic Design II & Physical Prototyping

Thursday, January 7

Session 6 : Guest Lecturer – Nicolas Gaudron
''Tuesday, February 12 (SPECIAL PLACE LRI/PCRI room 455)

Session 7 : Guest Lecturer – Nicolas Gaudron
week of February 18 (SPECIAL TIME 9 a.m. - 11 a.m., SPECIAL PLACE LRI/PCRI room 445)

Session 8 : Final Presentations
Thursday, February 28 (SPECIAL PLACE, LRI/PCRI room 445)

Request List: What do you hope to learn in this course?

from questionnaire on first week of class

• Collaboration & Creativity (3): "benefit from others' ideas", "push my (and my team's) creativity to the maximum possible", "how to exchange views with others"
• Beauty (2): "How to do beautiful stuff", "How to make beautiful and original designs"
• Creativity Theory & Research (2): "State of Research", "Theory/research about creativity"
• Methods & Techniques (2): "Methodology approaches to being creative (although the idea of confining to methodology is in itself not being creative)", "Methods to apply when we get stuck in one direction"
• Ideation (3): "Learning to make something out of lots of ideas; learning what to take into account", "How to generate great ideas and make a good design based on those ideas", "How to evaluate my own ideas and keep coming up with better ones"
• FUN (2): "Have fun", "something different & fun & inspiring"
• Discovery (1) : "Improve existing creative skills and find new ones I didn't know about"
• ETC.
  • "Some graphic design theory and practice"
  • "Guideline of methods or hints to guess what is useful for end users and how to make it real"
  • "How not to make bad/horrible designs"

Grading:

Assignments will be primarily graded on participation. Creative practice requires enthusiastically embracing new, unknown experiences, and by actively participating in generative exercises. Quality does not matter as much as quantity.

There will also be opportunities to earn bonus points on novelty. If you come up with 110 ideas instead of 100, you'll still get 10/10 points. But if you decide to turn your list of ideas into a 100-line rhyming poem, you will get +1 surprise points (11/10). Challenge yourself to stand out from your peers, to be different. This does not necessarily mean extraordinary amounts of extra work, or even a better quality end result – it primarily requires willingness to put in extra thought and to take a risk.

Final Project:

• In total, you will select and complete 4 of the mini-projects listed below.
• Be prepared to present your project to the course; in addition to an in-person presentation, have "portfolio-worthy" documentation of each of your projects.
• You must present at least one project at our Midterm "Show and Tell" on January 31.
• The rest of the projects will be presented at the Final "Show and Tell" on February 28.
• You may submit your projects for instructor critique on January 24, February 7, or February 14. You are encouraged to revise and iterate upon your designs.

1. Keep a rich design journal for this class (or another design class). Express what you've learned from your design journal in the form of an epic mindmap.
2. Prototype 3 different visualizations that describe the HCID program to future students. Select one and implement it beautifully.
3. Create a map of Paris, from scratch. Each map should tailored in its style and content to a specific audience.
4. Spell out a word using photographs that show everyday objects that look like letters (e.g., Alphabet Photography ). The subject matter of the photographs should match the meaning of the spelled word.
5. Create 3 poster designs that advertise this course. Select one and implement it beautifully.
6. Find 5 everyday signs that were created with haste. Create a thoughtful replacement, and post it for all five. Photograph the before and after, in context.
7. Visit three stores that carry three different types of prototyping materials. Take pictures, and write a brief report on each one. What do they carry? Was there anything that surprised or delighted you?
8. Ideate 3 possible alternate storylines for PONG, where a compelling storyline motivates the game mechanics. Storyboard one re-imagining of PONG; sketch/prototype how the game aesthetic might change to reflect this new narrative.
9. Build a "clock": a physical, mechanical, or computational system that tracks the passage of time in a novel, meaningful way.
10. Surprise me. Is there something that you've always wanted to do, but never had an excuse to get it done? *Instructor approval required.

Final Project Presentation: External jury

Please look at Assignment 17 (Final Presentation) for details.''

Class will be held in PUIO (Bâtiment 640)

This is NOT a programming course. Instead, students will work in groups of four to design, evaluate and redesign an interactive system, represented as a video prototype.

All in-class and homework exercises are required to complete the mid-term and final projects, so class attendance and participation is essential. Students will present the final video prototype to an external jury.

Grading for all three masters is:

Ressources and Video Prototypes

Here is link to an on-line tutorial I created for CHI'02: http://www.lri.fr/~mackay/VideoForDesign/

Here is a page with all the video prototypes VideoPrototypes

Course Lectures and Assignments

1: Finding out about Users

Lecture 1 Slides: Finding Out About Users

Assignment 1: Interviews (due 4 Dec.)

Assignment 2: Questionnaires (HCID - in class 28 Nov.)

2: Generating Ideas

Slides:

Resources on Grounded Theory: (HCID - in class 5 Dec.)

Assignment 3: User Profile

Assignment 4: Personas

Assignment 5: Use Scenario

Assignment 6: Web Search

3: Creating New Designs

Slides:

Assignment 7: Design Concept

Assignment 8: Design Scenario

Assignment 9: Function-Interaction Table

Extra interest: Design Space

Extra interest: Video Brainstorming

4: Evaluating Interactive Systems

Slides:

Class work 1: Storyboard Interaction Point

Class work 2: Video Prototyping Title Cards

Assignment 10: Video Prototyping

Assignment 11: Storyboard

Assignment 12: Midterm Assessment

Mid-term Project Due = 30% of grade

5: Redesign Strategies

Slides:

Assignment 13: Design Walkthrough

Assignment 14: Hypotheses

6: Evaluation & Generative Walkthroughs

Slides:

Assignment 15: Generative Walkthrough

7: Co-Adaptive Instruments

Slides:

Assignment 16: Co-Adaptive Instruments

8: Final Redesign: Video Prototyping

For info: Branching Storyboards

Slides: Final advice

Assignment 17: Final Presentation

Final Project Presentation: External jury

Ressources

This is a video tutorial for video prototyping: VideoForDesign