PDF

12-11-2007
Luís Carriço et al.
ABSOLUTE INTERACTION
Absolute Interaction (AbsInt)
People Characteristics
Everyone
Interaction
Location/Environment
Characteristics
People/Task
Uniqueness
Everywhere
Interaction
AbsInt
Clever &
Trustworthy
Interaction
Ubiquitous Technology
With Everything
Interaction
Knowledge-based Techniques
I/O Technology
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
2
1
12-11-2007
Absolute Interaction
Cog. & Physically Disabled,
Children, Elderly, …
Culture, …
Outdoor interaction
Standing
Public
Ubiquitous Computing
Noisy
Pervasive …
…
Multi-device
Mobile …
PDA, SmartPhones
SmartBoards,
Chairs, Walls, …
Universal Interaction
Interaction for All
Accessibility
AbsInt
Multimodalities
Unconventional UI
BCIs
…
Pens, Haptic input output
Cameras, microphones,
EEG, EMO, ECG
Gesture, Gaze,
Speech, …
Elderly
Playing, Learning,
Running, Living ….
Intelligent UI
Adaptive UI
Aware UI
Perceptual UI
If … then … else… ;-)
Customization techs.
Inference techs,
Mining, Discovery , …
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
3
Absolute Interaction
Supremely adequate (better than Human-
Human) Interaction for Everyone, Everywhere,
with Everything the human is able to use (body
and mind).
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
4
2
12-11-2007
Absolute Interaction
For the Development of AbsInt UIs?
Models (understanding) for People, Environment, …
Architectures and techniques
Toolkits (middleware)
Frameworks (IDEs et al)
Guidelines
For Validation/evaluation of AbsInt Uis
Same as above ☺
Complete Interactions, HCIM 2007/08, bootstrap meeting
AbsInt People
Nov. 2007
5
Just Whipping Everybody
• Me
Dissertating
Really working (classes)
Almost PhD
Master Students
Carlos Duarte
Rogério Bandeira
PhD Students
(António Batista)
(José Antunes)
Marco Sá
Rui Lopes
Almost PhD Students
Luis Duarte
Master Students
Tiago Reis
3rd Year Students
Mário Carranca
Miguel Alves
Mª João Leal
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
6
3
12-11-2007
AbsInt People
People Characteristics
Everyone
Interaction
Location/Environment
Characteristics
M. Alves
R. Lopes
Everywhere
Interaction
T. Reis
M. Sá
M. Carranca
C. Duarte
AbsInt
Clever &
Trustworthy
Interaction
R. Bandeira
José Antunes
L. Duarte
Ubiquitous Technology
People/Task
Uniqueness
With Everything
Interaction
Knowledge-based Techniques
M.ª João
António Batista
I/O Technology
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
7
People: Carlos Duarte
MultiModal Adaptive Interfaces (MMAI)
FAME - Framework for Adaptive Multimodal Environments
Areas
Design of MMAI
Evaluation of MMAI
Contributions
An Architecture for MMAI
A Matrix for Design, Implementation and Evaluation of MMAI
Guidelines for MMAI development
Results
Rich Book Player - a MMAI
An Adaptive Mmodal player of Enriched Digital Talking Books
Associated Results
A mobile simplified version of the RBP – Fernando Morgado (former AbsInt)
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
8
4
12-11-2007
People: Marco Sá
Mobile and Ubiquitous Interfaces (MUI)
Design and Evaluation Methodology and Framework for M(U)I
Areas
Design of M(U)I
Requirements analysis for M(U)I
MI Prototyping
Evaluation of M(U)I
Contributions
A Methodology for M(U)I Design including
Contexts and inter-context modeling
New M(U)I Prototyping approaches
New M(U)I Evaluation and requirement gathering techniques
Guidelines for M(U)I development
Results
ScWizz – should become MoDEF (or something like that) – a
A Framework for Design and Evaluation of Mobile Prototypes and Applications
A Mobile Framework for Refinement of M(U)I
Associated Results
See Luis and Tiago’s work
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
9
People: Rui Lopes
Interaction Design for All (ID4A) or Universal Interfaces (UnI)
Design e Evaluation Methodology and Framework for UnI
Areas
Universal Design and Evaluation
Web Applications and Frameworks
Contributions
An Ontology for UnI
Cognitive, Physical and Sensorial Characteristics, Device, Interaction, Context Dimensions
A Methodology of Assessment of Applications Universality
Profile Modeling, Guidelines, …
Results
(previous) DiTaBBu – Digital Talking Book Builder
A Framework for Design, Validation and Evaluation of UnI
Associated Results
A image classification tool – Hugo (Tito) Simões (former AbsInt)
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
10
5
12-11-2007
People: Luis Duarte
Before and Now
Development of a:
Group Facilitation Tool (FaGoTe)
Mobile Artifact Execution Tool (MATE)
Future
Unusual/Unconventional Interfaces (U2I)
Gamming Interfaces with unconventional interaction
EEG interaction
Blow interaction
…
Aware User Interfaces
Aiming at Children - and Animals ☺
Within critical scenarios (health)
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
11
Nov. 2007
12
People: Tiago Reis
Before
Development of a Group Facilitation Tool (FaGoTe)
Now
Multimodal Extensions …
To …
Mobile Design and Evaluation Framework (MoDEF)
Mobile Artifact Execution Tool (MATE)
Aiming at People with Visual Disabilities
Voice and video (in and out)
(and awkward usage situations)
Future
MUI & ID4A & U2I & MMAI
Gesture and/or EMO techniques
Aiming at People with Serious Motor Disabilities
Complete Interactions, HCIM 2007/08, bootstrap meeting
6
12-11-2007
People: … that really work
Rogério Bandeira
Symbian (UID/E60) version of the Mobile Artifact Execution Tool
UI, XML and Communication stuff
Mário Carranca
Communication Server
Session oriented publisher/subscriber based server for message delivery
TCP/IP, UDP, message broadcast and multicast and everything else
Mário Carranca & Miguel Alves
Session Planner
User, Group and Session Manager
Distributed Session Demonstrator
Mª João Leal
Eye-tracker, … other less common interaction
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
13
AbsInt Projects
Gone and almost gone
Under-Evaluation and Future
MMAI & ID4A related
U2I (uncommon) related
IPSOM (2001-2004)
RiCOBA (2005- dec.2007)
ID4A related
MI (mobile) related
SCOPE (2004-2006)
JoinTS (2005- Jun.2008)
Other small projects
SPiYChiLD
ACCESSIBLE (EU)
Future w/ history
ARIES (ID4A & U2I)
MobiDiT (MUI)
MobEd (MUI)
Stoke/Gesture/Vision
Health and Education
GD4A
…
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
14
7
12-11-2007
AbsInt Projects
People Characteristics
Location/Environment
Characteristics
ACCESSIBLE
€
People/Task
Uniqueness
€
Everywhere
Interaction
SCOPE
Everyone
Interaction
MoDEF & MATE-MM
JoinTS
€
RiCOBA
€
AbsInt
IPSOM
€
SpiYChiLD
MATE on Symbian
€
Ubiquitous Technology
With Everything
Interaction
Eye-Tracker
Clever &
Trustworthy
Interaction
Knowledge-based Techniques
Stroke-recognition
I/O Technology
Complete Interactions, HCIM 2007/08, bootstrap meeting
15
Nov. 2007
Projects: MMAI & ID4A …
RiCOBA (ending)
RiCoBA - Rich Content Books for All
Build and support Rich Content books to visual impaired people
and more
Partners: INESC (L2F), BN
ARIES (waiting)
ARIES - Ambient-assisted Reading Interfaces for the Elderly
Society
Build and Support and Assisted Reading/Earring Framework for
the Elderly, considering cognitive and physical disabilities, and
supporting voice, gesture and posture interaction
Partners: INESC (L2F), FCT/UNL
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
16
8
12-11-2007
Projects: MUI & U2I … & MMAI
JoinTS and SCOPE extensions (going on)
Joint Therapy Support
Support to psychotherapy in controlled group and individual with strong
ubiquitous/mobile dimensions
Partners: PsiSaude
MobiDiT (waiting)
MobiDiT – Mobile Distributed Therapy
Same, in the field (in exposure therapy – while falling from the plane)
Partners: PsiSaude, Viva Mulher Viva Associação
MobEd (waiting)
Mobile Education
Same, for education
Partners: Centro de Investigação em Educação (CIE/FC/UL)
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
17
Projects: ID4A & MMAI
ACCESSIBLE Proposta FP7, ICT-2007.7.2
Promotes ACCESSIBILITY and eInclusion as a core horizontal building block in
the establishment of the Information Society to ensure equal access for all in
Europe
Accessibility requirements (not just visual impairments)
Holistic methodology for (whole) Sw development
Formal Specification and Expert System to support de development, assessment
and evaluation of accessible stuff
Modular IDE for … the above
Java, Web, Models
Pilot Applications
Partners:
SUN Microsystems, Alcatel-Lucent
SME: Softeco, SOLINET, Netscouts, Concept Swiss
R&D: FFCUL, FORTH, CERTH, Univ. Stuttgard
NGO: Marie Curie Association
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
18
9
12-11-2007
Projects: U2I & MMAI … & MUI
SPiYChiLD (Clinical Research)
Spirometry Playground and Interpretation model for Young Children’s Lung
Disorder assessment
Software-based recognition, classification and notification system for flow-
volume patterns for preschool children
Modular gamming approaches, for improvement of children’s acceptance and
collaboration
Software-assistant enabling non-technical staff to conduct spirometry
Identification of reproducibility and repeatability of the flow-volume loop
patterns and of the spirometric reference values for young children
Improvements on analysis of the flow-volume curves shapes, adapted to those
obtainable in this age group
Applicability of the entire project to the ambulatory non-technical non-
centralized setting
Partners: Hosp. Santa Maria (FMUL)
Complete Interactions, HCIM 2007/08, bootstrap meeting
Nov. 2007
19
10