Human State‑Aware Robotics (H-STAR):
From Multimodal Data to Human‑Adaptive Behavior in HRI

Bringing together researchers and practitioners to advance robust, responsible, and deployable human state‑aware robotic systems.

DAYS
HOURS
MINUTES
SECONDS

About the Workshop

Objective

Explore how multimodal data can be systematically transformed into adaptive robot behaviors for next-generation Human–Robot Interaction (HRI). We focus on the end-to-end pipeline from clean and generalizable data curation, through learning and modeling, to real-time adaptive behavior—with emphasis on human internal states such as mind wandering, anxiety, engagement, and trust.

Expected Outcomes

Synthesize best practices, identify open research questions, and foster cross-disciplinary collaborations. A post-workshop summary will be published, and follow-up submissions encouraged to relevant venues.

Call for Participation

We welcome short papers, extended abstracts, and posters that advance human state-aware robotics for real-world HRI.

What to submit

Submit work that connects multimodal human data to adaptive robot behavior—methods, datasets, studies, systems, or lessons learned. We particularly encourage contributions that address robustness, responsible data practices, and deployment in-the-wild.

  • Paper submission deadline: June 29th
  • Notification date: July 20th

Accepted submissions will be archived on the workshop’s website.

Poster visibility: Poster presenters prepare a 1-minute lightning talk video. Videos are promoted on social media, played during breaks, and linked on the workshop website.

🏆 The workshop will recognize outstanding poster presentations by awarding first, second, and third place prizes.

Multimodal Sensing

Gaze, speech, motion, physiological signals for HRI.

Human State Estimation

Engagement, stress, fatigue, mind wandering detection.

Data Challenges

Alignment, missing data, dataset bias, robustness.

Adaptive Learning

Supervised, RL, imitation, LLM-based interaction policies.

Online Adaptation

Real-time learning and human-in-the-loop systems.

Trustworthy Robotics

Calibration, over-reliance, transparency, human agency.

Ethics & Privacy

Biosignals in the wild: privacy, consent, data governance.

Applications

Social robots, teleoperation, assistive robots, safety-critical HRI.

Responsible Sharing

De-identification, access control, reproducibility best practices.

Invited Speakers

Leading experts sharing complementary perspectives.

Gentiane Venture
Professor of robotics, the University of Tokyo
Kristiina Jokinen
University of Helsinki
CNRS-AIST Joint Robotics Lab
Institute of Science Tokyo
Silvia Rossi
Full Professor in Computer Science at Università degli Studi di Napoli Federico
Tetsuya Ogata
Chairman, AI Robot Association
Professor, Waseda University

Workshop Program

8:45
Opening

Welcome and Introduction

Tetsuya Ogata
9:00 Invited Talk 1

Beyond Affinity: Human-Robot Interaction in the Age of Physical AI

Prof. Tetsuya Ogata

Gentiane Venture
9:20 Invited Talk 2

Prof. Gentiane Venture

Professor of robotics, the University of Tokyo

9:40
Discussion

Breakout Group Discussion

10:00
Break

Coffee Break + Posters + Lightning Talk Videos

Kristiina Jokinen
10:20 Invited Talk 3

Interaction Space and Conversational Foundations: Grounding, Multimodality and Collaboration with Robot Agents

Prof. Kristiina Jokinen

Silvia Rossi
10:40 Invited Talk 4

Understanding and Being Understood: Cognitive Robotics Challenges from an HRI Point of View

Prof. Silvia Rossi

11:00
Discussion

Breakout Group Discussion

11:20
Break

Coffee Break + Posters + Lightning Talk Videos

11:40
Panel

Panel Discussion & Lessons-Learned Report

12:10
Closing

Closing

Organizing Committee

An interdisciplinary team spanning HRI, AI, and robotics.

Xiaoxuan Hei
ENSTA, Institut Polytechnique de Paris
Mohammed Al Sada
College of Engineering / Qatar Mobility Innovation Center, Qatar University
Nihan Karatas
Nagoya University
Neziha Akalin
Jönköping University
Faisal Al Jaber
College of Engineering, Qatar University
Tamon Miyake
Future Robotics Organization, Waseda University
Adriana Tapus
ENSTA, Institut Polytechnique de Paris
Shogo Okada
Japan Advanced Institute of Science and Technology

Intended Audience

Who should attend this workshop?

This workshop targets an interdisciplinary audience of researchers and practitioners in Human–Robot Interaction (HRI), robotics, artificial intelligence, and related fields who are interested in transforming multimodal human data into adaptive robot behavior. It is particularly relevant for those working on human state understanding, multimodal sensing and fusion, learning and modeling for interaction, and real-time behavioral adaptation.

The workshop will also attract researchers concerned with trustworthy and responsible robotics, including issues of human agency, over-reliance, and ethical use of sensitive data, as well as those developing or deploying adaptive robotic systems in domains such as social interaction, teleoperation, and safety-critical applications.

Human State Understanding

Modeling internal states during interaction.

Multimodal Sensing & Fusion

Combining signals reliably across modalities.

Learning & Modeling for Interaction

Policies and models grounded in HRI.

Real-time Behavioral Adaptation

Online inference and action selection.

Trustworthy & Responsible Robotics

Agency, calibration, transparency.

Safety-Critical Applications

Robustness for real-world deployment.

Sponsors

This workshop is sponsored by :

Contact

For questions, sponsorship, or participation inquiries, reach out to the workshop team.