Background Image 1 Background Image 4 Background Image 2 Background Image 3 Background Image 4

Hi, I'm Haopeng Wang

Human–Computer Interaction
Multimodal Interaction
Extended Reality

哈喽!!

I'm Haopeng Wang

Ph.D. Student at Lancaster University

I’m working in the field of Human-Computer Interaction (HCI) as a part of the GEMINI ERC project, supervised by Prof. Hans Gellersen. I explore and design multimodal interaction techniques for virtual reality, leveraging coordination between eye, head, and hand movements to improve efficiency and user experience.

My Resume 中文简历

Peer-reviewed Publications

Looking Around by Looking Around: Omnidirectional Gaze-based VR Viewport Control

Hock Siang Lee, Florian Weidner, Jinghui Hu, Haopeng Wang, Hans Gellersen
TVCG: IEEE Transactions on Visualization and Computer Graphics Presentation Video. Teaser Video. Repo. PDF.

Projects & Prototypes

All
AnywhereHand
MagicPitch
HeadDepth
HeadShift
Gaze, Wall, and Racket
Motion Correlation
OnGazeLeave
Cone and Bubble
Other Prototypes
AnywhereHand: Near and Far Interaction

AnywhereHand

Near and Far Interaction Switching

Switch between near and far interaction areas while manipulating virtual blocks.

AnywhereHand: Block Assembly

AnywhereHand

Block Assembly

Grab and position coloured blocks from the environment to build 3D structures in mid-air.

AnywhereHand: Cursor Annotation

AnywhereHand

Object Annotation

Draw annotations for virtual objects with a 3D cursor.

AnywhereHand: Free-space Annotation

AnywhereHand

Free-space Annotation

Draw freehand strokes in mid-air to create spatial annotations.

AnywhereHand: 3D Object Manipulation

AnywhereHand

3D Object Manipulation

Move and rotate objects in a virtual room with a remote 3D cursor.

AnywhereHand: Cursor Navigation

AnywhereHand

Cursor Navigation

Move a 3D cursor through objects for detailed selection in dense environments.

MagicPitch: Interaction Overview

MagicPitch

Interaction Overview

While holding the pinch: gaze sets direction, head pitch sets depth, and the hand refines in 6DoF.

MagicPitch: One-shot Positioning

MagicPitch

Manipulation in Action

Object manipulation in one action, gaze and head pitch guide coarse moves; the hand fine-tunes.

MagicPitch: Object Placement Task

MagicPitch

Experimental Object Docking

Use MagicPitch to dock a cube at its target position and orientation.

MagicPitch

Multi-room Interior Design

Use eye-head control across rooms and hand 6DoF within a room: same functionality, different contexts.

HeadShift: Fitts' Law Task

HeadShift

Fitts' Law Task

Select targets in a circular pointing task using head movements.

Motion Correlation

Magic Finger

Select menu items by tracking fingertip-driven motion with your eyes.

Motion Correlation

Stretch Ruler

Spread your hands and track orbiting markers to select menu items.

OnGazeLeave

Gaze Trigger

Confirm a hand selection with a saccade to a pop-up target.

OnGazeLeave

Hands-free Object Movement

Move objects with gaze aligned to head vector and look away to release.

OnGazeLeave

Multi-target Selection

Select multiple targets by looking first, then aligning the head vector to the gazed target.

Cone and Bubble

Gaze + Hand

Narrow targets with a gaze cone, then select precisely by hand.

Cone and Bubble

Hand + Hand

Narrow targets with one hand's cone, then select with the other.

OnGazeLeave

Camera Dragging

Turn your head while gazing at the centre to rotate the view.

Cone and Bubble

Voronoi Diagram

Expand targets within a gaze cone for easier hand selection.

Small Bench

Two-hand 3D Manipulation

Move objects along one hand's ray; use the other for depth and rotation.

FishRod

Ground Target Pointing

Point at near or far ground targets with a dynamic parabolic ray.

  • $$ { ID = Log_{\ 2}\ (\frac{D}{W_e} + 1) } $$

Activities

Presenting the MagicPitch takeaways at ISMAR 2026

MagicPitch at ISMAR 2026!

Loved sharing trimodal manipulation
with the ISMAR community.

Giving a talk on head input for multimodal interaction at Aarhus University

Visit to Aarhus University!

Visited friends in Aarhus and gave
a guest talk for the 3DUI master’s class.

Standing beside the Even Realities office sign

Internship at Even Realities!

Built cool prototypes for the world’s
most beautiful smart glasses.

Discussing my PhD research during a visit to Shandong University

Attended Qilu Youth Forum!

Shared my PhD research
at Shandong University.

Presenting HeadDepth on stage at ISMAR 2025

HeadDepth at ISMAR 2025!

Thrilled to share our eye–head input
for hands-free posintioning.

Presenting HeadShift to the audience at CHI 2025

HeadShift Hits CHI 2025!

Presented our TOCHI head pointing work
on the big CHI stage — so proud.

Presenting my doctoral research in a room overlooking the ocean

IEEE VR 2025 Doctoral Consortium!

Presented my PhD research
with the ocean as my backdrop.

A hiking moment with the GEMINI team in the Lake District

GEMINI Team Meetup 2025!

Also hiked through the Lake District
with labmates, Hans, and Albrecht.

At the registration desk for the first GEMINI workshop

The First GEMINI Workshop!

Helped welcome everyone
at the first GEMINI workshop.

Group photo at the GEMINI team meetup in 2024

GEMINI Team Meetup 2024!

Nice team meetup
but in a chilly castle -_-

Giving a research talk at Xi’an Jiaotong-Liverpool University

XJTLU Visit & New Friends!

Shared my work and had a lovely chat
with Prof. Hai-Ning Liang.

Contact

h.wang73@lancaster.ac.uk

A44, Infolab21,
Lancaster University, United Kingdom,
LA1 4WA

LinkedIn