Xiaoan (Sean) Liu

Research Intern @Google

researching future AI-native interfaces between humans, things, and AI agents.

creating contextual "representation" intelligence beyond conventional 2D displays.

building the semantic layer for reality.

founding the Intent Company.

empowering everyone to be superintelligence.

demo

demo

scholar

scholar

twitter

twitter

github

github

email

email

CV

CV

I've been exploring these questions from my undergrad to my master's:

How do intelligence (human and AI) perceive?

How do they express themselves outside of the 2D screens?

How does intelligent computing happen in Reality?

Reality is my playground:
I've been exploring the above questions by designing, hacking, and building.

I'm answering this question by designing, hacking and building.


For a better viewing experience, pls open this website on a larger screen or click this link to watch.

Reality Proxy (UIST 2025)

What if interacting with physical objects in MR were as simple and precise as managing their digital proxies?

Reality Proxy (UIST 2025)

What if interacting with physical objects in MR were as simple and precise as managing their digital proxies?

Reality Proxy (UIST 2025)

What if interacting with physical objects in MR were as simple and precise as managing their digital proxies?

RealiTips [Manuscript in preparation]

An assistant who can see your desktop and guide you through making a coffee step by step.

RealiTips [Manuscript in preparation]

An assistant who can see your desktop and guide you through making a coffee step by step.

RealiTips [Manuscript in preparation]

An assistant who can see your desktop and guide you through making a coffee step by step.

Fusion Reality

It's basically a JARVIS.

Fusion Reality

It's basically a JARVIS.

Fusion Reality

It's basically a JARVIS.

Eagle Vision [Work In Progress] - See beyond the physical limitations.

Collaborative XR (with Ken Perlin)

We developed a system for an XR classroom where everyone can learn computer graphics in an XR environment.

Collaborative XR (with Ken Perlin)

We developed a system for an XR classroom where everyone can learn computer graphics in an XR environment.

Collaborative XR (with Ken Perlin)

We developed a system for an XR classroom where everyone can learn computer graphics in an XR environment.

Programmable Reality (an imaginary vision)

Why use Unity when you can directly program the behaviors of objects in the scene?

Programmable Reality (an imaginary vision)

Why use Unity when you can directly program the behaviors of objects in the scene?

Programmable Reality (an imaginary vision)

Why use Unity when you can directly program the behaviors of objects in the scene?

Some explorations for technical pipelines (such as image generation and pose tracking in AR camera):

Publication:

Reality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract Representations (UIST 2025)

Xiaoan Liu, Difan Jia, Xianhao Carton Liu, Mar Gonzalez-Franco, Chen Zhu-Tian

Augmenting Human Cognition through Everyday AR (CHI 2025 Workshop)

Xiaoan Liu

A Collaborative Multimodal XR Physical Design Environment (SIGGRAPH Asia 2024)

Keru Wang, Pincun Liu, Yushen Hu, Xiaoan Liu, Zhu Wang, Ken Perlin

SurrealDriver: Designing Generative Driver Agent Simulation Framework in Urban Contexts based on Large Language Model (IROS 2024)

Ye Jin, Xiaoxi Shen, Huiling Peng, Xiaoan Liu, Jingli Qin, Jiayang Li, Jintao Xie, Peizhong Gao, Guyue Zhou, Jiangtao Gong

Works during my undergrad:
Works during my undergrad:
Fusion Reality
Fusion Reality
Fusion Reality
Fitbee
Fitbee
Fitbee
XIA
XIA
XIA
Mysterious Planet
Mysterious Planet
Mysterious Planet
Yonder
Yonder
Yonder
Jasmine
Jasmine
Jasmine
Enthusia
Enthusia
Enthusia
SketchGPT
SketchGPT
SketchGPT
Screen Time Infographic
Screen Time Infographic
Screen Time Infographic