Kexue 'Shirley' Fu
付珂雪
HCI Researcher
I am always delighted to work and collaborate with brilliant minds!
Hi there!
I am currently a second-year research graduate studentat the School of Creative Media, City University of Hong Kong, working with Prof.RAY LC, Prof.Shengdong Zhao and Prof.Qinyuan Lei.
My research focuses on empowering individuals in complex creative (e.g., storytelling, visual arts, dance performance) and communicative (e.g., science communication, avatar-mediated communication) contexts that require inspiration, creativity, and nuanced support. I design human-in-the-loop interactions that align AI with human mental models, drawing on cognitive psychology, communication theories, and insights from mixed-method empirical research.
News
On-going Work
LLM Powered Science Communication Narrative Design
[Under review at TOCHI & In preparation for UIST'25]Recently, I have been conducting research aimed at advancing science communication through Human-AI collaboration. This work encompasses two main areas: artifacts work that aims at developing novel human-LLM co-creation interfaces for enhancing science narratives with narrative peaks, and empirical work focus on establishing taxonomies derived from film storytelling techniques to create more engaging and effective science communication content.
Neural-Enhanced Human-AI Co-Creation: Integrating EEG and Eye-Tracking for Visual Arts
I'm also collaborating with researchers in cognitive science, linguistics, and computer vision to integrate neural data, such as EEG and eye-tracking, as human feedback to fine-tune LLMs. Based on this, we're developing new interfaces to assist creative practitioners in visual arts creation.
Selected Publication
-
DIS
Proceedings of the 2024 Designing Interactive Systems Conference (DIS '24)In this study, we designed a co-creation process to explore how GenAI as a tool for storytelling can assist participants in conveying the intangible knowledge of cultural heritage, and analyzed the constraints of GenAI in the co-creation process. We also explored and prototyped how images, prompts, and qualitative insights from the co-creation process can be used as materials to design an interactive exhibition that tells the intangible stories of heritage.
CHI
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23)In this study, we investigated the mirror’s synergistic effect with avatars on behaviors and dedicated user conversational performance. Studying how users interact with mirrors in an immersive environment allows us to explore how digital environments affect spatialized interactions when transported from physical to digital domains.
See my full publication in Google Scholar or CV