I am currently a second-year research graduate studentat the School of Creative Media, City University of Hong Kong, working with Prof.RAY LC, Prof.Shengdong Zhao and Prof.Qinyuan Lei. My research primarily focuses on the understand the cognitive processes involved in creative activities such as storytelling, scriptwriting and artistic creation and informal learning in digital environments . Based on studies of perception and behavior, I am particularly interested in designing and developing Human-AI collaboration prototypes and systems to enhance creativity or foster effective communication and expression.
Recently, I have been conducting research aimed at advancing science communication through Human-AI collaboration. This work encompasses two main areas: artifacts work that aims at developing novel human-LLM co-creation interfaces for enhancing science narratives with narrative peaks, and empirical work focus on establishing taxonomies derived from film storytelling techniques to create more engaging and effective science communication content.
I'm also collaborating with researchers in cognitive science, linguistics, and computer vision to integrate neural data, such as EEG and eye-tracking, as human feedback to fine-tune LLMs. Based on this, we're developing new interfaces to assist creative practitioners in visual arts creation.
In this study, we designed a co-creation process to explore how GenAI as a tool for storytelling can assist participants in conveying the intangible knowledge of cultural heritage, and analyzed the constraints of GenAI in the co-creation process. We also explored and prototyped how images, prompts, and qualitative insights from the co-creation process can be used as materials to design an interactive exhibition that tells the intangible stories of heritage.
In this study, we investigated the mirror’s synergistic effect with avatars on behaviors and dedicated user conversational performance. Studying how users interact with mirrors in an immersive environment allows us to explore how digital environments affect spatialized interactions when transported from physical to digital domains.