Tuesday, June 10, 2025

同济大学 DigitalFUTURES 2025 数字未来工作营 | 视听触嗅味 AIGC 感官多模态交互项目 非遗交互视觉设计负责人(2025.6 - 至今)

作为项目核心模块负责人,统筹 “AIGC + 非遗功夫茶” 多感官沉浸式交互设计,聚焦 “身体 - 环境的新型连接” 与文化遗产数字化活化,联动华祥苑品牌打造融合传统茶礼与未来科技的沉浸式体验方案。

核心工作包括:

  • 主导 “非遗功夫茶 ×AIGC 多感官” 模块设计,以 “可感知、可交互、可传播” 为目标,重构功夫茶非遗技艺的数字展陈逻辑,将采茶、制茶、品茶等传统流程转化为多维度感官叙事;

  • 整合 AIGC 技术与多模态交互工具:通过 Midjourney 生成茶席场景视觉基底,结合 AI 投影、Kinect 动作捕捉与Mediapipe实时编码技术,实现参与者身体数据(手势、姿态)与虚拟茶席元素的动态联动 —— 例如挥手触发茶汤纹理的 AIGC 视觉演变,俯身感应茶香数据可视化投影;

  • 对接华祥苑品牌需求,将技术方案落地为 “未来茶席沉浸式宴席”,通过视听触嗅味五感交互设计,让品牌受众在虚拟与现实融合的空间中体验非遗茶礼的现代演绎,目前项目已完成原型测试,计划纳入品牌文化体验展厅核心内容。

Tongji University DigitalFUTURES 2025 Workshop | AIGC Multisensory (Audio-Visual-Tactile-Olfactory-Gustatory) Interactive Project Lead of Intangible Heritage Interactive Visual Design (Jun 2025 - Present)

As the lead of the core module, I oversee the "AIGC + Intangible Heritage Kung Fu Tea" multisensory immersive interaction design, focusing on "new body-environment connections" and digital activation of cultural heritage. Collaborating with Huaxiangyuan brand, the project aims to create an immersive experience integrating traditional tea rituals with future technology.

Key responsibilities include:

  • Leading the design of the "Intangible Heritage Kung Fu Tea × AIGC Multisensory" module. With the goal of "perceivable, interactive, and communicable," I restructured the digital exhibition logic of Kung Fu tea’s intangible heritage techniques, transforming traditional processes (tea picking, processing, and tasting) into multi-dimensional sensory narratives;

  • Integrating AIGC with multimodal interaction tools: Using Midjourney to generate visual bases for tea ceremony scenes, combined with AI projection, Kinect motion capture, and Mediapipe real-time coding to achieve dynamic linkage between participants’ body data (gestures, postures) and virtual tea ceremony elements—such as waving hands to trigger AIGC visual evolution of tea soup textures, or leaning forward to activate data-visualized projections of tea aroma;

  • Aligning with Huaxiangyuan’s needs, translating the technical solution into a "future tea ceremony immersive banquet." Through five-sensory (audio-visual-tactile-olfactory-gustatory) interaction design, brand audiences experience the modern interpretation of intangible heritage tea rituals in a virtual-real integrated space. The project has completed prototype testing and is scheduled to become a core exhibit in the brand’s cultural experience hall.

Direction:

AIGC Multimodal Interaction Design

Organization:

Tongji University

Duration:

7 - 8 Weeks

Location:

SHANGHAI,CHINA

Man
Black Man
Black Man
Woman
Woman
© Selected Works
GALAXY VISUAL
AIGC Designer
© Selected Works
AIGC Designer
© Selected Works
AIGC Designer

Create a free website with Framer, the website builder loved by startups, designers and agencies.