세계 지도 배경구름 배경

Technology for a Better World

Unlocking Creator-AI Synergy: Challenges, Requirements, and Design Opportunities in AI-Powered Short-Form Video Production

CHI 24: Proceedings of the CHI Conference on Human Factors in Computing Systems
Hajun Kim*, Jini Kim* (co-first author)

Research Focus:

This study investigates design opportunities from the perspective of short-form creators, focusing on optimizing their workflows by automating repetitive tasks while enhancing creative cognition. It also explores their core concerns regarding collaboration with AI.

We conducted interviews with 17 short-form video creators, identifying three distinct creator types(Participatory Entertainer, Knowledge Sharer, Highlight Capturer) and mapping their unique production workflows and challenges.

Short-form video creators’ production process
Short-form video creators’ production process, showing common behaviors (A) and distinctive behaviors across three types: (1) Participatory Entertainers, (2) Knowledge Sharers, and (3) Highlight Capturers.

A thematic analysis of the interview data was performed to systematically code these difficulties. Following this, we designed and conducted participatory workshops with 12 creators, grouped by type, to explore domain-specific design opportunities. Four distinct stimuli were utilized to facilitate ideation: AI capability cards, interventions for scaffolding AI concepts, an idea summary template, and a functional working prototype.

The participatory design workshop
The participatory design workshop consisted of three phases: (1) participants rated the challenges they deemed most relevant and in need of solutions, (2) they shared their experiences related to the selected challenges, and (3) they collaboratively developed solutions using workshop materials to address these challenges
Thematic analysis map of findings
Thematic analysis map of findings: (1) team challenge selection, (2) selected challenges, and (3) design suggestions from workshop sessions. Design suggestions were categorized based on the production process: (a) planning, (b) performance, (c) editing, and (d) uploading & management

Our findings highlight crucial design opportunities from the creators' perspective, primarily focusing on the automation of repetitive tasks and methods to enhance their creative cognition and capabilities.

We also identified significant concerns regarding AI collaboration, including the potential dilution of creator identity, the need for empathetic AI interaction, and challenges related to trust and transparency.

Key Findings:

Automating Repetitive & Labor-Intensive Tasks

  • Editing Automation: Automatically spotting highlights, cutting silences, stitching together essential scenes, and dynamically adjusting layouts for vertical formats.
  • Performance Assistance: Providing real-time guidance on "viewer-friendly" camera angles and layout, ensuring the subject isn't obscured by platform UI elements (like 'like' buttons).
  • Management Support: Supporting motivation by analyzing positive viewer comments and reminding creators of their production schedules to maintain consistency.

Augmenting Creative & Cognitive Tasks

  • Creative Planning: Moving beyond simple idea generation to co-planning scripts. A key opportunity is an AI that helps creators "Harmonize Trends with Creators' Unique Identity", suggesting ways to adapt a trend to their specific channel's style rather than just copying it.
  • Context-Aware Editing: Creators desired AI with complex and contextual understanding. Instead of just identifying subjects, they envisioned commands like, "Find me a scene where character 461 in the Squid Game gets angry!".
  • Preserving Identity: Moving beyond generic Text-to-Speech (TTS). Creators proposed AI that could generate "Emotional and Controllable Intelligent AI Voices", for instance, by learning and mimicking a creator's unique vocal style to maintain their channel's brand.
  • Ethical Guidance: Using AI to empower ethical and responsible content creation by analyzing content for potential issues like false information, ethical concerns, or copyright infringements before uploading.

Key Concerns

A critical finding is the central tension between the utility of AI and the preservation of creator identity. While creators welcome AI's benefits, they expressed some primary concerns:

  • Retaining Channel-Specific Identity: The most significant concern was that over-reliance on AI-generated ideas could lead to generic content, diluting their unique brand. One creator worried that relying on AI "could potentially disrupt the flow and character of my channel".
  • Lack of Empathetic Communication: Creators value emotional connection with their audience. They found current AI tools "unfriendly" and lacking the ability to grasp human emotion, context, and nuance.
  • Trust and Transparency: Creators were wary of AI's unreliability, citing instances where tools like ChatGPT provided inaccurate or outdated information. This damages trust, especially for Knowledge Sharers whose credibility depends on accuracy.
Designed By Hajun