StoryWeaver

A Text-to-Image model that generates storyboard-style images from scripts for webtoon artists, presented at YBIGTA conference

{% include github_card.liquid repo=”YBIGTA/24th-conference-text2storyboard” %}

Project Overview

StoryWeaver is an innovative Text-to-Image generative model designed specifically for webtoon artists. The system takes a script as input and generates storyboard-style images, providing a powerful tool for visual storytelling in the digital comics industry.

Key Features

  • Script-to-Storyboard Conversion: Transforms written scripts into visual storyboard layouts
  • Webtoon-Optimized Output: Generates images specifically tailored for webtoon format and style
  • AI-Powered Generation: Utilizes advanced text-to-image generation techniques
  • Artist-Friendly Interface: Designed with webtoon artists’ workflow in mind

Conference Presentation

This project was presented at the YBIGTA Conference, hosted by Yonsei University’s Big Data Academic Club. The presentation showcased the technical implementation and potential applications of the StoryWeaver model in the webtoon industry.

Left: Model architecture overview. Middle: Example of generated storyboard from script input. Right: Application in webtoon creation workflow.

Technical Implementation

The StoryWeaver model leverages state-of-the-art text-to-image generation techniques, specifically optimized for storyboard-style output. The system processes natural language scripts and generates corresponding visual representations that maintain narrative coherence and artistic style consistency.

Performance evaluation showing the model's effectiveness in generating storyboard-style images from text inputs.

Impact and Applications

This project addresses a significant need in the webtoon industry, where artists often spend considerable time converting scripts into visual storyboards. By automating this process, StoryWeaver can:

  • Accelerate Production: Reduce the time needed for storyboard creation
  • Enhance Creativity: Allow artists to focus on artistic refinement rather than basic layout
  • Improve Consistency: Maintain visual style consistency across episodes
  • Support Collaboration: Facilitate better communication between writers and artists
Integration of StoryWeaver into the webtoon creation workflow and the user-friendly interface designed for artists.

Future Development

The project continues to evolve with plans for:

  • Enhanced style customization options
  • Multi-panel generation capabilities
  • Integration with popular webtoon creation tools
  • Real-time collaboration features

This work represents a significant step forward in bridging the gap between textual storytelling and visual art creation, particularly in the rapidly growing webtoon industry.