Create Animated Stories using GPT-4o-mini, Midjourney, Kling, and Creatomate API

This workflow achieves a fully automated process from text story creation to animated video generation. Users only need to input basic parameters, and the system will intelligently generate story prompts, illustrations, and dynamic videos, ultimately synthesizing a complete animated story video. This process significantly reduces the complexity and time costs associated with traditional animation production, making it suitable for the rapid generation of multimedia content such as children's stories and brand promotional videos, helping content creators and educators efficiently produce high-quality animated materials.

Workflow Diagram
Create Animated Stories using GPT-4o-mini, Midjourney, Kling, and Creatomate API Workflow diagram

Workflow Name

Create Animated Stories using GPT-4o-mini, Midjourney, Kling, and Creatomate API

Key Features and Highlights

This workflow enables a fully automated process from text-based story creation to animated video production. It leverages GPT-4o-mini to intelligently generate story scene prompts, integrates Midjourney to create multiple high-quality illustrations, utilizes the Kling API to transform static images into dynamic videos, and finally employs the Creatomate API for video composition, producing a complete animated story video. The workflow is highly automated, supporting multi-round asynchronous task status monitoring and waiting to ensure the quality and completeness of generated content.

Core Problems Addressed

Traditional animation production is complex and time-consuming. This workflow integrates multiple AI services to automate story ideation, image generation, video production, and composition, significantly lowering the barriers and time costs of content creation. It is ideal for rapid generation of children’s stories, brand promotional videos, and other multimedia content.

Application Scenarios

  • Children’s story animation production
  • Fast generation of brand marketing videos
  • Social media content creation
  • Automated production of educational and training video materials

Main Process Steps

  1. Basic Parameter Setup: Users input story characters, visual style, and contextual keywords.
  2. Story Prompt Generation: GPT-4o-mini generates segmented story text along with corresponding image prompts.
  3. Illustration Generation: Midjourney API is called to produce three key scene illustrations for the story.
  4. Illustration Status Monitoring and Retrieval: Polling is performed to check image generation status, ensuring images are complete before obtaining temporary URLs.
  5. Video Generation: Using the three illustrations, the Kling API generates three dynamic video clips.
  6. Video Status Monitoring and Retrieval: Polling checks the video generation status to confirm completion.
  7. Video Composition: The Creatomate API merges the three video clips into a complete animated story video, embedding the story title text.
  8. Final Output: The URL of the composed video is obtained, achieving fully automated end-to-end animated story generation.

Involved Systems or Services

  • GPT-4o-mini: Generates story text and image description prompts
  • Midjourney (via piapi.ai interface): Creates story illustrations
  • Kling (via piapi.ai interface): Converts static illustrations into dynamic videos
  • Creatomate: Video template composition and final video generation
  • n8n: Workflow orchestration and task status management

Target Users and Value

  • Content creators and animators seeking rapid generation of high-quality animated story assets
  • Marketing and branding teams aiming to improve video content production efficiency
  • Educators automating the creation of instructional animations
  • AI enthusiasts and developers exploring automated creative workflows integrating multiple AI tools

By deeply integrating various AI generation services, this workflow greatly simplifies the production pipeline from story conception to finished animation, enabling users to efficiently produce creative and professional animated content.