Shorts Media Factory: An AI Automated Pipeline for One-Click Short Video Generation

Shorts Media Factory is an intelligent AI pipeline designed to solve the problems of time-consuming production and high professional barriers for high-quality short videos. Users only need to submit a theme and style preferences via API to automatically complete the entire process—including script generation, voiceover, sound effect design, video editing, and rendering—allowing anyone to quickly create professional short videos.

Short videos have become a mainstream form of information dissemination, but the creation barrier is high: scripts need to capture attention and understand algorithms; voiceover and sound effects require professional equipment and knowledge; editing needs proficient software; and large-scale production has high labor costs. These difficulties restrict the continuous output of content creators and brands.

1. Theme Receipt & Script Generation: Users submit theme and style preferences; Google Gemini generates a structured script with opening hook, core content, interactive guidance, and ending memory points.
2. Speech Synthesis & Sound Effects: ElevenLabs generates natural speech (including multi-role dialogue) and matching sound effects.
3. Video Assembly: MoviePy + FFmpeg sync audio and video, generate dynamic subtitles, add transitions, and render.
4. Delivery & Retention: PostgreSQL tracks task status; videos are downloadable within the retention period.

• API Layer: FastAPI (Python3.12, high performance, asynchronous, auto-documentation)
• Script Generation: Google Gemini (multilingual, balanced creative structure)
• Speech Synthesis: ElevenLabs (natural human voice)
• Video Processing: MoviePy + FFmpeg (user-friendly interface + powerful functions)
• State Management: PostgreSQL + SQLModel (type-safe, query capabilities)
• Deployment: Docker + docker-compose (consistent environment, simplified deployment)

In the early testing of the project, the generated short videos received 23,000 views and 1,000 likes on TikTok, verifying the core hypothesis: the market needs high-quality content where AI handles production and humans control creativity.

Collaboration Paradigm: Humans are responsible for theme direction, style definition, review selection, and strategy formulation; AI handles script writing, speech synthesis, sound effect design, and video editing. Application Scenarios: Content creators increase output; brands do precise marketing; news media convert text to short videos; educational institutions generate teaching content in bulk.

Limitations: AI scripts lack creative depth; copyright compliance needs consideration; relies on third-party service stability. Future Directions: Integrate user authentication (Clerk/Supabase JWT); add customization options (voice, music, subtitles); support batch processing and template functions.