Integrate Haiper AI for AI-Generated Videos

Open
#849 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
php, wordpress
Domain
ai, content, full-stack

Research direction

The issue names no repository files, tests, or entry points; begin by reviewing the Haiper AI API Reference and the repository’s existing OpenAI integrations. Define the supported text-to-video flow, WordPress media handling, UI and status behavior, and acceptance tests before implementation; done should be demonstrated by those agreed tests and a working end-to-end integration.

Written by the indexing model from the issue text.

Description

Is your enhancement related to a problem? Please describe.

This feature request proposes integrating Haiper AI to enable video generation within WordPress. Similar to how DALL·E is used for image generation, Haiper AI could allow users to generate videos from prompts and refine them through iterative re-prompting, streamlining content creation workflows.

Why Haiper AI?
  • Hosted Open-Sora Instance – No need to self-host an Open-Sora model.
  • API-Driven Automation – Allows seamless integration with ClassifAI for automated workflows.
  • Minimal Free Tier Available – Haiper AI offers a free (beta) tier, but with significant limitations (see "Describe alternatives you've considered" section below).
  • Feature Expansion Roadmap – Integration will start with Haiper AI's Text-to-Video generation, with plans to expand to Image-to-Video and Repainting in future iterations.
Initial Integration Focus: Text-to-Video

The first phase of integration will utilize Haiper AI’s Text-to-Video API, allowing users to generate videos from text descriptions directly within WordPress. This feature will provide:

  • AI-powered video creation based on written prompts
  • Dynamic content generation for blogs, marketing, and storytelling
  • A seamless workflow for embedding AI-generated videos into WordPress
Future Expansion Targets

Once the initial Text-to-Video integration is stable, additional Haiper AI features could be explored:

  • Image-to-Video – Allowing users to animate images and turn them into video sequences.
  • Repainting – Enabling AI-powered refinements and modifications to existing video content.
Haiper AI Free Tier Limitations
  • 10 creations per day, 300 credits, 3 concurrent creations
  • Watermark-free images, but videos may include watermarks
  • No commercial use or private creations on the free tier
  • Upgrading to the Pro plan ($24/month) removes these limitations
  • See more via Haiper AI's Pricing & Access
Potential Use Cases
  • Automated Video Creation for Blog Content – Generate dynamic video summaries, intros, or explainer videos from blog posts
  • Product Showcase Videos – Create promotional videos for WooCommerce products dynamically
  • Storyboarding & Visual Narratives – Assist content creators with AI-generated video sequences
  • Social Media & Marketing Videos – Generate engaging short-form videos for marketing campaigns
Integration Points & API Considerations

Haiper AI provides an API for video generation, allowing WordPress users to interact with the service efficiently. Integration would involve the following workflows:

  1. Request Video Generation

    • Users provide a prompt describing the video (e.g., “A scenic drone shot over a tropical beach at sunset”).
    • API request sent to Haiper AI to generate video content.
  2. Retrieve & Display Video

    • Once generation is complete, the video URL is returned and can be embedded into WordPress.
    • Videos can be stored in the Media Library for easy reuse.
  3. Refinement & Edits

    • Users can re-prompt Haiper AI with modifications (e.g., adjust scene, extend length, refine motion).
    • API calls to Haiper AI to request iterative updates to the generated video.
  4. UI/UX Considerations

    • Add a “Generate Video” option alongside existing AI-powered features.
    • Display generation status and allow users to manage iterations.
    • Enable previewing and selecting from multiple AI-generated variations.
Haiper AI API Documentation & References
Next Steps & Considerations
  • Confirm API access requirements and determine feasibility for free-tier integration
  • Ensure proper media handling (e.g., storing videos locally or linking to cloud storage)
  • Implement UI for user-friendly prompt-based video creation
  • Assess performance considerations, including async processing and webhook-based callbacks for completed videos
Designs

No response

Describe alternatives you've considered
  1. Note that this enhancement would significantly expand ClassifAI’s AI capabilities but requires a paid third-party service for full functionality, which isn't different than our various OpenAI integrations but is suboptimal in that it doesn't have a free tier option for ClassifAI users to test out the feature for free before fully putting it to use on their site.

  2. Note that I explored utilizing Sora for this, but there's currently no API available so I've got this feature slotted for a slightly farther future release in hopes OpenAI opens up Sora a bit more for us to consider that instead of / alongside Haiper AI.

Code of Conduct
  • I agree to follow this project's Code of Conduct
Dominant language
PHP
Stars
714
Forks
68
Avg merge
4h 32m
Merged PRs (30d)
23

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from 10up/classifai

All issues in 10up/classifai

Similar issues

More PHP issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.