Integrate Haiper AI for AI-Generated Videos

Aperta
#849 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
5/5
Tempo stimato
Più di una settimana
Idoneità per principianti
25/100
Tipo di issue
Funzionalità
Chiarezza
Da chiarire
Stato di attività
Ferma
Stack tecnologico
php, wordpress
Ambito
ai, content, full-stack

Direzione di ricerca

L’issue non indica file del repository, test o punti di ingresso; inizia esaminando Haiper AI API Reference e le integrazioni OpenAI esistenti del repository. Definisci prima dell’implementazione il flusso text-to-video supportato, la gestione dei media WordPress, il comportamento dell’UI e dello stato e i test di accettazione; il completamento deve essere dimostrato da questi test concordati e da un’integrazione End-to-End funzionante.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Is your enhancement related to a problem? Please describe.

This feature request proposes integrating Haiper AI to enable video generation within WordPress. Similar to how DALL·E is used for image generation, Haiper AI could allow users to generate videos from prompts and refine them through iterative re-prompting, streamlining content creation workflows.

Why Haiper AI?
  • Hosted Open-Sora Instance – No need to self-host an Open-Sora model.
  • API-Driven Automation – Allows seamless integration with ClassifAI for automated workflows.
  • Minimal Free Tier Available – Haiper AI offers a free (beta) tier, but with significant limitations (see "Describe alternatives you've considered" section below).
  • Feature Expansion Roadmap – Integration will start with Haiper AI's Text-to-Video generation, with plans to expand to Image-to-Video and Repainting in future iterations.
Initial Integration Focus: Text-to-Video

The first phase of integration will utilize Haiper AI’s Text-to-Video API, allowing users to generate videos from text descriptions directly within WordPress. This feature will provide:

  • AI-powered video creation based on written prompts
  • Dynamic content generation for blogs, marketing, and storytelling
  • A seamless workflow for embedding AI-generated videos into WordPress
Future Expansion Targets

Once the initial Text-to-Video integration is stable, additional Haiper AI features could be explored:

  • Image-to-Video – Allowing users to animate images and turn them into video sequences.
  • Repainting – Enabling AI-powered refinements and modifications to existing video content.
Haiper AI Free Tier Limitations
  • 10 creations per day, 300 credits, 3 concurrent creations
  • Watermark-free images, but videos may include watermarks
  • No commercial use or private creations on the free tier
  • Upgrading to the Pro plan ($24/month) removes these limitations
  • See more via Haiper AI's Pricing & Access
Potential Use Cases
  • Automated Video Creation for Blog Content – Generate dynamic video summaries, intros, or explainer videos from blog posts
  • Product Showcase Videos – Create promotional videos for WooCommerce products dynamically
  • Storyboarding & Visual Narratives – Assist content creators with AI-generated video sequences
  • Social Media & Marketing Videos – Generate engaging short-form videos for marketing campaigns
Integration Points & API Considerations

Haiper AI provides an API for video generation, allowing WordPress users to interact with the service efficiently. Integration would involve the following workflows:

  1. Request Video Generation

    • Users provide a prompt describing the video (e.g., “A scenic drone shot over a tropical beach at sunset”).
    • API request sent to Haiper AI to generate video content.
  2. Retrieve & Display Video

    • Once generation is complete, the video URL is returned and can be embedded into WordPress.
    • Videos can be stored in the Media Library for easy reuse.
  3. Refinement & Edits

    • Users can re-prompt Haiper AI with modifications (e.g., adjust scene, extend length, refine motion).
    • API calls to Haiper AI to request iterative updates to the generated video.
  4. UI/UX Considerations

    • Add a “Generate Video” option alongside existing AI-powered features.
    • Display generation status and allow users to manage iterations.
    • Enable previewing and selecting from multiple AI-generated variations.
Haiper AI API Documentation & References
Next Steps & Considerations
  • Confirm API access requirements and determine feasibility for free-tier integration
  • Ensure proper media handling (e.g., storing videos locally or linking to cloud storage)
  • Implement UI for user-friendly prompt-based video creation
  • Assess performance considerations, including async processing and webhook-based callbacks for completed videos
Designs

No response

Describe alternatives you've considered
  1. Note that this enhancement would significantly expand ClassifAI’s AI capabilities but requires a paid third-party service for full functionality, which isn't different than our various OpenAI integrations but is suboptimal in that it doesn't have a free tier option for ClassifAI users to test out the feature for free before fully putting it to use on their site.

  2. Note that I explored utilizing Sora for this, but there's currently no API available so I've got this feature slotted for a slightly farther future release in hopes OpenAI opens up Sora a bit more for us to consider that instead of / alongside Haiper AI.

Code of Conduct
  • I agree to follow this project's Code of Conduct
Lingua principale
PHP
Stelle
714
Fork
68
Merge medio
4h 32m
PR unite (30g)
23

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di 10up/classifai

Tutte le issue di 10up/classifai

Issue simili

Altre issue su PHP

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.