Integrate Haiper AI for AI-Generated Videos

Abierto
#849 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
25/100
Tipo de issue
Nueva funcionalidad
Claridad
Necesita aclaración
Estado de actividad
Estancado
Stack tecnológico
php, wordpress

Línea de trabajo

El issue no menciona archivos del repositorio, pruebas ni puntos de entrada; comienza revisando Haiper AI API Reference y las integraciones existentes de OpenAI del repositorio. Define el flujo de texto a vídeo compatible, el manejo de medios de WordPress, el comportamiento de la UI y del estado, y las pruebas de aceptación antes de la implementación; la finalización debe demostrarse mediante esas pruebas acordadas y una integración End-to-End funcional.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Is your enhancement related to a problem? Please describe.

This feature request proposes integrating Haiper AI to enable video generation within WordPress. Similar to how DALL·E is used for image generation, Haiper AI could allow users to generate videos from prompts and refine them through iterative re-prompting, streamlining content creation workflows.

Why Haiper AI?
  • Hosted Open-Sora Instance – No need to self-host an Open-Sora model.
  • API-Driven Automation – Allows seamless integration with ClassifAI for automated workflows.
  • Minimal Free Tier Available – Haiper AI offers a free (beta) tier, but with significant limitations (see "Describe alternatives you've considered" section below).
  • Feature Expansion Roadmap – Integration will start with Haiper AI's Text-to-Video generation, with plans to expand to Image-to-Video and Repainting in future iterations.
Initial Integration Focus: Text-to-Video

The first phase of integration will utilize Haiper AI’s Text-to-Video API, allowing users to generate videos from text descriptions directly within WordPress. This feature will provide:

  • AI-powered video creation based on written prompts
  • Dynamic content generation for blogs, marketing, and storytelling
  • A seamless workflow for embedding AI-generated videos into WordPress
Future Expansion Targets

Once the initial Text-to-Video integration is stable, additional Haiper AI features could be explored:

  • Image-to-Video – Allowing users to animate images and turn them into video sequences.
  • Repainting – Enabling AI-powered refinements and modifications to existing video content.
Haiper AI Free Tier Limitations
  • 10 creations per day, 300 credits, 3 concurrent creations
  • Watermark-free images, but videos may include watermarks
  • No commercial use or private creations on the free tier
  • Upgrading to the Pro plan ($24/month) removes these limitations
  • See more via Haiper AI's Pricing & Access
Potential Use Cases
  • Automated Video Creation for Blog Content – Generate dynamic video summaries, intros, or explainer videos from blog posts
  • Product Showcase Videos – Create promotional videos for WooCommerce products dynamically
  • Storyboarding & Visual Narratives – Assist content creators with AI-generated video sequences
  • Social Media & Marketing Videos – Generate engaging short-form videos for marketing campaigns
Integration Points & API Considerations

Haiper AI provides an API for video generation, allowing WordPress users to interact with the service efficiently. Integration would involve the following workflows:

  1. Request Video Generation

    • Users provide a prompt describing the video (e.g., “A scenic drone shot over a tropical beach at sunset”).
    • API request sent to Haiper AI to generate video content.
  2. Retrieve & Display Video

    • Once generation is complete, the video URL is returned and can be embedded into WordPress.
    • Videos can be stored in the Media Library for easy reuse.
  3. Refinement & Edits

    • Users can re-prompt Haiper AI with modifications (e.g., adjust scene, extend length, refine motion).
    • API calls to Haiper AI to request iterative updates to the generated video.
  4. UI/UX Considerations

    • Add a “Generate Video” option alongside existing AI-powered features.
    • Display generation status and allow users to manage iterations.
    • Enable previewing and selecting from multiple AI-generated variations.
Haiper AI API Documentation & References
Next Steps & Considerations
  • Confirm API access requirements and determine feasibility for free-tier integration
  • Ensure proper media handling (e.g., storing videos locally or linking to cloud storage)
  • Implement UI for user-friendly prompt-based video creation
  • Assess performance considerations, including async processing and webhook-based callbacks for completed videos
Designs

No response

Describe alternatives you've considered
  1. Note that this enhancement would significantly expand ClassifAI’s AI capabilities but requires a paid third-party service for full functionality, which isn't different than our various OpenAI integrations but is suboptimal in that it doesn't have a free tier option for ClassifAI users to test out the feature for free before fully putting it to use on their site.

  2. Note that I explored utilizing Sora for this, but there's currently no API available so I've got this feature slotted for a slightly farther future release in hopes OpenAI opens up Sora a bit more for us to consider that instead of / alongside Haiper AI.

Code of Conduct
  • I agree to follow this project's Code of Conduct
Lenguaje dominante
PHP
Estrellas
714
Forks
68
Merge medio
4 h 32 min
PR fusionados (30 d)
23

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de 10up/classifai

Todos los issues de 10up/classifai

Issues similares

Más issues de PHP

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.