deeplearning4j/deeplearning4j-examples

Video analytics

Open

#871 opened on Aug 8, 2019

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Java (1,841 forks)batch import
help wantedquestion

Repository metrics

Stars
 (2,395 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

I need advice: I'm a Java guy, and I would feel very comfortable using DL4J. The problem I'm trying to solve is to build a video-attention model. Basically, given a video, it gives me a rank of attention about video shots; basically which shot is more interesting.

Apparently I should use LSTM for that. But is there a good tutorial how to do this using DL4J? The video classification example is basically frame-based, not timed video based.

Contributor guide

Research direction
Research building a video attention model using DL4J. Look into LSTM architectures for temporal modeling and attention mechanisms. Review existing DL4J examples and documentation for sequence models. Consider adapting the video classification example to incorporate attention over time.
Tech stack
java
Domain
machine learningai
Issue type
Research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
JavaDL4J
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60