facebookarchive/caffe2

MKL-DNN integration does not support backward pass

Open

#2,376 opened on Mar 22, 2018

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Shell (1,954 forks)batch import
help wanted

Repository metrics

Stars
 (8,424 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

MKL-DNN integration (in caffe2/mkl) implements only forward pass operators, although MKL-DNN itself provides primitives for both forward and backward pass. Implementation of ConvGradient operator would let Caffe2 use MKL-DNN for training on CPU, and support some models which need backprop (e.g. deep dream).

Contributor guide

Research direction
Study the existing forward pass implementation of Conv operator in caffe2/mkl and use MKL DNN's backward pass primitives to implement ConvGradient operator.
Tech stack
cpp
Domain
machine learning
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
C++MKL DNNDeep Learning
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20