davisking/dlib

Feature: Android NN API usage

Open

#1332 aperta il 26 mag 2018

Vedi su GitHub
 (1 commento) (0 reazioni) (0 assegnatari)C++ (3314 fork)batch import
help wanted

Metriche repository

Star
 (12.570 star)
Metriche merge PR
 (Nessuna PR mergiata in 30 g)

Descrizione

Android now has a neural network API that delegates to NPU/DSP/GPU or falls back to CPU, on devices running Android 8.1 or higher. https://developer.android.com/ndk/guides/neuralnetworks/

Ideally there would be a backend in dlib to support this framework as it is likely going to be the most optimised pathway going forwards.

NNAPI is a bit limited in what it can do at this stage. It only does int8, int32 and float32 for types and a few dozen operations.

It was expanded in NNAPI 1.1, adding some more operations [Div/Mul/Pad/Mean/Sub] (which requires Android 9.0).

Example implementation can be found in the Tensorflow Lite library: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/lite/nnapi/NeuralNetworksShim.h

Guida contributor