Modular Java app can't create tensor object

Open
#509 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
28/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
java

Research direction

Start with src/main/java/module-info.java and build.gradle, then inspect the TensorFlow Java module declarations involved in the IllegalAccessException. Reproduce the failure through com.varankin.ocrc.Inferencer.image and the TInt32/TFloat32 tensor creation calls. Done means the modular Gradle application can create tensors without the reported access warning.

Written by the indexing model from the issue text.

Description

System information

  • Have I written custom code (as opposed to using a stock example script provided in TensorFlow): YES
  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04 x86_64): Windows 10 Pro
  • TensorFlow installed from (source or binary): Gradle dependence
  • TensorFlow version (use command below): 2.10.1
  • Java version (i.e., the output of java -version): 17.0.2
  • Java command line flags (e.g., GC parameters):
  • Python version (if transferring a model trained in Python):
  • Bazel version (if compiling from source):
  • GCC/Compiler version (if compiling from source):
  • CUDA/cuDNN version: 12.3
  • GPU model and memory:

Describe the current behavior
Java Gradle project, as built from IntelliJ IDEA pattern, repeatedly reports a fatal warning on attempt to create a tensor object. See the code and log below. The error raises exception that is effectively intercepted by JavaFX runtime.
The project was found having Java module support. After this support has been removed from the project, code runs just fine. However, modularity is highly desired for the application.

Describe the expected behavior

After module access permissions (exports, open's) get fixed in tensorflow-core-platform, etc., all Java objects should be created just fine, as they are in non-modular edition of the project.

Code to reproduce the issue

excerpt from file src/main/java/module-info.java:

module com.varankin.ocrc.jfx
{
    requires org.tensorflow.ndarray;
    requires org.tensorflow;
}

excerpt from file build.gradle (remove shown lines to let code run with no error):

plugins 
{
    id 'org.javamodularity.moduleplugin' version '1.8.12'
}
dependencies 
{
    implementation 'org.tensorflow:tensorflow-core-platform:0.5.0'
}

excerpt from file src/main/java/com/varankin/ocrc:

package com.varankin.ocrc;
import org.tensorflow.*;
import org.tensorflow.ndarray.*;
import org.tensorflow.types.TFloat32;
import org.tensorflow.types.TInt32;

public class Inferencer
{
    public void image( float[][] data )
    {
            FloatNdArray data_nda = NdArrays.ofFloats( Shape.of( data.length, data[0].length ) );
            data_nda.elements( /* 0, */ 1 ).forEachIndexed( (ix,nda) -> nda.setFloat( data[(int)ix[0]][(int)ix[1]] ) );
            // OK before this line; any next line fails; 
            TInt32 tdata_is = TInt32.scalarOf( 24 );
            TInt32 tdata_i = TInt32.tensorOf( Shape.of( 24, 24 ) );
            TFloat32 tdata_0 = TFloat32.tensorOf( Shape.of( 24, 24 ) );
            tdata_0.set( data_nda );
            TFloat32 tdata = TFloat32.tensorOf( data_nda );
    }
}

Other info / logs

Warning: Could not create an instance of class org.tensorflow.internal.c_api.presets.tensorflow: java.lang.IllegalAccessException: class org.bytedeco.javacpp.ClassProperties (in module org.bytedeco.javacpp) cannot access class org.tensorflow.internal.c_api.presets.tensorflow (in module org.tensorflow) because module org.tensorflow does not export org.tensorflow.internal.c_api.presets to module org.bytedeco.javacpp

Call stack has been wiped off by JavaFX, below is manual reproduction

  • com.varankin.ocrc.Inferencer.image
  • org.tensorflow.types.TInt32.scalarOf:44 -- same for TFloat32 methods
  • org.tensorflow.Tensor.of:128
  • org.tensorflow.RawTensor.allocate:109

Please do not hesitate to ask for runnable example if needed. Current project cannot be presented as-is because of IP protection requirements, and because it's bulky.

Dominant language
Java
Stars
928
Forks
227
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from tensorflow/java

All issues in tensorflow/java

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.