WebARKit development

Open
#21 2 comments 0 reactions 1 assignee View on GitHub

@kalwalt is already working on this.

Since Nov 6, 2023.

Assessment

This issue has not been assessed yet.

Description

C/C++ code enhancement

I will make the point of the WebARKit library. Actually it is in the dev branch of this repository, before merging in master and to be officially released it is required to add some important features.
One of the most important feature to add is a better pose matrix solution. We receive the pose matrix from the knn matcher but it needs to be evaluated with a PnP solver. This require a camera matrix for the PnP pose computation, that for now our solution is lacking, and after that use a Kalman filter (or other filter) to stabilize the 6DOF tracking result.
Adding to this: in order to utilize the pose matrix we need a set of functions for GL graphics, to convert the pose matrix as Right hand GL matrix and also a function to compute the Camera Projection matrix.
Summing up, we need to develop:

  • camera matrix: implemented a new class WebARKitCamera #22
  • PnP solver for the pose matrix.
  • arGLposeMatrix and cameraProjectionMatrix
  • improve calcOpticalFlowPyrLK approach -> done in PR https://github.com/webarkit/WebARKitLib/pull/27
  • Kalman filter or OneEuro filter to stabilize the tracking.
Dominant language
C++
Stars
21
Forks
8
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from webarkit/WebARKitLib

All issues in webarkit/WebARKitLib

Similar issues

More C++ issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.