The-AI-Alliance/open-trusted-data-initiative

Identify catalog metadata management tool options

Open

#75 opened on Jan 8, 2025

View on GitHubContributor guide
 (3 comments) (0 reactions) (2 assignees)Jupyter Notebook (7 forks)auto 404
cataloghelp wanted

Repository metrics

Stars
 (16 stars)
PR merge metrics
 (PR metrics pending)

Description

This task is just to determine a list of tools for further consideration. For each candidate, separate issues will be created for evaluating each one appropriately.

The list can be captured here as comments.

For example, see #71, for Unity Catalog as an option.

Some requirements the candidates should be able to meet:

  1. Support datasets managed elsewhere, while some datasets might also be managed by the Alliance directly. Hence, provide the ability to manage or just a catalog a dataset.
  2. GUI for browsing.
  3. Access controls.

Contributor guide

Research direction
Research existing catalog metadata management tools such as Unity Catalog, DataHub, Amundsen, etc. Evaluate each based on requirements: ability to catalog datasets managed elsewhere, GUI for browsing, access controls. Document findings as comments in the issue.
Tech stack
None
Domain
data
Issue type
Research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
None
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60