dmarx/Multi-Modal-Comparators

View on GitHub

Unified API to facilitate usage of pre-trained "perceptor" models, a la CLIP

Stars: 39
Forks: 4
Open beginner issues: 0
Indexed issues: 18

Dominant language: Jupyter Notebook
License: No license data
Last GitHub push: Nov 26, 2022
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

18 open issues indexed

interface Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dmarx/Multi-Modal-Comparators#41 · Opened Nov 23, 2022
mechanism to isolate mode-specific components? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dmarx/Multi-Modal-Comparators#39 · Opened Jul 24, 2022
Gradient Checkpointing for OpenCLIP should be optional Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

dmarx/Multi-Modal-Comparators#36 · Opened Jun 2, 2022
refactor to use hooks Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 15/100

dmarx/Multi-Modal-Comparators#35 · Opened May 30, 2022
sbert embeddings need to be normalized prior to comparison Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#34 · Opened May 30, 2022
openai/CLIP -> rom1504/CLIP Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

dmarx/Multi-Modal-Comparators#33 · Opened May 29, 2022
Inherit from nn.Module Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 15/100

dmarx/Multi-Modal-Comparators#29 · Opened May 18, 2022
improved packaging Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#26 · 19 comments · Opened May 13, 2022
Add support for hosted CLIP (e.g. HF, Jina), with openai mocking Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#24 · Opened May 13, 2022
"vanilla return value Open

documentation enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#17 · 1 comment · Opened May 1, 2022
metadata field for shortform (and myabe longform too?) description of model Open

documentation enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#16 · Opened May 1, 2022
Attach model metadata to facilitate estimating inference/memory cost Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#13 · 2 comments · Opened Apr 23, 2022
Huggingface base loader Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

dmarx/Multi-Modal-Comparators#11 · Opened Apr 19, 2022
better name... Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dmarx/Multi-Modal-Comparators#10 · 7 comments · Opened Apr 19, 2022
modularity for comparison operators ("reducers") Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#7 · Opened Apr 9, 2022
mmc `__add__` method -> union operation Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

dmarx/Multi-Modal-Comparators#5 · Opened Apr 9, 2022
Feature brainstorming Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dmarx/Multi-Modal-Comparators#4 · 6 comments · Opened Apr 9, 2022
model architectures and pretrained models to support Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

dmarx/Multi-Modal-Comparators#2 · 36 comments · Opened Apr 9, 2022

dmarx/Multi-Modal-Comparators

Get new issues in your inbox