[IMPROVE] Embedding model encoding time for search and file upload
Assessment
This issue has not been assessed yet.
Description
Title: [IMPROVE] Embedding model encoding time for search and file upload
Background
Search and file uploading call TransformerModel.get_instance() directly at request time
Current State
Acceptance Criteria
- The model is warm before the first search or upload request hits
Approach
Preload SentenceTransformer model at Django startup before traffic is routed to the application instance
Add tests for the embeddings services by pulling apart the core logic to make testing easier
References
Risks and Rollback
Fall back to lazy load using try except block if preloading embedding model at startup fails
Screenshots / Recordings
Related PR
Balancer PR https://github.com/CodeForPhilly/balancer-main/pull/461
- Dominant language
- TypeScript
- Stars
- 21
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from CodeForPhilly/balancer-main
-
Bug
Difficulty 1/5 1-3 hours Newbie friendliness 72/100
CodeForPhilly/balancer-main#509 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 76/100
CodeForPhilly/balancer-main#503 ·
-
Bug
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
CodeForPhilly/balancer-main#502 · 1 comment ·
-
Bug
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
CodeForPhilly/balancer-main#488 ·
-
Documentation
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
CodeForPhilly/balancer-main#478 ·
All issues in CodeForPhilly/balancer-main
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
vercel-labs/just-bash#464 ·
-
looksLikeSlug() is ASCII-only, so non-Latin entity slugs (e.g. Korean) skip exact match and collapse Open
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
TanStack/tanstack.com#1293 ·