spcl/serverless-benchmarks

Verification and ARM support for 411.image-recognition

Open

#321 opened on Aug 12, 2026

View on GitHubContributor guide
 (0 comments) (0 reactions) (0 assignees)Python (99 forks)auto 404
benchmarkenhancementgood first issue

Repository metrics

Stars
 (196 stars)
PR merge metrics
 (PR metrics pending)

Description

Our PyTorch-based benchmark has been recently ported to support Python 3.12. We should verify that it runs on 3.13 and 3.14 on all platforms.

Furthermore, we should port dependencies to also run on ARM Lambda instances. Since PyPI packages for torch should have CPU-only wheels for ARM, we can try to use that. On x64, we use custom wheels because we don't want to ship the heavy CUDA bundle.

Contributor guide

Research direction
Inspect the benchmark's requirements and build scripts. Try to reproduce the issue by running tests on Python 3.13/3.14. For ARM, check if PyTorch provides CPU only wheels and update the dependency configuration accordingly.
Tech stack
awsdockerpythonpytorch
Domain
cloudbackend
Issue type
Chore
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitPython
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70