RFE: Add support to git LFS to the git source plugin

Open
#31 17 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
git, python
Domain
build-system, tooling

Research direction

Start with the git source plugin and reproduce the checkout failure using the GitLab repository described in the issue. Determine how Git LFS repositories should be fetched and checked out, then verify that the bzip2 example completes without the smudge-filter error.

Written by the indexing model from the issue text.

Description

enhancement

See original issue on GitLab
In GitLab by [Gitlab user @jjardon] on Aug 9, 2018, 10:43

git lfs is a Git extension for versioning large files: https://git-lfs.github.com/

If I try to use a git lfs repo at the moment, this is the error I'm getting:

    Downloading bzip2-1.0.6.tar.bz2 (709 KB)
    Error downloading object: bzip2-1.0.6.tar.bz2 (d70a9cc): Smudge error: Error downloading bzip2-1.0.6.tar.bz2 (d70a9ccd8bdf47e302d96c69fecd54925f45d9c7b966bb4ef5f56b770960afa7): batch request: missing protocol: "/home/jjardon/.cache/buildstream/sources/git/https___gitlab_com_freedesktop_sdk_bzip2_tarball_git.git/info/lfs"

    Errors logged to /home/jjardon/.cache/buildstream/build/bzip2-z6uk2y5j/root/buildstream/freedesktop-sdk-bootstrap/bzip2.bst/.git/lfs/logs/20180809T103920.716221677.log
    Use `git lfs logs last` to view the log.
    error: external filter 'git-lfs smudge -- %f' failed 2
    error: external filter 'git-lfs smudge -- %f' failed
    fatal: bzip2-1.0.6.tar.bz2: smudge filter lfs failed
    [00:00:00] FAILURE bzip2.bst-0: Staging https://gitlab.com/freedesktop-sdk/bzip2-tarball.git
    [00:00:00] FAILURE bzip2.bst: Staging sources
    [00:00:05] FAILURE bzip2.bst: git source at bzip2.bst [line 55 column 4]: Failed to checkout git ref 8cdcb115dd45dd5d0f795f0d6af55a1054604fdb
Dominant language
Python
Stars
8
Forks
16
Avg merge
3h 24m
Merged PRs (30d)
3

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/buildstream-plugins

All issues in apache/buildstream-plugins

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.