Support fsspec or other file system abstraction in GenericFilePublisher

Open
  • Is something wrong?
#79 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
45/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
backend, cloud

Research direction

Locate GenericFilePublisher and inspect how it currently accesses the underlying filesystem. Determine the existing publisher behavior and integration points before choosing how an optional filesystem abstraction should be represented; done should include preserving current local-filesystem behavior while enabling object-store use.

Written by the indexing model from the issue text.

Description

type: enhancement

Is your feature request related to a problem? Please describe.
Currently can't use GenericFilePublisher with other file system abstractions (for integration with S3 or object store).

Describe the solution you'd like
Optional abstraction of underlying filesystem.

Dominant language
Python
Stars
44
Forks
7
Avg merge
18h 20m
Merged PRs (30d)
14

Getting set up

  • No Dockerfile or Docker Compose file
  • Has a pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from Point72/ccflow

All issues in Point72/ccflow

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.