[FEATURE] Big Data support

Open
#57 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
go

Research direction

The issue names no files, tests, or entry points; begin by reviewing the existing query execution and deployment architecture. Define supported large or unbounded query cases, opt-in SQL restrictions, failure and QoS behavior, and error-message expectations before implementation.

Written by the indexing model from the issue text.

Description

enhancement v0.4

Feature Description

stackql should service queries against large or unbounded datasets, with configurable, opt-in restrictions on SQL support (eg: no aggregation).

Where the stackql deployment cannot service an big data query, there should be a decent error message to that effect.

It might be that some things onyl work on horizontally scaled stackql or some best effort algorithm with serious bottlenecks; this needs to be architected and failure / QOS degradation cases catalogued.

Example(s)
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Possible Approaches or Libraries to Consider
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Dominant language
Go
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from stackql/stackql-devel

All issues in stackql/stackql-devel

Similar issues

More Go issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.