apache/pinot

Add real-time table support for data ingestion rest API

Open

#11,914 opened on Oct 31, 2023

View on GitHub
 (6 comments) (1 reaction) (1 assignee)Java (1,234 forks)batch import
featuregood first issuehelp wantedingestion

Repository metrics

Stars
 (4,937 stars)
PR merge metrics
 (Avg merge 6d 7h) (186 merged PRs in 30d)

Description

In #6354 we introduced rest API to ingest data from file/URI, but it only supports ingesting data into offline table as of now. Since we already support pushing segment to real-time table, we should extend the API to support ingesting data into real-time table.

Contributor guide

Research direction
Study the existing data ingestion REST API for offline tables (#6354) and learn how segments are pushed to real time tables. Adapt the API to accept real time table ingestion requests.
Tech stack
java
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
JavaREST APIApache Pinot concepts
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60