Add support for asynchronous fetching, the `async_capable` table option
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 48/100
Research direction
Start with PostgreSQL's postgres_fdw changes referenced in commits 27e1f1456, bb684c82, and 5c854e7, then read the FDW Routines for Asynchronous Execution documentation. Trace pg_clickhouse's foreign-table option handling and fetch entry points; done means async_capable is supported and fetches can execute asynchronously alongside other foreign tables.
Written by the indexing model from the issue text.
Description
Add support for the async_capable option to allow async fetching of result sets, as described in All Your GUCs in a Row: enable_async_append and the FDW Routines for Asynchronous Execution docs. The option was added to postgres_fdw in postgres/postgres@27e1f1456 and modified in postgres/postgres@bb684c82 and postgres/postgres@5c854e7.
This will allow Postgres to execute fetches via pg_clickhouse asynchronously with other foreign tables, via pg_clickhouse or otherwise. Note, however, that its utility will be limited for fetches from the same foreign server, as pg_clickhouse uses a a single connection for all queries for a given server, so they'll run synchronously. Thus this feature, while desirable, is less important than improving join pushdown in general.
Suggested by @heavycrystal.
- Dominant language
- C
- Stars
- 284
- Forks
- 21
- Avg merge
- 23h 1m
- Merged PRs (30d)
- 20
Getting set up
We have not checked this project's setup files yet. Start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ClickHouse/pg_clickhouse
-
Difficulty 1/5 1-3 hours Newbie friendliness 88/100
ClickHouse/pg_clickhouse#383 · 1 comment ·
Maintainers usually reply within 1 day
-
data types enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
ClickHouse/pg_clickhouse#380 ·
Maintainers usually reply within 1 day
-
enhancement functions pushdown
Difficulty 3/5 1-2 days Newbie friendliness 68/100
ClickHouse/pg_clickhouse#379 ·
Maintainers usually reply within 1 day
-
Push down joins against an aggregated `IN (SELECT … GROUP BY … HAVING)` subquery (TPC-H Q18 shape)Possibly taken @JoshDreamland claimed this 3 days ago. Openenhancement pushdown sql
ClickHouse/pg_clickhouse#378 · 1 assignee ·
Maintainers usually reply within 1 day
-
operators pushdown
Difficulty 3/5 1-2 days Newbie friendliness 65/100
ClickHouse/pg_clickhouse#375 ·
Maintainers usually reply within 1 day
All issues in ClickHouse/pg_clickhouse
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
microsoft/ebpf-for-windows#5604 ·
Maintainers usually reply within 3 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 84/100
AcademySoftwareFoundation/openexr#2683 ·
Maintainers usually reply within 1 day