rapidsai/cudf

Use grid stride in CSV reader kernels

Open

#14,066 opened on Sep 8, 2023

View on GitHub
 (1 comment) (0 reactions) (1 assignee)C++ (735 forks)batch import
PerformancecuIOgood first issue

Repository metrics

Stars
 (6,000 stars)
PR merge metrics
 (Avg merge 17d 21h) (230 merged PRs in 30d)

Description

Currently, the CSV reader parses data using a thread per row, and a separate thread is used for each row, regardless of the file size. Using a grid stride loop would allow kernels to launch with preset number of blocks even with large input.

This applies both to the parser and the data inference kernels.

Contributor guide

Research direction
Implement grid stride loops in the CSV reader kernels to handle variable row counts efficiently. Study existing kernel launch configurations and modify the kernel to use a grid stride loop for both parsing and data inference.
Tech stack
cpp
Domain
backenddata
Issue type
Performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
CUDAC++
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40