rapidsai/cudf

[FEA] Exploit Symmetry for `groupby.corr` and `groupby.cov`

Open

#10,098 opened on Jan 20, 2022

View on GitHub
 (1 comment) (1 reaction) (0 assignees)C++ (735 forks)batch import
Pythonfeature requestgood first issue

Repository metrics

Stars
 (6,000 stars)
PR merge metrics
 (Avg merge 17d 21h) (230 merged PRs in 30d)

Description

In https://github.com/rapidsai/cudf/pull/9889#discussion_r771493338, @bdice made an observation that due to symmetry, there's a chance of utilizing that to reduce computation by only applying the upper half of the matrix. In an attempt to reduce the scope of the PR, this is the issue that tracks the suggestion separately. If applicable, groupby.corr should also share the logic.

cc @skirui-source

Contributor guide

Research direction
Investigate the symmetry of covariance and correlation matrices to optimize groupby operations by computing only the upper triangle.
Tech stack
cpp
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
C++
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
35