rapidsai/cudf

[FEA] Series and DataFrame mean absolute deviation

Open

#3,676 opened on 2019年12月30日

GitHub で見る
 (1 comment) (0 reactions) (0 assignees)C++ (735 forks)batch import
Pythonfeature requestgood first issue

Repository metrics

Stars
 (6,000 stars)
PR merge metrics
 (平均マージ 17d 21h) (30d で 230 merged PRs)

説明

For API compatibility and supporting exploratory analysis, we should support Series and DataFrame mean absolute deviation. See the pandas mean absolute deviation for more information.

This can be implemented for Python Series and DataFrame as a stopgap as Series.mad and then leverage _apply_support_method for DataFrame.mad. It's not 10x faster, but it gets the job done well.

import cudf
import numpy as np
​
def mad(self):
    # mad formula
    n = len(self)
    m = self.mean()
    mad = ((self - m).abs() / n).sum()
    return mad
​
​# 1 million rows
s = cudf.Series(np.random.normal(10,5,1_000_000))
ps = s.to_pandas()
​
%time mp = ps.mad()
%time mg = mad(s)
print(mp)
print(mg)
CPU times: user 31.9 ms, sys: 0 ns, total: 31.9 ms
Wall time: 32 ms
CPU times: user 0 ns, sys: 7.24 ms, total: 7.24 ms
Wall time: 23.2 ms
3.990811998439671
3.990811998439673

コントリビューターガイド