alteryx/evalml

Improve implementation of ``NullDataCheck``

开放

#3,273 创建于 2022年1月22日

 (1 条评论) (0 个反应) (1 位负责人)Python (93 个派生)auto 404
good first issueperformancerefactor

仓库指标

星标
 (852 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Follow up on https://github.com/alteryx/evalml/pull/3182 based on @freddyaboulton's comment:

I think we can improve this implementation. Right now we do two scans of the data to determine the highly null columns and the columns with any nulls. Doing so also involves creating a new copy of the data without NaturalLanguage/DateTime.

I think if we refactor get_null_column_information to return {col_name: % nulls} we only have to do one scan without creating another copy to determine which are highly null and which are null.

Originally posted by @freddyaboulton in https://github.com/alteryx/evalml/pull/3182#discussion_r789977564

贡献者指南