Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upGitHub is where the world builds software
Millions of developers and companies build, ship, and maintain their software on GitHub — the largest and most advanced development platform in the world.
[FEA] need to support cudf.DataFrame([[‘a’,‘b’]]).corr() when set ‘method=spearman’, we only support ‘method=pearson’ so far #6804
Comments
|
This would be a welcome addition. This could be implemented (in cuDF Python) by combining Would you be interested in contributing this? |
|
love to .... but need your guidance ;) @beckernick |
|
Pearson correlation is currently the implementation of correlation in cuDF Python currently. Spearman correlation is defined mathematically as the pearson correlation of the ranks of the columns. Rank is implemented currently. This means we have everything needed in cuDF Python. There are several ways to do this. One way would be to use a branching statement inside The dataframe implementation would need to be tweaked less, as we use CuPy's pearson correlation for efficiency. So you'd need to pass cudf/python/cudf/cudf/core/column/numerical.py Lines 330 to 339 in de5577c cudf/python/cudf/cudf/core/dataframe.py Lines 6789 to 6795 in de5577c |
Is your feature request related to a problem? Please describe.
from time series analysis, need to support spearman correlation matrix calculation in cuDF
Describe the solution you'd like
similar like pandas.DataFrame().corr(method='spearman')
Additional context
is it possible to let me know this feature adding roadmap? big thanks !