Skip to content
Branch: master
Find file History

Latest commit

TJX2014 and srowen [SPARK-31400][ML] The catalogString doesn't distinguish Vectors in ml…
… and mllib

What changes were proposed in this pull request?
1.Add class info output in org.apache.spark.ml.util.SchemaUtils#checkColumnType to distinct Vectors in ml and mllib
2.Add unit test

Why are the changes needed?
the catalogString doesn't distinguish Vectors in ml and mllib when mllib vector misused in ml
https://issues.apache.org/jira/browse/SPARK-31400

Does this PR introduce any user-facing change?
No

How was this patch tested?
Unit test is added

Closes #28347 from TJX2014/master-catalogString-distinguish-Vectors-in-ml-and-mllib.

Authored-by: TJX2014 <xiaoxingstack@gmail.com>
Signed-off-by: Sean Owen <srowen@gmail.com>
Latest commit fe07b21 Apr 26, 2020

Files

Permalink
Type Name Latest commit message Commit time
..
Failed to load latest commit information.
benchmarks [SPARK-29297][TESTS] Compare `core`/`mllib` module benchmarks in JDK8/11 Sep 30, 2019
src [SPARK-31400][ML] The catalogString doesn't distinguish Vectors in ml… Apr 26, 2020
pom.xml [SPARK-30950][BUILD] Setting version to 3.1.0-SNAPSHOT Feb 26, 2020
You can’t perform that action at this time.