Provides DataFrame-based API for image pre-processing and feature transformation.
DLClassifier is a specialized DLEstimator that simplifies the data format for classification tasks.
DLClassifier is a specialized DLEstimator that simplifies the data format for classification tasks. It only supports label column of DoubleType. and the fitted DLClassifierModel will have the prediction column of DoubleType.
(Since version 0.10.0)
DLClassifierModel is a specialized DLModel for classification tasks.
DLClassifierModel is a specialized DLModel for classification tasks. The prediction column will have the datatype of Double.
(Since version 0.10.0)
DLEstimator helps to train a BigDL Model with the Spark ML Estimator/Transfomer pattern, thus Spark users can conveniently fit BigDL into Spark ML pipeline.
DLEstimator helps to train a BigDL Model with the Spark ML Estimator/Transfomer pattern, thus Spark users can conveniently fit BigDL into Spark ML pipeline.
DLEstimator supports feature and label data in the format of Array[Double], Array[Float], org.apache.spark.mllib.linalg.{Vector, VectorUDT}, org.apache.spark.ml.linalg.{Vector, VectorUDT}, Double and Float.
User should specify the feature data dimensions and label data dimensions via the constructor parameters featureSize and labelSize respectively. Internally the feature and label data are converted to BigDL tensors, to further train a BigDL model efficiently.
For details usage, please refer to examples in package com.intel.analytics.bigdl.example.MLPipeline
(Since version 0.10.0)
DLModel helps embed a BigDL model into a Spark Transformer, thus Spark users can conveniently merge BigDL into Spark ML pipeline.
DLModel helps embed a BigDL model into a Spark Transformer, thus Spark users can conveniently merge BigDL into Spark ML pipeline. DLModel supports feature data in the format of Array[Double], Array[Float], org.apache.spark.mllib.linalg.{Vector, VectorUDT}, org.apache.spark.ml.linalg.{Vector, VectorUDT}, Double and Float. Internally DLModel use features column as storage of the feature data, and create Tensors according to the constructor parameter featureSize.
DLModel is compatible with both spark 1.5-plus and 2.0 by extending ML Transformer.
(Since version 0.10.0)
Primary DataFrame-based image loading interface, defining API to read images into DataFrame.
Definition for image data in a DataFrame
Provides DataFrame-based API for image pre-processing and feature transformation. DLImageTransformer follows the Spark Transformer API pattern and can be used as one stage in Spark ML pipeline.
The input column can be either DLImageSchema.byteSchema or DLImageSchema.floatSchema. If using DLImageReader, the default format is DLImageSchema.byteSchema The output column is always DLImageSchema.floatSchema.