utils

Type Members

1. abstract class AbstractTextClassificationParams extends Serializable

2. case class TextClassificationParams(baseDir: String = "./", maxSequenceLength: Int = 1000, maxWordsNum: Int = 20000, trainingSplit: Double = 0.8, batchSize: Int = 128, embeddingDim: Int = 100, partitionNum: Int = 4) extends AbstractTextClassificationParams with Product with Serializable

3. class TextClassifier extends Serializable

   This example use a (pre-trained GloVe embedding) to convert word to vector, and uses it to train a text classification model on the 20 Newsgroup dataset with 20 different categories.

4. case class WordMeta(count: Int, index: Int) extends Product with Serializable