weka.dl4j.text.tokenization.preprocessor.impl

Class StemmingPreProcessorImpl

java.lang.Object

org.deeplearning4j.text.tokenization.tokenizer.preprocessor.CommonPreprocessor

weka.dl4j.text.tokenization.preprocessor.impl.StemmingPreProcessorImpl

All Implemented Interfaces:

java.io.Serializable, org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess, weka.core.OptionHandler

public class StemmingPreProcessorImpl
extends org.deeplearning4j.text.tokenization.tokenizer.preprocessor.CommonPreprocessor
implements java.io.Serializable, weka.core.OptionHandler

Implements basic cleaning inherited from CommonPreProcessor + does stemming using a Weka Stemmer.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
StemmingPreProcessorImpl()

Method Summary

Modifier and Type	Method and Description
java.lang.String[]	getOptions() Gets the current settings of the Classifier.
weka.core.stemmers.Stemmer	getStemmer()
java.lang.String	globalInfo() Returns a string describing this object.
java.util.Enumeration<weka.core.Option>	listOptions() Returns an enumeration describing the available options.
java.lang.String	preProcess(java.lang.String token)
void	setOptions(java.lang.String[] options) Parses a given list of options.
void	setStemmer(weka.core.stemmers.Stemmer stemmer)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface weka.core.OptionHandler

makeCopy

Constructor Detail

StemmingPreProcessorImpl

public StemmingPreProcessorImpl()

Method Detail

globalInfo

public java.lang.String globalInfo()

Returns a string describing this object.

Returns:

a description of the object suitable for displaying in the explorer/experimenter gui

listOptions

public java.util.Enumeration<weka.core.Option> listOptions()

Returns an enumeration describing the available options.

Specified by:

listOptions in interface weka.core.OptionHandler

Returns:

an enumeration of all the available options.

getOptions

public java.lang.String[] getOptions()

Gets the current settings of the Classifier.

Specified by:

getOptions in interface weka.core.OptionHandler

Returns:

an array of strings suitable for passing to setOptions

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Parses a given list of options.

Specified by:

setOptions in interface weka.core.OptionHandler

Parameters:

options - the list of options as an array of strings

Throws:

java.lang.Exception - if an option is not supported

preProcess

public java.lang.String preProcess(java.lang.String token)

Specified by:

preProcess in interface org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess

Overrides:

preProcess in class org.deeplearning4j.text.tokenization.tokenizer.preprocessor.CommonPreprocessor

getStemmer

@OptionMetadata(displayName="stemmer",
                description="The Weka stemmer to use.",
                commandLineParamName="stemmer",
                commandLineParamSynopsis="-stemmer <String>",
                displayOrder=0)
public weka.core.stemmers.Stemmer getStemmer()

setStemmer

public void setStemmer(weka.core.stemmers.Stemmer stemmer)