weka.dl4j.text.tokenization.tokenizer.factory.impl

Class TweetNLPTokenizerFactoryImpl

java.lang.Object

weka.dl4j.text.tokenization.tokenizer.factory.impl.TweetNLPTokenizerFactoryImpl

All Implemented Interfaces:

java.io.Serializable, org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory, weka.core.OptionHandler

public class TweetNLPTokenizerFactoryImpl
extends java.lang.Object
implements org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory, java.io.Serializable, weka.core.OptionHandler

A DeepLearning4j's TokenizerFactory interface for the CMU TweetNLP tokenizer.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
TweetNLPTokenizerFactoryImpl()

Method Summary

Modifier and Type	Method and Description
org.deeplearning4j.text.tokenization.tokenizer.Tokenizer	create(java.io.InputStream toTokenize)
org.deeplearning4j.text.tokenization.tokenizer.Tokenizer	create(java.lang.String toTokenize)
java.lang.String[]	getOptions() Gets the current settings of the Classifier.
org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess	getTokenPreProcessor()
java.lang.String	globalInfo() Returns a string describing this object.
java.util.Enumeration<weka.core.Option>	listOptions() Returns an enumeration describing the available options.
void	setOptions(java.lang.String[] options) Parses a given list of options.
void	setTokenPreProcessor(org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess preProcessor)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface weka.core.OptionHandler

makeCopy

Constructor Detail

TweetNLPTokenizerFactoryImpl

public TweetNLPTokenizerFactoryImpl()

Method Detail

create

public org.deeplearning4j.text.tokenization.tokenizer.Tokenizer create(java.lang.String toTokenize)

Specified by:

create in interface org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory

create

public org.deeplearning4j.text.tokenization.tokenizer.Tokenizer create(java.io.InputStream toTokenize)

Specified by:

create in interface org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory

getTokenPreProcessor

public org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess getTokenPreProcessor()

Specified by:

getTokenPreProcessor in interface org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory

setTokenPreProcessor

public void setTokenPreProcessor(org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess preProcessor)

Specified by:

setTokenPreProcessor in interface org.deeplearning4j.text.tokenization.tokenizerfactory.TokenizerFactory

globalInfo

public java.lang.String globalInfo()

Returns a string describing this object.

Returns:

a description of the object suitable for displaying in the explorer/experimenter gui

listOptions

public java.util.Enumeration<weka.core.Option> listOptions()

Returns an enumeration describing the available options.

Specified by:

listOptions in interface weka.core.OptionHandler

Returns:

an enumeration of all the available options.

getOptions

public java.lang.String[] getOptions()

Gets the current settings of the Classifier.

Specified by:

getOptions in interface weka.core.OptionHandler

Returns:

an array of strings suitable for passing to setOptions

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Parses a given list of options.

Specified by:

setOptions in interface weka.core.OptionHandler

Parameters:

options - the list of options as an array of strings

Throws:

java.lang.Exception - if an option is not supported