weka.dl4j.text.tokenization.tokenizer.factory

Class NGramTokenizerFactory

java.lang.Object

weka.dl4j.text.tokenization.tokenizer.factory.TokenizerFactory<NGramTokenizerFactoryImpl>

weka.dl4j.text.tokenization.tokenizer.factory.NGramTokenizerFactory

All Implemented Interfaces:

java.io.Serializable, weka.core.OptionHandler, ApiWrapper<NGramTokenizerFactoryImpl>

public class NGramTokenizerFactory
extends TokenizerFactory<NGramTokenizerFactoryImpl>
implements java.io.Serializable, weka.core.OptionHandler

A DeepLearning4j's TokenizerFactory interface for Weka core tokenizers.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
NGramTokenizerFactory()

Method Summary

Modifier and Type	Method and Description
java.lang.String	getDelimiters()
int	getNMax()
int	getNMin()
java.lang.String[]	getOptions() Gets the current settings of the Classifier.
java.lang.String	globalInfo() Returns a string describing this object.
void	initializeBackend() Initialize the DL4J backend.
java.util.Enumeration<weka.core.Option>	listOptions() Returns an enumeration describing the available options.
void	setDelimiters(java.lang.String delimiters)
void	setNMax(int nMax)
void	setNMin(int nMin)
void	setOptions(java.lang.String[] options) Parses a given list of options.

Methods inherited from class weka.dl4j.text.tokenization.tokenizer.factory.TokenizerFactory

create, getBackend, setBackend

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface weka.core.OptionHandler

makeCopy

Constructor Detail

NGramTokenizerFactory

public NGramTokenizerFactory()

Method Detail

globalInfo

public java.lang.String globalInfo()

Returns a string describing this object.

Returns:

a description of the object suitable for displaying in the explorer/experimenter gui

listOptions

public java.util.Enumeration<weka.core.Option> listOptions()

Returns an enumeration describing the available options.

Specified by:

listOptions in interface weka.core.OptionHandler

Overrides:

listOptions in class TokenizerFactory<NGramTokenizerFactoryImpl>

Returns:

an enumeration of all the available options.

getOptions

public java.lang.String[] getOptions()

Gets the current settings of the Classifier.

Specified by:

getOptions in interface weka.core.OptionHandler

Overrides:

getOptions in class TokenizerFactory<NGramTokenizerFactoryImpl>

Returns:

an array of strings suitable for passing to setOptions

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Parses a given list of options.

Specified by:

setOptions in interface weka.core.OptionHandler

Overrides:

setOptions in class TokenizerFactory<NGramTokenizerFactoryImpl>

Parameters:

options - the list of options as an array of strings

Throws:

java.lang.Exception - if an option is not supported

getNMax

@OptionMetadata(displayName="NMax",
                description="NGram max size.",
                commandLineParamName="NMax",
                commandLineParamSynopsis="-NMax <int>",
                displayOrder=0)
public int getNMax()

setNMax

public void setNMax(int nMax)

getNMin

@OptionMetadata(displayName="NMin",
                description="NGram min size.",
                commandLineParamName="NMin",
                commandLineParamSynopsis="-NMin <int>",
                displayOrder=1)
public int getNMin()

setNMin

public void setNMin(int nMin)

getDelimiters

@OptionMetadata(displayName="delimiters",
                description="Set of delimiter characters to use in tokenizing (\\r, \\n and \\t can be used for carriage-return, line-feed and tab).",
                commandLineParamName="delimiters",
                commandLineParamSynopsis="-delimiters <int>",
                displayOrder=2)
public java.lang.String getDelimiters()

setDelimiters

public void setDelimiters(java.lang.String delimiters)

initializeBackend

public void initializeBackend()

Description copied from interface: ApiWrapper

Initialize the DL4J backend.

Specified by:

initializeBackend in interface ApiWrapper<NGramTokenizerFactoryImpl>