weka.dl4j.iterators.instance.sequence.text.cnn

Class CnnTextFilesEmbeddingInstanceIterator

java.lang.Object

weka.dl4j.iterators.instance.AbstractInstanceIterator

weka.dl4j.iterators.instance.sequence.AbstractSequenceInstanceIterator

weka.dl4j.iterators.instance.sequence.text.AbstractTextEmbeddingIterator

weka.dl4j.iterators.instance.sequence.text.cnn.CnnTextEmbeddingInstanceIterator

weka.dl4j.iterators.instance.sequence.text.cnn.CnnTextFilesEmbeddingInstanceIterator

All Implemented Interfaces:

java.io.Serializable, weka.core.OptionHandler

public class CnnTextFilesEmbeddingInstanceIterator
extends CnnTextEmbeddingInstanceIterator

Iterator that constructs datasets from text data given as a set of files.

See Also:

Serialized Form

Field Summary

Fields inherited from class weka.dl4j.iterators.instance.sequence.text.AbstractTextEmbeddingIterator

wordVectors

Constructor Summary

Constructors

Constructor and Description
CnnTextFilesEmbeddingInstanceIterator()

Method Summary

Modifier and Type	Method and Description
java.lang.String[]	getOptions() Gets the current settings of the Classifier.
org.deeplearning4j.iterator.LabeledSentenceProvider	getSentenceProvider(weka.core.Instances data) Create a sentence provider from the given data.
java.io.File	getTextsLocation()
java.lang.String	globalInfo()
java.util.Enumeration<weka.core.Option>	listOptions() Returns an enumeration describing the available options.
void	setOptions(java.lang.String[] options) Parses a given list of options.
void	setTextsLocation(java.io.File textsLocation)
void	validate(weka.core.Instances data) Validates the input dataset

Methods inherited from class weka.dl4j.iterators.instance.sequence.text.cnn.CnnTextEmbeddingInstanceIterator

getDataSetIterator

Methods inherited from class weka.dl4j.iterators.instance.sequence.text.AbstractTextEmbeddingIterator

getStopwords, getTokenizerFactory, getTokenPreProcess, getTruncateLength, getWordVectorLocation, getWordVectors, initialize, initWordVectors, setStopwords, setTokenizerFactory, setTokenPreProcess, setTruncateLength, setWordVectorLocation, setWordVectors

Methods inherited from class weka.dl4j.iterators.instance.AbstractInstanceIterator

getDataSetIterator, getTrainBatchSize, setTrainBatchSize

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface weka.core.OptionHandler

makeCopy

Constructor Detail

CnnTextFilesEmbeddingInstanceIterator

public CnnTextFilesEmbeddingInstanceIterator()

Method Detail

getSentenceProvider

public org.deeplearning4j.iterator.LabeledSentenceProvider getSentenceProvider(weka.core.Instances data)

Description copied from class: AbstractTextEmbeddingIterator

Create a sentence provider from the given data.

Overrides:

getSentenceProvider in class AbstractTextEmbeddingIterator

Parameters:

data - Data

Returns:

Sentence provider

validate

public void validate(weka.core.Instances data)
              throws InvalidInputDataException

Description copied from class: AbstractInstanceIterator

Validates the input dataset

Overrides:

validate in class CnnTextEmbeddingInstanceIterator

Parameters:

data - the input dataset

Throws:

InvalidInputDataException - if validation is unsuccessful

getTextsLocation

@OptionMetadata(displayName="directory of text files",
                description="The directory containing the text files (default = user home).",
                commandLineParamName="textsLocation",
                commandLineParamSynopsis="-textsLocation <string>",
                displayOrder=3)
public java.io.File getTextsLocation()

setTextsLocation

public void setTextsLocation(java.io.File textsLocation)

globalInfo

public java.lang.String globalInfo()

listOptions

public java.util.Enumeration<weka.core.Option> listOptions()

Returns an enumeration describing the available options.

Specified by:

listOptions in interface weka.core.OptionHandler

Overrides:

listOptions in class CnnTextEmbeddingInstanceIterator

Returns:

an enumeration of all the available options.

getOptions

public java.lang.String[] getOptions()

Gets the current settings of the Classifier.

Specified by:

getOptions in interface weka.core.OptionHandler

Overrides:

getOptions in class CnnTextEmbeddingInstanceIterator

Returns:

an array of strings suitable for passing to setOptions

setOptions

public void setOptions(java.lang.String[] options)
                throws java.lang.Exception

Parses a given list of options.

Specified by:

setOptions in interface weka.core.OptionHandler

Overrides:

setOptions in class CnnTextEmbeddingInstanceIterator

Parameters:

options - the list of options as an array of strings

Throws:

java.lang.Exception - if an option is not supported