weka.dl4j.iterators.dataset

Class DefaultDataSetIterator

java.lang.Object

weka.dl4j.iterators.dataset.DefaultDataSetIterator

All Implemented Interfaces:

java.io.Serializable, java.util.Iterator<org.nd4j.linalg.dataset.DataSet>, org.nd4j.linalg.dataset.api.iterator.DataSetIterator

public class DefaultDataSetIterator
extends java.lang.Object
implements org.nd4j.linalg.dataset.api.iterator.DataSetIterator, java.io.Serializable

An nd4j mini-batch iterator that iterates a given dataset.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DefaultDataSetIterator(org.nd4j.linalg.dataset.DataSet data, int batchSize) Constructs a new dataset iterator.

Method Summary

Modifier and Type	Method and Description
boolean	asyncSupported() Whether the iterator can be used asynchronously.
int	batch() The size of the mini batches.
java.util.List<java.lang.String>	getLabels() Gets the labels.
org.nd4j.linalg.dataset.api.DataSetPreProcessor	getPreProcessor() Gets the preprocessor.
boolean	hasNext() Whether another batch of data is still available.
int	inputColumns() Returns the number of input columns.
org.nd4j.linalg.dataset.DataSet	next() Returns the next mini batch of data.
org.nd4j.linalg.dataset.DataSet	next(int num) Returns a batch of the given size
void	remove() Enables removing of a mini-batch.
void	reset() Resets the cursor.
boolean	resetSupported() Whether the iterator can be reset.
void	setPreProcessor(org.nd4j.linalg.dataset.api.DataSetPreProcessor preProcessor) Sets the preprocessor.
int	totalOutcomes() Returns the total number of labels.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Constructor Detail

DefaultDataSetIterator

public DefaultDataSetIterator(org.nd4j.linalg.dataset.DataSet data,
                              int batchSize)

Constructs a new dataset iterator.

Parameters:

data - The dataset to operate on

batchSize - The batch size

Method Detail

hasNext

public boolean hasNext()

Whether another batch of data is still available.

Specified by:

hasNext in interface java.util.Iterator<org.nd4j.linalg.dataset.DataSet>

Returns:

true if another batch is still available

next

public org.nd4j.linalg.dataset.DataSet next()

Returns the next mini batch of data.

Specified by:

next in interface java.util.Iterator<org.nd4j.linalg.dataset.DataSet>

Returns:

the dataset corresponding to the mini batch

next

public org.nd4j.linalg.dataset.DataSet next(int num)

Returns a batch of the given size

Specified by:

next in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Parameters:

num - the size of the batch to return

Returns:

a mini-batch of the given size

inputColumns

public int inputColumns()

Returns the number of input columns.

Specified by:

inputColumns in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

the number of input columns

totalOutcomes

public int totalOutcomes()

Returns the total number of labels.

Specified by:

totalOutcomes in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

the total number of labels

reset

public void reset()

Resets the cursor.

Specified by:

reset in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

resetSupported

public boolean resetSupported()

Whether the iterator can be reset.

Specified by:

resetSupported in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

true

asyncSupported

public boolean asyncSupported()

Whether the iterator can be used asynchronously.

Specified by:

asyncSupported in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

false

batch

public int batch()

The size of the mini batches.

Specified by:

batch in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

the size of the mini batches

getPreProcessor

public org.nd4j.linalg.dataset.api.DataSetPreProcessor getPreProcessor()

Gets the preprocessor.

Specified by:

getPreProcessor in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

preProcessor

setPreProcessor

public void setPreProcessor(org.nd4j.linalg.dataset.api.DataSetPreProcessor preProcessor)

Sets the preprocessor.

Specified by:

setPreProcessor in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Parameters:

preProcessor - A DataSet preprocessor.

getLabels

public java.util.List<java.lang.String> getLabels()

Gets the labels.

Specified by:

getLabels in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Returns:

the labels

remove

public void remove()

Enables removing of a mini-batch.

Specified by:

remove in interface java.util.Iterator<org.nd4j.linalg.dataset.DataSet>