ai.djl.basicdataset

Class TextDataset.Builder<T extends TextDataset.Builder<T>>

java.lang.Object

ai.djl.training.dataset.RandomAccessDataset.BaseBuilder<T>

ai.djl.basicdataset.TextDataset.Builder<T>

Direct Known Subclasses:

StanfordMovieReview.Builder, TatoebaEnglishFrenchDataset.Builder

Enclosing class:

TextDataset

public abstract static class TextDataset.Builder<T extends TextDataset.Builder<T>>
extends ai.djl.training.dataset.RandomAccessDataset.BaseBuilder<T>

Abstract Builder that helps build a TextDataset.

Field Summary

Fields inherited from class ai.djl.training.dataset.RandomAccessDataset.BaseBuilder

dataBatchifier, device, executor, labelBatchifier, limit, pipeline, prefetchNumber, sampler, targetPipeline

Constructor Summary

Constructors

Constructor and Description
Builder()

Method Summary

Modifier and Type	Method and Description
T	optManager(ai.djl.ndarray.NDManager manager) Sets the optional manager for the dataset (default follows engine default).
T	setSourceConfiguration(TextData.Configuration sourceConfiguration) Sets the TextData.Configuration to use for the source text data.
T	setTargetConfiguration(TextData.Configuration targetConfiguration) Sets the TextData.Configuration to use for the target text data.

Methods inherited from class ai.djl.training.dataset.RandomAccessDataset.BaseBuilder

getSampler, optDataBatchifier, optDevice, optExecutor, optLabelBatchifier, optLimit, optPipeline, optTargetPipeline, self, setSampling, setSampling, setSampling

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Builder

public Builder()

Method Detail

setSourceConfiguration

public T setSourceConfiguration(TextData.Configuration sourceConfiguration)

Sets the TextData.Configuration to use for the source text data.

Parameters:

sourceConfiguration - the TextData.Configuration

Returns:

this builder

setTargetConfiguration

public T setTargetConfiguration(TextData.Configuration targetConfiguration)

Sets the TextData.Configuration to use for the target text data.

Parameters:

targetConfiguration - the TextData.Configuration

Returns:

this builder

optManager

public T optManager(ai.djl.ndarray.NDManager manager)

Sets the optional manager for the dataset (default follows engine default).

Parameters:

manager - the manager

Returns:

this builder