ai.djl.basicdataset

Class StanfordMovieReview

java.lang.Object

ai.djl.training.dataset.RandomAccessDataset

ai.djl.basicdataset.TextDataset

ai.djl.basicdataset.StanfordMovieReview

All Implemented Interfaces:

ai.djl.repository.dataset.PreparedDataset, ai.djl.repository.dataset.ZooDataset, ai.djl.training.dataset.Dataset, java.util.RandomAccess

public class StanfordMovieReview
extends TextDataset
implements ai.djl.repository.dataset.ZooDataset

The StanfordMovieReview dataset contains a Application.NLP.SENTIMENT_ANALYSIS set of movie reviews and their sentiment ratings.

The data is sourced from reviews located on IMDB (see here for details).

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StanfordMovieReview.Builder A builder for a StanfordMovieReview.

Nested classes/interfaces inherited from class ai.djl.training.dataset.RandomAccessDataset

ai.djl.training.dataset.RandomAccessDataset.BaseBuilder<T extends ai.djl.training.dataset.RandomAccessDataset.BaseBuilder>

Nested classes/interfaces inherited from interface ai.djl.training.dataset.Dataset

ai.djl.training.dataset.Dataset.Usage

Field Summary

Fields inherited from class ai.djl.basicdataset.TextDataset

manager, sourceTextData, targetTextData

Fields inherited from class ai.djl.training.dataset.RandomAccessDataset

dataBatchifier, device, executor, labelBatchifier, limit, pipeline, prefetchNumber, sampler, targetPipeline

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	StanfordMovieReview(StanfordMovieReview.Builder builder) Creates a new instance of StanfordMovieReview with the given necessary configurations.

Method Summary

Modifier and Type	Method and Description
protected long	availableSize()
static StanfordMovieReview.Builder	builder() Creates a new builder to build a StanfordMovieReview.
ai.djl.training.dataset.Record	get(ai.djl.ndarray.NDManager manager, long index)
ai.djl.repository.Artifact	getArtifact()
ai.djl.repository.MRL	getMrl()
ai.djl.repository.Repository	getRepository()
ai.djl.training.dataset.Dataset.Usage	getUsage()
boolean	isPrepared()
void	prepareData(ai.djl.training.dataset.Dataset.Usage usage)
void	setPrepared(boolean prepared)
void	useDefaultArtifact()

Methods inherited from class ai.djl.basicdataset.TextDataset

getProcessedText, getRawText, getTextEmbedding, getVocabulary, preprocess

Methods inherited from class ai.djl.training.dataset.RandomAccessDataset

getData, getData, randomSplit, size

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.djl.repository.dataset.ZooDataset

prepare

Methods inherited from interface ai.djl.training.dataset.Dataset

getData

Methods inherited from interface ai.djl.repository.dataset.PreparedDataset

prepare

Constructor Detail

StanfordMovieReview

protected StanfordMovieReview(StanfordMovieReview.Builder builder)

Creates a new instance of StanfordMovieReview with the given necessary configurations.

Parameters:

builder - a builder with the necessary configurations

Method Detail

builder

public static StanfordMovieReview.Builder builder()

Creates a new builder to build a StanfordMovieReview.

Returns:

a new builder

getMrl

public ai.djl.repository.MRL getMrl()

Specified by:

getMrl in interface ai.djl.repository.dataset.ZooDataset

getRepository

public ai.djl.repository.Repository getRepository()

Specified by:

getRepository in interface ai.djl.repository.dataset.ZooDataset

getArtifact

public ai.djl.repository.Artifact getArtifact()

Specified by:

getArtifact in interface ai.djl.repository.dataset.ZooDataset

getUsage

public ai.djl.training.dataset.Dataset.Usage getUsage()

Specified by:

getUsage in interface ai.djl.repository.dataset.ZooDataset

isPrepared

public boolean isPrepared()

Specified by:

isPrepared in interface ai.djl.repository.dataset.ZooDataset

setPrepared

public void setPrepared(boolean prepared)

Specified by:

setPrepared in interface ai.djl.repository.dataset.ZooDataset

useDefaultArtifact

public void useDefaultArtifact()
                        throws java.io.IOException

Specified by:

useDefaultArtifact in interface ai.djl.repository.dataset.ZooDataset

Throws:

java.io.IOException

prepareData

public void prepareData(ai.djl.training.dataset.Dataset.Usage usage)
                 throws java.io.IOException

Specified by:

prepareData in interface ai.djl.repository.dataset.ZooDataset

Throws:

java.io.IOException

get

public ai.djl.training.dataset.Record get(ai.djl.ndarray.NDManager manager,
                                          long index)

Specified by:

get in class ai.djl.training.dataset.RandomAccessDataset

availableSize

protected long availableSize()

Specified by:

availableSize in class ai.djl.training.dataset.RandomAccessDataset