ai.idylnlp.nlp.utils.ngrams

Class NgramUtils

java.lang.Object

ai.idylnlp.nlp.utils.ngrams.NgramUtils

public class NgramUtils
extends Object

Utility functions for N-Grams.

Author:

Mountain Fog, Inc.

Method Summary

Modifier and Type	Method and Description
static String[]	getNgrams(String[] tokens) Gets all n-grams for a given set of tokens.
static String[]	getNgrams(String[] tokens, int len) Returns the N-Grams for a string of a given length.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getNgrams

public static String[] getNgrams(String[] tokens,
                                 int len)

Returns the N-Grams for a string of a given length.

Parameters:

tokens - An array of tokens.

len - The length of the n-grams.

Returns:

A collection of N-Grams for the input string.

getNgrams

public static String[] getNgrams(String[] tokens)

Gets all n-grams for a given set of tokens.

Parameters:

tokens - The tokens.

Returns:

All n-grams for a given set of tokens.