ai.idylnlp.nlp.filters.confidence

Class HeuristicConfidenceFilter

java.lang.Object

ai.idylnlp.nlp.filters.confidence.HeuristicConfidenceFilter

All Implemented Interfaces:

ConfidenceFilter

public class HeuristicConfidenceFilter
extends Object
implements ConfidenceFilter

Implementation of ConfidenceFilter that uses a T-test to determine if an entity should be filtered or not.

Author:

Mountain Fog, Inc.

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<String,org.apache.commons.math3.stat.descriptive.SynchronizedSummaryStatistics>	statistics

Constructor Summary

Constructors

Constructor and Description
HeuristicConfidenceFilter(ConfidenceFilterSerializer serializer) Creates a new filter.
HeuristicConfidenceFilter(ConfidenceFilterSerializer serializer, int minSampleSize, double alpha) Creates a new filter.

Method Summary

Modifier and Type	Method and Description
int	deserialize()
boolean	isDirty()
void	reset(String modelId)
void	resetAll()
int	serialize()
boolean	test(String modelId, double entityConfidence, double confidenceThreshold)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

statistics

protected Map<String,org.apache.commons.math3.stat.descriptive.SynchronizedSummaryStatistics> statistics

Constructor Detail

HeuristicConfidenceFilter

public HeuristicConfidenceFilter(ConfidenceFilterSerializer serializer)

Creates a new filter.

HeuristicConfidenceFilter

public HeuristicConfidenceFilter(ConfidenceFilterSerializer serializer,
                                 int minSampleSize,
                                 double alpha)

Creates a new filter.

Parameters:

minSampleSize - The minimum sample size before tests are used to filter the entities.

alpha - The alpha value for the test. 0.5 for 95% is recommended.

Method Detail

test

public boolean test(String modelId,
                    double entityConfidence,
                    double confidenceThreshold)

Specified by:

test in interface ConfidenceFilter

serialize

public int serialize()
              throws Exception

Specified by:

serialize in interface ConfidenceFilter

Throws:

Exception

deserialize

public int deserialize()
                throws Exception

Specified by:

deserialize in interface ConfidenceFilter

Throws:

Exception

resetAll

public void resetAll()

Specified by:

resetAll in interface ConfidenceFilter

reset

public void reset(String modelId)

Specified by:

reset in interface ConfidenceFilter

isDirty

public boolean isDirty()

Specified by:

isDirty in interface ConfidenceFilter