public abstract class ApproximateRandomizationTest<Obs extends de.pado.sigf.Observation<?>>
extends java.lang.Object
Constructor and Description |
---|
ApproximateRandomizationTest() |
Modifier and Type | Method and Description |
---|---|
double |
apply_test(java.util.Vector<Obs> orig_observations_1,
java.util.Vector<Obs> orig_observations_2,
java.lang.Class<? extends de.pado.sigf.Statistic<Obs>> statistics_class,
long iterations,
java.lang.String measure)
apply_test runs the test.
|
abstract java.util.Vector<Obs> |
readInput(java.lang.String filename)
Method to read observations from a file
|
void |
run(java.lang.String filename1,
java.lang.String filename2,
java.lang.Class<? extends de.pado.sigf.Statistic<Obs>> statisticClass,
long numberOfIterations,
java.lang.String measure)
Start the computation of the significance of the difference between two
models.
|
public double apply_test(java.util.Vector<Obs> orig_observations_1, java.util.Vector<Obs> orig_observations_2, java.lang.Class<? extends de.pado.sigf.Statistic<Obs>> statistics_class, long iterations, java.lang.String measure) throws java.lang.InstantiationException, java.lang.IllegalAccessException
java.lang.InstantiationException
java.lang.IllegalAccessException
public abstract java.util.Vector<Obs> readInput(java.lang.String filename) throws java.io.IOException, java.io.FileNotFoundException
filename:
- File with observations (one observation per line)Vector<Observation>
: A vector with a Observation for each
observation. Must be compatible with the used implementation of
Statistic.addObservation()java.io.IOException
java.io.FileNotFoundException
public void run(java.lang.String filename1, java.lang.String filename2, java.lang.Class<? extends de.pado.sigf.Statistic<Obs>> statisticClass, long numberOfIterations, java.lang.String measure) throws java.lang.InstantiationException, java.lang.IllegalAccessException, java.lang.ClassNotFoundException
filename1:
- Observations for model1filename2:
- Observations for model2statisticClass:
- Class to be used as evaluation statistic (must
inherit from Statistic)numberOfIterations:
- Number of iterations to be used (try
10.000-100.000, depending on size of dataset)measure
- evaluation score for AverageART-Statistic (precision,
recall, or f1-measure). If the Statistic is of type
AverageART
, then this argument keeps null
.java.lang.InstantiationException
java.lang.IllegalAccessException
java.lang.ClassNotFoundException