Package weka.experiment
Interface ResultProducer
-
- All Superinterfaces:
java.io.Serializable
- All Known Implementing Classes:
AveragingResultProducer,CrossValidationResultProducer,DatabaseResultProducer,LearningRateResultProducer,RandomSplitResultProducer
public interface ResultProducer extends java.io.SerializableThis interface defines the methods required for an object that produces results for different randomizations of a dataset.Possible implementations of ResultProducer:
- Random test/train splits
- CrossValidation splits
- LearningCurve splits (multiple results per run?)
- Averaging results of other result producers
- Version:
- $Revision: 1.7 $
- Author:
- Len Trigg (trigg@cs.waikato.ac.nz)
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description voiddoRun(int run)Gets the results for a specified run number.voiddoRunKeys(int run)Gets the keys for a specified run number.java.lang.StringgetCompatibilityState()Gets a description of the internal settings of the result producer, sufficient for distinguishing a ResultProducer instance from another with different settings (ignoring those settings set through this interface).java.lang.String[]getKeyNames()Gets the names of each of the key columns produced for a single run.java.lang.Object[]getKeyTypes()Gets the data types of each of the key columns produced for a single run.java.lang.String[]getResultNames()Gets the names of each of the result columns produced for a single run.java.lang.Object[]getResultTypes()Gets the data types of each of the result columns produced for a single run.voidpostProcess()Perform any postprocessing.voidpreProcess()Prepare to generate results.voidsetAdditionalMeasures(java.lang.String[] additionalMeasures)Sets a list of method names for additional measures to look for in SplitEvaluators.voidsetInstances(Instances instances)Sets the dataset that results will be obtained for.voidsetResultListener(ResultListener listener)Sets the object to send results of each run to.
-
-
-
Method Detail
-
setInstances
void setInstances(Instances instances)
Sets the dataset that results will be obtained for.- Parameters:
instances- a value of type 'Instances'.
-
setResultListener
void setResultListener(ResultListener listener)
Sets the object to send results of each run to.- Parameters:
listener- a value of type 'ResultListener'
-
setAdditionalMeasures
void setAdditionalMeasures(java.lang.String[] additionalMeasures)
Sets a list of method names for additional measures to look for in SplitEvaluators.- Parameters:
additionalMeasures- a list of method names
-
preProcess
void preProcess() throws java.lang.ExceptionPrepare to generate results. The ResultProducer should call preProcess(this) on the ResultListener it is to send results to.- Throws:
java.lang.Exception- if an error occurs during preprocessing.
-
postProcess
void postProcess() throws java.lang.ExceptionPerform any postprocessing. When this method is called, it indicates that no more requests to generate results for the current experiment will be sent. The ResultProducer should call preProcess(this) on the ResultListener it is to send results to.- Throws:
java.lang.Exception- if an error occurs
-
doRun
void doRun(int run) throws java.lang.ExceptionGets the results for a specified run number. Different run numbers correspond to different randomizations of the data. Results produced should be sent to the current ResultListener, but only if the ResultListener says the result is required (it may already have that result). A single run may produce multiple results.- Parameters:
run- the run number to generate results for.- Throws:
java.lang.Exception- if a problem occurs while getting the results
-
doRunKeys
void doRunKeys(int run) throws java.lang.ExceptionGets the keys for a specified run number. Different run numbers correspond to different randomizations of the data. Keys produced should be sent to the current ResultListener- Parameters:
run- the run number to get keys for.- Throws:
java.lang.Exception- if a problem occurs while getting the keys
-
getKeyNames
java.lang.String[] getKeyNames() throws java.lang.ExceptionGets the names of each of the key columns produced for a single run. The names should not contain spaces (use '_' instead for easy translation.)- Returns:
- an array containing the name of each key column
- Throws:
java.lang.Exception- if the key names could not be determined (perhaps because of a problem from a nested sub-resultproducer)
-
getKeyTypes
java.lang.Object[] getKeyTypes() throws java.lang.ExceptionGets the data types of each of the key columns produced for a single run.- Returns:
- an array containing objects of the type of each key column. The objects should be Strings, or Doubles.
- Throws:
java.lang.Exception- if the key types could not be determined (perhaps because of a problem from a nested sub-resultproducer)
-
getResultNames
java.lang.String[] getResultNames() throws java.lang.ExceptionGets the names of each of the result columns produced for a single run. The names should not contain spaces (use '_' instead for easy translation.)- Returns:
- an array containing the name of each result column
- Throws:
java.lang.Exception- if the result names could not be determined (perhaps because of a problem from a nested sub-resultproducer)
-
getResultTypes
java.lang.Object[] getResultTypes() throws java.lang.ExceptionGets the data types of each of the result columns produced for a single run.- Returns:
- an array containing objects of the type of each result column. The objects should be Strings, or Doubles.
- Throws:
java.lang.Exception- if the result types could not be determined (perhaps because of a problem from a nested sub-resultproducer)
-
getCompatibilityState
java.lang.String getCompatibilityState()
Gets a description of the internal settings of the result producer, sufficient for distinguishing a ResultProducer instance from another with different settings (ignoring those settings set through this interface). For example, a cross-validation ResultProducer may have a setting for the number of folds. For a given state, the results produced should be compatible. Typically if a ResultProducer is an OptionHandler, this string will represent those command line arguments required to set the ResultProducer to that state.- Returns:
- the description of the ResultProducer state, or null if no state is defined
-
-