evaluate_classifiers¶

tsml_eval.evaluation.evaluate_classifiers(classifier_results, save_path, error_on_missing=True, continue_on_missing=False, eval_name=None, estimator_names=None)[source]¶

Evaluate multiple classifiers on multiple datasets.

Writes multiple csv files and figures to save_path, one for each statistic evaluated. Provides a summary csv file with the average statistic and average rank for each classifier.

Parameters:

classifier_resultslist of ClassifierResults: The results to evaluate.
save_pathstr: The path to save the evaluation results to.
error_on_missingbool, default=True: Whether to raise an error if results are missing.
continue_on_missingbool, default=False: Whether to continue the evaluation if results are missing. If False, removes datasets with missing results from the evaluation. If True, keeps all datasets but does not include summary results, figures or p-values. Treats any missing stat as NaN.
eval_namestr, default=None: The name of the evaluation, used in save_path.
estimator_nameslist of str, default=None: The names of the estimator for each classifier result. If None, uses the estimator_name attribute of each classifier result.