Data
monks-problems-3

monks-problems-3

active ARFF Publicly available Visibility: public Uploaded 26-08-2014 by Joaquin Vanschoren
0 likes downloaded by 0 people , 0 total downloads 0 issues 0 downvotes
  • artificial Machine Learning mythbusting_1 OpenML100 study_1 study_123 study_135 study_14 study_144 study_15 study_20 study_34 study_41 study_50 study_52 study_7 uci
Issue #Downvotes for this reason By


Loading wiki
Help us complete this description Edit
Author: Sebastian Thrun (Carnegie Mellon University) Source: [UCI](https://archive.ics.uci.edu/ml/datasets/MONK's+Problems) - October 1992 Please cite: [UCI](https://archive.ics.uci.edu/ml/citation_policy.html) The Monk's Problems: Problem 3 Once upon a time, in July 1991, the monks of Corsendonk Priory were faced with a school held in their priory, namely the 2nd European Summer School on Machine Learning. After listening more than one week to a wide variety of learning algorithms, they felt rather confused: Which algorithm would be optimal? And which one to avoid? As a consequence of this dilemma, they created a simple task on which all learning algorithms ought to be compared: the three MONK's problems. The target concept associated with the 3rd Monk's problem is the binary outcome of the logical formula: MONK-3: (a5 = 3 and a4 = 1) or (a5 /= 4 and a2 /= 3) In addition, 5% class noise was added to the training set In this dataset, the original train and test sets were merged to allow other sampling procedures. However, the original train-test splits can be found as one of the OpenML tasks. ### Attribute information: * attr1: 1, 2, 3 * attr2: 1, 2, 3 * attr3: 1, 2 * attr4: 1, 2, 3 * attr5: 1, 2, 3, 4 * attr6: 1, 2 ### Relevant papers The MONK's Problems - A Performance Comparison of Different Learning Algorithms, by S.B. Thrun, J. Bala, E. Bloedorn, I. Bratko, B. Cestnik, J. Cheng, K. De Jong, S. Dzeroski, S.E. Fahlman, D. Fisher, R. Hamann, K. Kaufman, S. Keller, I. Kononenko, J. Kreuziger, R.S. Michalski, T. Mitchell, P. Pachowicz, Y. Reich H. Vafaie, W. Van de Welde, W. Wenzel, J. Wnek, and J. Zhang. Technical Report CS-CMU-91-197, Carnegie Mellon University, Dec. 1991.

7 features

class (target)nominal2 unique values
0 missing
attr1nominal3 unique values
0 missing
attr2nominal3 unique values
0 missing
attr3nominal2 unique values
0 missing
attr4nominal3 unique values
0 missing
attr5nominal4 unique values
0 missing
attr6nominal2 unique values
0 missing

107 properties

554
Number of instances (rows) of the dataset.
7
Number of attributes (columns) of the dataset.
2
Number of distinct values of the target attribute (if it is nominal).
0
Number of missing values in the dataset.
0
Number of instances with at least one value missing.
0
Number of numeric attributes.
7
Number of nominal attributes.
Second quartile (Median) of skewness among attributes of the numeric type.
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 3
0.55
Kappa coefficient achieved by the landmarker weka.classifiers.trees.DecisionStump
Maximum of means among attributes of the numeric type.
0
Minimal mutual information between the nominal attributes and the target attribute.
42.86
Percentage of binary attributes.
Second quartile (Median) of standard deviation of attributes of the numeric type.
0.95
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
0.01
Number of attributes divided by the number of instances.
0.32
Maximum mutual information between the nominal attributes and the target attribute.
2
The minimal number of distinct values among attributes of the nominal type.
0
Percentage of instances having missing values.
1.69
Third quartile of entropy among attributes.
0.06
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
9.44
Number of attributes needed to optimally describe the class (under the assumption of independence among attributes). Equals ClassEntropy divided by MeanMutualInformation.
4
The maximum number of distinct values among attributes of the nominal type.
Minimum skewness among attributes of the numeric type.
0
Percentage of missing values.
Third quartile of kurtosis among attributes of the numeric type.
0.77
Average class difference between consecutive instances.
0.89
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 1
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .00001
Maximum skewness among attributes of the numeric type.
Minimum standard deviation of attributes of the numeric type.
0
Percentage of numeric attributes.
Third quartile of means among attributes of the numeric type.
0.98
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.95
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
0.01
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .00001
Maximum standard deviation of attributes of the numeric type.
48.01
Percentage of instances belonging to the least frequent class.
100
Percentage of nominal attributes.
0.31
Third quartile of mutual information between the nominal attributes and the target attribute.
0.03
Error rate achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.06
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
0.98
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .00001
1.46
Average entropy of the attributes.
266
Number of instances belonging to the least frequent class.
1
First quartile of entropy among attributes.
Third quartile of skewness among attributes of the numeric type.
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.trees.DecisionStump -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.89
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 2
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .0001
Mean kurtosis among attributes of the numeric type.
0.98
Area Under the ROC Curve achieved by the landmarker weka.classifiers.bayes.NaiveBayes
First quartile of kurtosis among attributes of the numeric type.
Third quartile of standard deviation of attributes of the numeric type.
0.98
Area Under the ROC Curve achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.95
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
0.01
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .0001
Mean of means among attributes of the numeric type.
0.04
Error rate achieved by the landmarker weka.classifiers.bayes.NaiveBayes
First quartile of means among attributes of the numeric type.
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 1
0.03
Error rate achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.06
Error rate achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
0.98
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .0001
0.11
Average mutual information between the nominal attributes and the target attribute.
0.93
Kappa coefficient achieved by the landmarker weka.classifiers.bayes.NaiveBayes
0
First quartile of mutual information between the nominal attributes and the target attribute.
0.03
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 1
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.bayes.NaiveBayes -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.89
Kappa coefficient achieved by the landmarker weka.classifiers.trees.RandomTree -depth 3
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.J48 -C .001
12.78
An estimate of the amount of irrelevant information in the attributes regarding the class. Equals (MeanAttributeEntropy - MeanMutualInformation) divided by MeanMutualInformation.
3
Number of binary attributes.
First quartile of skewness among attributes of the numeric type.
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 1
0.98
Area Under the ROC Curve achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.76
Standard deviation of the number of distinct values among attributes of the nominal type.
0.01
Error rate achieved by the landmarker weka.classifiers.trees.J48 -C .001
2.71
Average number of distinct values among the attributes of the nominal type.
First quartile of standard deviation of attributes of the numeric type.
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 2
0.03
Error rate achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.98
Area Under the ROC Curve achieved by the landmarker weka.classifiers.lazy.IBk
0.98
Kappa coefficient achieved by the landmarker weka.classifiers.trees.J48 -C .001
Mean skewness among attributes of the numeric type.
1.58
Second quartile (Median) of entropy among attributes.
0.03
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 2
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.lazy.IBk -E "weka.attributeSelection.CfsSubsetEval -P 1 -E 1" -S "weka.attributeSelection.BestFirst -D 1 -N 5" -W
0.04
Error rate achieved by the landmarker weka.classifiers.lazy.IBk
51.99
Percentage of instances belonging to the most frequent class.
Mean standard deviation of attributes of the numeric type.
Second quartile (Median) of kurtosis among attributes of the numeric type.
0.95
Kappa coefficient achieved by the landmarker weka.classifiers.trees.REPTree -L 2
1
Entropy of the target attribute values.
0.92
Kappa coefficient achieved by the landmarker weka.classifiers.lazy.IBk
288
Number of instances belonging to the most frequent class.
1
Minimal entropy among attributes.
Second quartile (Median) of means among attributes of the numeric type.
0.99
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.REPTree -L 3
0.78
Area Under the ROC Curve achieved by the landmarker weka.classifiers.trees.DecisionStump
2
Maximum entropy among attributes.
Minimum kurtosis among attributes of the numeric type.
0
Second quartile (Median) of mutual information between the nominal attributes and the target attribute.
0.03
Error rate achieved by the landmarker weka.classifiers.trees.REPTree -L 3
0.22
Error rate achieved by the landmarker weka.classifiers.trees.DecisionStump
Maximum kurtosis among attributes of the numeric type.
Minimum of means among attributes of the numeric type.

36 tasks

73042 runs - estimation_procedure: 10-fold Crossvalidation - target_feature: class
32406 runs - estimation_procedure: 10-fold Crossvalidation - evaluation_measure: precision - target_feature: class
335 runs - estimation_procedure: 33% Holdout set - evaluation_measure: predictive_accuracy - target_feature: class
211 runs - estimation_procedure: 10 times 10-fold Crossvalidation - evaluation_measure: predictive_accuracy - target_feature: class
1 runs - estimation_procedure: 5 times 2-fold Crossvalidation - target_feature: class
216 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: 10-fold Learning Curve - target_feature: class
0 runs - estimation_procedure: Interleaved Test then Train - evaluation_measure: predictive_accuracy - target_feature: class
0 runs - estimation_procedure: Interleaved Test then Train - target_feature: class
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - target_feature: class
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
1308 runs - target_feature: class
1301 runs - target_feature: class
0 runs - target_feature: class
0 runs - target_feature: class
0 runs - target_feature: class
0 runs - target_feature: class
0 runs - target_feature: class
0 runs - target_feature: class
Define a new task