OpenML
Supervised Classification on letter

Supervised Classification on letter

Task 3840 Supervised Classification letter 434 runs submitted
0 likes downloaded by 0 people , 0 total downloads 0 issues
Visibility: Public
  • mythbusting_1 study_1 study_107 study_15 study_20 study_41 study_7 under100k under1m
Issue #Downvotes for this reason By


Metric:

434 Runs

Fetching data
Fetching data
Search runs in more detail
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9454, f_measure: 0.9792, kappa: 0.7109, kb_relative_information_score: -15.6787, mean_absolute_error: 0.0426, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9799, predictive_accuracy: 0.9811, prior_entropy: 0.2455, recall: 0.9811, relative_absolute_error: 0.5464, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1344, root_relative_squared_error: 0.6806, scimark_benchmark: 932.3943, usercpu_time_millis: 500, usercpu_time_millis_testing: 50, usercpu_time_millis_training: 450,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9505, f_measure: 0.9802, kappa: 0.7187, kb_relative_information_score: -2074.9116, mean_absolute_error: 0.046, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9824, predictive_accuracy: 0.9824, prior_entropy: 0.2455, recall: 0.9824, relative_absolute_error: 0.5898, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1344, root_relative_squared_error: 0.6807, scimark_benchmark: 911.0478, usercpu_time_millis: 1710, usercpu_time_millis_testing: 20, usercpu_time_millis_training: 1690,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.5, f_measure: 0.9394, kb_relative_information_score: 4486.5698, mean_absolute_error: 0.0407, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9204, predictive_accuracy: 0.9594, prior_entropy: 0.2455, recall: 0.9594, relative_absolute_error: 0.5209, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.2016, root_relative_squared_error: 1.021, scimark_benchmark: 947.9494, usercpu_time_millis: 110, usercpu_time_millis_testing: 20, usercpu_time_millis_training: 90,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9856, f_measure: 0.9952, kappa: 0.9377, kb_relative_information_score: 17788.4535, mean_absolute_error: 0.0063, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9952, predictive_accuracy: 0.9952, prior_entropy: 0.2455, recall: 0.9952, relative_absolute_error: 0.0802, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0677, root_relative_squared_error: 0.3429, scimark_benchmark: 904.3001, usercpu_time_millis: 770, usercpu_time_millis_testing: 160, usercpu_time_millis_training: 610,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9418, f_measure: 0.9394, kb_relative_information_score: -11055.9555, mean_absolute_error: 0.0602, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9204, predictive_accuracy: 0.9594, prior_entropy: 0.2455, recall: 0.9594, relative_absolute_error: 0.7714, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1853, root_relative_squared_error: 0.9385, scimark_benchmark: 945.6434, usercpu_time_millis: 260667510, usercpu_time_millis_testing: 260666950, usercpu_time_millis_training: 560,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9963, f_measure: 0.9958, kappa: 0.9451, kb_relative_information_score: 12642.8741, mean_absolute_error: 0.0158, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9958, predictive_accuracy: 0.9959, prior_entropy: 0.2455, recall: 0.9959, relative_absolute_error: 0.2021, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0624, root_relative_squared_error: 0.3161, scimark_benchmark: 947.9494, usercpu_time_millis: 242840, usercpu_time_millis_testing: 70, usercpu_time_millis_training: 242770,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.8868, f_measure: 0.9394, kb_relative_information_score: -17925.0553, mean_absolute_error: 0.0746, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9204, predictive_accuracy: 0.9594, prior_entropy: 0.2455, recall: 0.9594, relative_absolute_error: 0.9554, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1907, root_relative_squared_error: 0.9658, scimark_benchmark: 901.0726, usercpu_time_millis: 120, usercpu_time_millis_testing: 30, usercpu_time_millis_training: 90,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.4987, f_measure: 0.9394, kb_relative_information_score: -39.8507, mean_absolute_error: 0.078, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9204, predictive_accuracy: 0.9594, prior_entropy: 0.2455, recall: 0.9594, relative_absolute_error: 1.0001, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1975, root_relative_squared_error: 1, scimark_benchmark: 947.9494, usercpu_time_millis: 30, usercpu_time_millis_testing: 20, usercpu_time_millis_training: 10,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9978, f_measure: 0.9986, kappa: 0.982, kb_relative_information_score: 19181.9165, mean_absolute_error: 0.0019, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9986, predictive_accuracy: 0.9986, prior_entropy: 0.2455, recall: 0.9986, relative_absolute_error: 0.0248, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0319, root_relative_squared_error: 0.1614, scimark_benchmark: 901.0726, usercpu_time_millis: 2384800, usercpu_time_millis_testing: 2384610, usercpu_time_millis_training: 190,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9852, f_measure: 0.9983, kappa: 0.9785, kb_relative_information_score: 19345.921, mean_absolute_error: 0.0017, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9983, predictive_accuracy: 0.9984, prior_entropy: 0.2455, recall: 0.9984, relative_absolute_error: 0.0212, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0405, root_relative_squared_error: 0.2052, scimark_benchmark: 889.9795, usercpu_time_millis: 78820, usercpu_time_millis_testing: 900, usercpu_time_millis_training: 77920,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9852, f_measure: 0.9986, kappa: 0.9825, kb_relative_information_score: 19464.8455, mean_absolute_error: 0.0014, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9986, predictive_accuracy: 0.9987, prior_entropy: 0.2455, recall: 0.9987, relative_absolute_error: 0.0176, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0369, root_relative_squared_error: 0.1867, scimark_benchmark: 945.9253, usercpu_time_millis: 153050, usercpu_time_millis_testing: 2120, usercpu_time_millis_training: 150930,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9901, f_measure: 0.9975, kappa: 0.9679, kb_relative_information_score: 19146.0777, mean_absolute_error: 0.0024, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9975, predictive_accuracy: 0.9976, prior_entropy: 0.2455, recall: 0.9976, relative_absolute_error: 0.0307, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0465, root_relative_squared_error: 0.2356, scimark_benchmark: 904.0233, usercpu_time_millis: 32450, usercpu_time_millis_testing: 60, usercpu_time_millis_training: 32390,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9973, f_measure: 0.9921, kappa: 0.8986, kb_relative_information_score: 15876.4316, mean_absolute_error: 0.01, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9921, predictive_accuracy: 0.9922, prior_entropy: 0.2455, recall: 0.9922, relative_absolute_error: 0.1284, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0788, root_relative_squared_error: 0.3991, scimark_benchmark: 945.6434, usercpu_time_millis: 24420, usercpu_time_millis_testing: 150, usercpu_time_millis_training: 24270,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9966, f_measure: 0.9892, kappa: 0.8583, kb_relative_information_score: 12160.0445, mean_absolute_error: 0.017, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9892, predictive_accuracy: 0.9896, prior_entropy: 0.2455, recall: 0.9896, relative_absolute_error: 0.2176, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0888, root_relative_squared_error: 0.4498, scimark_benchmark: 904.3001, usercpu_time_millis: 1070, usercpu_time_millis_testing: 780, usercpu_time_millis_training: 290,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.5, f_measure: 0.9394, kb_relative_information_score: 4486.5698, mean_absolute_error: 0.0407, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9204, predictive_accuracy: 0.9594, prior_entropy: 0.2455, recall: 0.9594, relative_absolute_error: 0.5209, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.2016, root_relative_squared_error: 1.021, scimark_benchmark: 917.7039, usercpu_time_millis: 100090, usercpu_time_millis_testing: 8270, usercpu_time_millis_training: 91820,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.7258, f_measure: 0.9728, kappa: 0.6029, kb_relative_information_score: 11138.7629, mean_absolute_error: 0.0232, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9762, predictive_accuracy: 0.9768, prior_entropy: 0.2455, recall: 0.9768, relative_absolute_error: 0.2973, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.1523, root_relative_squared_error: 0.7713, scimark_benchmark: 945.0164, usercpu_time_millis: 2430, usercpu_time_millis_testing: 30, usercpu_time_millis_training: 2400,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9993, build_cpu_time: 1198.0762, build_memory: 782387218.4, f_measure: 0.9974, kappa: 0.967, kb_relative_information_score: 16801.6095, mean_absolute_error: 0.0064, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9974, predictive_accuracy: 0.9975, prior_entropy: 0.2455, recall: 0.9975, relative_absolute_error: 0.0821, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0481, root_relative_squared_error: 0.2437, scimark_benchmark: 821.7292,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 1663.0269, build_memory: 833528995.2, f_measure: 0.9976, kappa: 0.9696, kb_relative_information_score: 16850.9474, mean_absolute_error: 0.0065, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9976, predictive_accuracy: 0.9977, prior_entropy: 0.2455, recall: 0.9977, relative_absolute_error: 0.0838, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0472, root_relative_squared_error: 0.2392, scimark_benchmark: 938.259,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 1614.194, build_memory: 928298784, f_measure: 0.9976, kappa: 0.9696, kb_relative_information_score: 16850.9474, mean_absolute_error: 0.0065, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9976, predictive_accuracy: 0.9977, prior_entropy: 0.2455, recall: 0.9977, relative_absolute_error: 0.0838, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0472, root_relative_squared_error: 0.2392, scimark_benchmark: 946.197,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 3050.2484, build_memory: 1270473038.4, f_measure: 0.9979, kappa: 0.9728, kb_relative_information_score: 16925.6266, mean_absolute_error: 0.0065, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9979, predictive_accuracy: 0.9979, prior_entropy: 0.2455, recall: 0.9979, relative_absolute_error: 0.0831, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.046, root_relative_squared_error: 0.2328, scimark_benchmark: 945.0883,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 6298.0379, build_memory: 684383380.8, f_measure: 0.998, kappa: 0.974, kb_relative_information_score: 16901.0217, mean_absolute_error: 0.0065, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.998, predictive_accuracy: 0.998, prior_entropy: 0.2455, recall: 0.998, relative_absolute_error: 0.0832, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0458, root_relative_squared_error: 0.2317, scimark_benchmark: 909.9339,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9907, build_cpu_time: 251.5261, build_memory: 1967996369.6, f_measure: 0.9979, kappa: 0.9725, kb_relative_information_score: 19194.4443, mean_absolute_error: 0.0022, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9979, predictive_accuracy: 0.9979, prior_entropy: 0.2455, recall: 0.9979, relative_absolute_error: 0.0286, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.045, root_relative_squared_error: 0.2278, scimark_benchmark: 946.2416,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9912, build_cpu_time: 137.3017, build_memory: 1052988956, f_measure: 0.9964, kappa: 0.9527, kb_relative_information_score: 18621.1295, mean_absolute_error: 0.0037, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9964, predictive_accuracy: 0.9964, prior_entropy: 0.2455, recall: 0.9964, relative_absolute_error: 0.0469, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0574, root_relative_squared_error: 0.2904, scimark_benchmark: 941.4198,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9897, build_cpu_time: 71.2138, build_memory: 131024472.8, f_measure: 0.9943, kappa: 0.9245, kb_relative_information_score: 17945.4418, mean_absolute_error: 0.0057, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9943, predictive_accuracy: 0.9944, prior_entropy: 0.2455, recall: 0.9944, relative_absolute_error: 0.0731, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0716, root_relative_squared_error: 0.3626, scimark_benchmark: 941.4198,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.985, build_cpu_time: 38.7123, build_memory: 140056057.6, f_measure: 0.9915, kappa: 0.8888, kb_relative_information_score: 16868.0902, mean_absolute_error: 0.0083, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9915, predictive_accuracy: 0.9918, prior_entropy: 0.2455, recall: 0.9918, relative_absolute_error: 0.1068, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.086, root_relative_squared_error: 0.4355, scimark_benchmark: 942.9632,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.985, build_cpu_time: 35.9325, build_memory: 1005446426.4, f_measure: 0.9915, kappa: 0.8888, kb_relative_information_score: 16868.0902, mean_absolute_error: 0.0083, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9915, predictive_accuracy: 0.9918, prior_entropy: 0.2455, recall: 0.9918, relative_absolute_error: 0.1068, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.086, root_relative_squared_error: 0.4355, scimark_benchmark: 942.6202,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9988, build_cpu_time: 427.3153, build_memory: 1825837583.2, f_measure: 0.9962, kappa: 0.951, kb_relative_information_score: 16438.8071, mean_absolute_error: 0.0091, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9963, predictive_accuracy: 0.9963, prior_entropy: 0.2455, recall: 0.9963, relative_absolute_error: 0.1165, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0536, root_relative_squared_error: 0.2716, scimark_benchmark: 941.5093,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 893.6055, build_memory: 1088727065.6, f_measure: 0.9962, kappa: 0.9509, kb_relative_information_score: 16470.0125, mean_absolute_error: 0.0091, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9963, predictive_accuracy: 0.9963, prior_entropy: 0.2455, recall: 0.9963, relative_absolute_error: 0.1166, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0536, root_relative_squared_error: 0.2713, scimark_benchmark: 941.3236,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9996, build_cpu_time: 800.438, build_memory: 811783481.6, f_measure: 0.9962, kappa: 0.9509, kb_relative_information_score: 16470.0125, mean_absolute_error: 0.0091, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9963, predictive_accuracy: 0.9963, prior_entropy: 0.2455, recall: 0.9963, relative_absolute_error: 0.1166, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0536, root_relative_squared_error: 0.2713, scimark_benchmark: 943.586,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9983, f_measure: 0.996, kappa: 0.9483, kb_relative_information_score: 16325.8277, mean_absolute_error: 0.0089, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9961, predictive_accuracy: 0.9961, prior_entropy: 0.2455, recall: 0.9961, relative_absolute_error: 0.114, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0551, root_relative_squared_error: 0.2789,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9983, build_cpu_time: 16.657, build_memory: 1861776709.6, f_measure: 0.996, kappa: 0.9483, kb_relative_information_score: 16325.8277, mean_absolute_error: 0.0089, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9961, predictive_accuracy: 0.9961, prior_entropy: 0.2455, recall: 0.9961, relative_absolute_error: 0.114, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0551, root_relative_squared_error: 0.2789, scimark_benchmark: 943.8154,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9983, build_cpu_time: 15.6646, build_memory: 2133075426.4, f_measure: 0.996, kappa: 0.9483, kb_relative_information_score: 16325.8277, mean_absolute_error: 0.0089, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9961, predictive_accuracy: 0.9961, prior_entropy: 0.2455, recall: 0.9961, relative_absolute_error: 0.114, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0551, root_relative_squared_error: 0.2789, scimark_benchmark: 943.4051,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9983, build_cpu_time: 13.5109, build_memory: 2032060532, f_measure: 0.996, kappa: 0.9483, kb_relative_information_score: 16325.8277, mean_absolute_error: 0.0089, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.9961, predictive_accuracy: 0.9961, prior_entropy: 0.2455, recall: 0.9961, relative_absolute_error: 0.114, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0551, root_relative_squared_error: 0.2789, scimark_benchmark: 942.3637,
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9977, build_cpu_time: 7.2521, build_memory: 127590971.2, f_measure: 0.9959, kappa: 0.947, kb_relative_information_score: 16130.856, mean_absolute_error: 0.0088, mean_prior_absolute_error: 0.078, number_of_instances: 20000, precision: 0.996, predictive_accuracy: 0.996, prior_entropy: 0.2455, recall: 0.996, relative_absolute_error: 0.1128, root_mean_prior_squared_error: 0.1975, root_mean_squared_error: 0.0565, root_relative_squared_error: 0.2863, scimark_benchmark: 920.3151,

Metric:

Timeline

Plotting contribution timeline

Leaderboard

Rank Name Top Score Entries Highest rank

Note: The leaderboard ignores resubmissions of previous solutions, as well as parameter variations that do not improve performance.

Challenge

In supervised classification, you are given an input dataset in which instances are labeled with a certain class. The goal is to build a model that predicts the class for future unlabeled instances. The model is evaluated using a train-test procedure, e.g. cross-validation.

To make results by different users comparable, you are given the exact train-test folds to be used, and you need to return at least the predictions generated by your model for each of the test instances. OpenML will use these predictions to calculate a range of evaluation measures on the server.

You can also upload your own evaluation measures, provided that the code for doing so is available from the implementation used. For extremely large datasets, it may be infeasible to upload all predictions. In those cases, you need to compute and provide the evaluations yourself.

Optionally, you can upload the model trained on all the input data. There is no restriction on the file format, but please use a well-known format or PMML.

Given inputs

Expected outputs

evaluations A list of user-defined evaluations of the task as key-value pairs. KeyValue (optional)
model A file containing the model built on all the input data. File (optional)
predictions The desired output format Predictions (optional)

How to submit runs

Using your favorite machine learning environment

Download this task directly in your environment and automatically upload your results

OpenML bootcamp

From your own software

Use one of our APIs to download data from OpenML and upload your results

OpenML APIs