Task
Supervised Data Stream Classification on 20_newsgroups.drift

Supervised Data Stream Classification on 20_newsgroups.drift

Task 125960 Supervised Data Stream Classification 20_newsgroups.drift 124 runs submitted
0 likes downloaded by 0 people , 0 total downloads 0 issues
Visibility: Public
Issue #Downvotes for this reason By


Metric:

124 Runs

Fetching data
Fetching data
Search runs in more detail
ID's
Sort: most recent
124 results
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.3617, f_measure: 0.1388, kappa: -0.0022, kb_relative_information_score: -309120.8073, mean_absolute_error: 0.8871, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.8933, predictive_accuracy: 0.1177, prior_entropy: 1, recall: 0.1177, relative_absolute_error: 1.7743, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9385, root_relative_squared_error: 1.8771,
Jan van Rijn 8 years ago
ran flow moa.kNN(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9898, f_measure: 0.987, kappa: 0.8618, kb_relative_information_score: 384262.966, mean_absolute_error: 0.021, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9869, predictive_accuracy: 0.987, prior_entropy: 1, recall: 0.987, relative_absolute_error: 0.042, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.0998, root_relative_squared_error: 0.1995,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.4664, f_measure: 0.1523, kappa: 0.0039, kb_relative_information_score: -299521.2858, mean_absolute_error: 0.875, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9246, predictive_accuracy: 0.1277, prior_entropy: 1, recall: 0.1277, relative_absolute_error: 1.7499, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9336, root_relative_squared_error: 1.8672,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.3825, f_measure: 0.1556, kappa: 0.0016, kb_relative_information_score: -297714.9201, mean_absolute_error: 0.8724, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.913, predictive_accuracy: 0.1286, prior_entropy: 1, recall: 0.1286, relative_absolute_error: 1.7448, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9334, root_relative_squared_error: 1.8669,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.4137, f_measure: 0.1545, kappa: 0.0016, kb_relative_information_score: -298434.4389, mean_absolute_error: 0.8734, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9127, predictive_accuracy: 0.128, prior_entropy: 1, recall: 0.128, relative_absolute_error: 1.7467, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9337, root_relative_squared_error: 1.8673,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.3165, f_measure: 0.1549, kappa: -0.0035, kb_relative_information_score: -299180.621, mean_absolute_error: 0.8743, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.8885, predictive_accuracy: 0.1262, prior_entropy: 1, recall: 0.1262, relative_absolute_error: 1.7487, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9339, root_relative_squared_error: 1.8678,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.3519, f_measure: 0.1544, kappa: 0.0016, kb_relative_information_score: -298548.7275, mean_absolute_error: 0.8735, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9127, predictive_accuracy: 0.1279, prior_entropy: 1, recall: 0.1279, relative_absolute_error: 1.747, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.9339, root_relative_squared_error: 1.8677,
Jan van Rijn 8 years ago
ran flow moa.AccuracyWeightedEnsemble_WEKAClassifier(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.4662, f_measure: 0.1536, kappa: -0.0029, kb_relative_information_score: -299969.8171, mean_absolute_error: 0.8752, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.8911, predictive_accuracy: 0.1257, prior_entropy: 1, recall: 0.1257, relative_absolute_error: 1.7504, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.935, root_relative_squared_error: 1.8699,
Jan van Rijn 8 years ago
ran flow moa.HoeffdingTree(7) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.8806, f_measure: 0.9599, kappa: 0.5654, kb_relative_information_score: 354805.4966, mean_absolute_error: 0.0614, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.959, predictive_accuracy: 0.9612, prior_entropy: 1, recall: 0.9612, relative_absolute_error: 0.1228, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.1975, root_relative_squared_error: 0.395,
Jan van Rijn 8 years ago
ran flow moa.SPegasos(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.5, f_measure: 0.9256, kappa: -0, kb_relative_information_score: 359944, mean_absolute_error: 0.05, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9025, predictive_accuracy: 0.95, prior_entropy: 1, recall: 0.95, relative_absolute_error: 0.1, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.2236, root_relative_squared_error: 0.4472,
Jan van Rijn 8 years ago
ran flow moa.SPegasos(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.914, f_measure: 0.9826, kappa: 0.81, kb_relative_information_score: 386418.1088, mean_absolute_error: 0.0169, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9825, predictive_accuracy: 0.9832, prior_entropy: 1, recall: 0.9832, relative_absolute_error: 0.0338, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.1271, root_relative_squared_error: 0.2542,
Jan van Rijn 8 years ago
ran flow moa.SGD(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.7138, f_measure: 0.9594, kappa: 0.5284, kb_relative_information_score: 370944, mean_absolute_error: 0.0363, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9589, predictive_accuracy: 0.9638, prior_entropy: 1, recall: 0.9638, relative_absolute_error: 0.0725, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.1904, root_relative_squared_error: 0.3808,
Jan van Rijn 8 years ago
ran flow moa.SGD(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.77, f_measure: 0.9281, kappa: 0.0406, kb_relative_information_score: 336509.0717, mean_absolute_error: 0.0887, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9353, predictive_accuracy: 0.9505, prior_entropy: 1, recall: 0.9505, relative_absolute_error: 0.1774, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.2065, root_relative_squared_error: 0.4129,
Jan van Rijn 8 years ago
ran flow moa.kNNwithPAW(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9859, f_measure: 0.984, kappa: 0.8263, kb_relative_information_score: 376604.6264, mean_absolute_error: 0.0322, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.984, predictive_accuracy: 0.9846, prior_entropy: 1, recall: 0.9846, relative_absolute_error: 0.0644, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.1146, root_relative_squared_error: 0.2292,
Jan van Rijn 8 years ago
ran flow moa.kNN(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9547, f_measure: 0.9905, kappa: 0.9007, kb_relative_information_score: 392370.3725, mean_absolute_error: 0.0095, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9906, predictive_accuracy: 0.9905, prior_entropy: 1, recall: 0.9905, relative_absolute_error: 0.0189, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.0949, root_relative_squared_error: 0.1897,
Jan van Rijn 8 years ago
ran flow moa.HoeffdingOptionTree(7) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.7904, f_measure: 0.9538, kappa: 0.4533, kb_relative_information_score: 348327.6607, mean_absolute_error: 0.0718, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9531, predictive_accuracy: 0.9598, prior_entropy: 1, recall: 0.9598, relative_absolute_error: 0.1437, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.2008, root_relative_squared_error: 0.4015,
Jan van Rijn 8 years ago
ran flow moa.Perceptron(5) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.5124, f_measure: 0.9326, kappa: 0.1073, kb_relative_information_score: 362182.469, mean_absolute_error: 0.0472, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9539, predictive_accuracy: 0.9529, prior_entropy: 1, recall: 0.9529, relative_absolute_error: 0.0945, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.2169, root_relative_squared_error: 0.4338,
Jan van Rijn 8 years ago
ran flow moa.MajorityClass(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.5066, f_measure: 0.9256, kappa: -0, kb_relative_information_score: 332542.0122, mean_absolute_error: 0.0962, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9025, predictive_accuracy: 0.95, prior_entropy: 1, recall: 0.95, relative_absolute_error: 0.1924, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.218, root_relative_squared_error: 0.4359,
Jan van Rijn 8 years ago
ran flow moa.NoChange(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.8179, f_measure: 0.9654, kappa: 0.6359, kb_relative_information_score: 372270, mean_absolute_error: 0.0346, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9654, predictive_accuracy: 0.9654, prior_entropy: 1, recall: 0.9654, relative_absolute_error: 0.0692, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.186, root_relative_squared_error: 0.372,
Jan van Rijn 8 years ago
ran flow moa.RandomHoeffdingTree(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.7294, f_measure: 0.9373, kappa: 0.219, kb_relative_information_score: 337620.382, mean_absolute_error: 0.0864, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9341, predictive_accuracy: 0.9499, prior_entropy: 1, recall: 0.9499, relative_absolute_error: 0.1729, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.2137, root_relative_squared_error: 0.4274,
Jan van Rijn 8 years ago
ran flow moa.HoeffdingAdaptiveTree(2) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.9842, f_measure: 0.9903, kappa: 0.8982, kb_relative_information_score: 391854.2759, mean_absolute_error: 0.0102, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9903, predictive_accuracy: 0.9903, prior_entropy: 1, recall: 0.9903, relative_absolute_error: 0.0205, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.0968, root_relative_squared_error: 0.1935,
Jan van Rijn 8 years ago
ran flow moa.ASHoeffdingTree(4) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.8806, f_measure: 0.9599, kappa: 0.5654, kb_relative_information_score: 354805.4966, mean_absolute_error: 0.0614, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.959, predictive_accuracy: 0.9612, prior_entropy: 1, recall: 0.9612, relative_absolute_error: 0.1228, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.1975, root_relative_squared_error: 0.395,
Jan van Rijn 8 years ago
ran flow moa.RuleClassifier(3) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 1, f_measure: 1, kappa: 0.9999, kb_relative_information_score: 399933.9993, mean_absolute_error: 0, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 1, predictive_accuracy: 1, prior_entropy: 1, recall: 1, relative_absolute_error: 0, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.0027, root_relative_squared_error: 0.0055,
Jan van Rijn 8 years ago
ran flow moa.NaiveBayes(4) on task Supervised Data Stream Classification on data set 20_newsgroups.drift
0 likes - 0 downloads - 0 reach - area_under_roc_curve: 0.6054, f_measure: 0.7821, kappa: 0.0354, kb_relative_information_score: 153425.3052, mean_absolute_error: 0.3095, mean_prior_absolute_error: 0.5, number_of_instances: 399940, precision: 0.9134, predictive_accuracy: 0.697, prior_entropy: 1, recall: 0.697, relative_absolute_error: 0.6191, root_mean_prior_squared_error: 0.5, root_mean_squared_error: 0.5211, root_relative_squared_error: 1.0421,

Metric:

Timeline

Plotting contribution timeline

Leaderboard

Rank Name Top Score Entries Highest rank

Note: The leaderboard ignores resubmissions of previous solutions, as well as parameter variations that do not improve performance.

Challenge

Given a dataset with a nominal target, various data samples of increasing size are defined. A model is build for each individual data sample; from this a learning curve can be drawn.

Given inputs

estimation_procedure Interleaved Test then Train
source_data 20_newsgroups.drift (2)
target_feature class

Expected outputs

evaluations A list of user-defined evaluations of the task as key-value pairs. KeyValue (optional)
predictions The desired output format Predictions (optional)

How to submit runs

Using your favorite machine learning environment

Download this task directly in your environment and automatically upload your results

OpenML bootcamp

From your own software

Use one of our APIs to download data from OpenML and upload your results

OpenML APIs