OpenML

JavaScript is required to properly view the contents of this page!

okcupid-stem

active ARFF Publicly available Visibility: public Uploaded 10-01-2019 by Florian Pargent
0 likes downloaded by 0 people , 0 total downloads 0 issues 0 downvotes

Issue	#Downvotes for this reason	By

Loading wiki

Help us complete this description Edit

User profile data for San Francisco OkCupid users published in [Kim, A. Y., & Escobedo-Land, A. (2015). OKCupid data for introductory statistics and data science courses. Journal of Statistics Education, 23(2).]. The curated dataset was downloaded from [https://github.com/rudeboybert/JSE_OkCupid]. The original dataset was created with the use of a python script that pulled the data from public profiles on www.okcupid.com on 06/30/2012. It includes people (n = 59946) within a 25 mile radius of San Francisco, who were online in the last year (06/30/2011), with at least one profile picture. Permission to use this data was obtained by the author of the original paper from OkCupid president and co-founder Christian Rudder under the condition that the dataset remains public. As target, the variable 'job' was collapsed into three categories: 'stem', 'non_stem', and 'student'. STEM jobs were defined as 'job' %in% c('computer / hardware / software', 'science / tech / engineering'). Observations with 'job' %in% c('unemployed', 'retired', 'rather not say') or missing values in 'job' were removed. The original dataset also included ten open text variables 'essay0' to 'essay9', which were removed from the dataset uploaded here. The dataset further includes the date/time variable 'last_online' (ignored by default) which could be used to construct additional features. Using OkCupid data for predicting STEM jobs was inspired by Max Kuhns book 'Feature Engineering and Selection: A Practical Approach for Predictive Models' [https://bookdown.org/max/FES/].

20 features

job (target)	nominal	3 unique values 0 missing
age	numeric	53 unique values 0 missing
body_type	nominal	12 unique values 3905 missing
diet	nominal	18 unique values 19382 missing
drinks	nominal	6 unique values 1552 missing
drugs	nominal	3 unique values 11622 missing
education	nominal	32 unique values 3486 missing
ethnicity	nominal	208 unique values 3989 missing
height	numeric	57 unique values 1 missing
income	nominal	12 unique values 39886 missing
last_online (ignore)	string	26169 unique values 0 missing
location	nominal	184 unique values 0 missing
offspring	nominal	15 unique values 28914 missing
orientation	nominal	3 unique values 0 missing
pets	nominal	15 unique values 14938 missing
religion	nominal	45 unique values 15126 missing
sex	nominal	2 unique values 0 missing
sign	nominal	48 unique values 7700 missing
smokes	nominal	5 unique values 3572 missing
speaks	nominal	7019 unique values 34 missing
status	nominal	5 unique values 0 missing

Show all 20 features

62 properties

NumberOfInstances

50789

Number of instances (rows) of the dataset.

NumberOfFeatures

Number of attributes (columns) of the dataset.

NumberOfClasses

Number of distinct values of the target attribute (if it is nominal).

NumberOfMissingValues

154107

Number of missing values in the dataset.

NumberOfInstancesWithMissingValues

48622

Number of instances with at least one value missing.

NumberOfNumericFeatures

Number of numeric attributes.

NumberOfSymbolicFeatures

Number of nominal attributes.

ClassEntropy

1.12

Entropy of the target attribute values.

MeanNoiseToSignalRatio

65.47

An estimate of the amount of irrelevant information in the attributes regarding the class. Equals (MeanAttributeEntropy - MeanMutualInformation) divided by MeanMutualInformation.

Quartile2AttributeEntropy

2.06

Second quartile (Median) of entropy among attributes.

Dimensionality

Number of attributes divided by the number of instances.

MeanNominalAttDistinctValues

424.17

Average number of distinct values among the attributes of the nominal type.

Quartile2KurtosisOfNumericAtts

5.01

Second quartile (Median) of kurtosis among attributes of the numeric type.

EquivalentNumberOfAtts

31.63

Number of attributes needed to optimally describe the class (under the assumption of independence among attributes). Equals ClassEntropy divided by MeanMutualInformation.

MeanSkewnessOfNumericAtts

0.33

Mean skewness among attributes of the numeric type.

Quartile2MeansOfNumericAtts

50.41

Second quartile (Median) of means among attributes of the numeric type.

MajorityClassPercentage

71.57

Percentage of instances belonging to the most frequent class.

MeanStdDevOfNumericAtts

6.67

Mean standard deviation of attributes of the numeric type.

Quartile2MutualInformation

0.01

Second quartile (Median) of mutual information between the nominal attributes and the target attribute.

MajorityClassSize

36350

Number of instances belonging to the most frequent class.

MinAttributeEntropy

0.46

Minimal entropy among attributes.

Quartile2SkewnessOfNumericAtts

0.33

Second quartile (Median) of skewness among attributes of the numeric type.

MaxAttributeEntropy

6.52

Maximum entropy among attributes.

MinKurtosisOfNumericAtts

1.41

Minimum kurtosis among attributes of the numeric type.

PercentageOfBinaryFeatures

Percentage of binary attributes.

Quartile2StdDevOfNumericAtts

6.67

Second quartile (Median) of standard deviation of attributes of the numeric type.

MaxKurtosisOfNumericAtts

8.62

Maximum kurtosis among attributes of the numeric type.

MinMeansOfNumericAtts

32.47

Minimum of means among attributes of the numeric type.

PercentageOfInstancesWithMissingValues

95.73

Percentage of instances having missing values.

Quartile3AttributeEntropy

3.13

Third quartile of entropy among attributes.

MaxMeansOfNumericAtts

68.34

Maximum of means among attributes of the numeric type.

MinMutualInformation

Minimal mutual information between the nominal attributes and the target attribute.

PercentageOfMissingValues

15.17

Percentage of missing values.

Quartile3KurtosisOfNumericAtts

8.62

Third quartile of kurtosis among attributes of the numeric type.

MaxMutualInformation

0.21

Maximum mutual information between the nominal attributes and the target attribute.

MinNominalAttDistinctValues

The minimal number of distinct values among attributes of the nominal type.

PercentageOfNumericFeatures

Percentage of numeric attributes.

Quartile3MeansOfNumericAtts

68.34

Third quartile of means among attributes of the numeric type.

MaxNominalAttDistinctValues

7019

The maximum number of distinct values among attributes of the nominal type.

MinSkewnessOfNumericAtts

-0.57

Minimum skewness among attributes of the numeric type.

PercentageOfSymbolicFeatures

Percentage of nominal attributes.

Quartile3MutualInformation

0.03

Third quartile of mutual information between the nominal attributes and the target attribute.

MaxSkewnessOfNumericAtts

1.23

Maximum skewness among attributes of the numeric type.

MinStdDevOfNumericAtts

3.97

Minimum standard deviation of attributes of the numeric type.

Quartile1AttributeEntropy

0.99

First quartile of entropy among attributes.

Quartile3SkewnessOfNumericAtts

1.23

Third quartile of skewness among attributes of the numeric type.

MaxStdDevOfNumericAtts

9.38

Maximum standard deviation of attributes of the numeric type.

MinorityClassPercentage

9.61

Percentage of instances belonging to the least frequent class.

Quartile1KurtosisOfNumericAtts

1.41

First quartile of kurtosis among attributes of the numeric type.

Quartile3StdDevOfNumericAtts

9.38

Third quartile of standard deviation of attributes of the numeric type.

MeanAttributeEntropy

2.36

Average entropy of the attributes.

MinorityClassSize

4882

Number of instances belonging to the least frequent class.

Quartile1MeansOfNumericAtts

32.47

First quartile of means among attributes of the numeric type.

StdvNominalAttDistinctValues

1646.95

Standard deviation of the number of distinct values among attributes of the nominal type.

MeanKurtosisOfNumericAtts

5.01

Mean kurtosis among attributes of the numeric type.

NumberOfBinaryFeatures

Number of binary attributes.

Quartile1MutualInformation

First quartile of mutual information between the nominal attributes and the target attribute.

MeanMeansOfNumericAtts

50.41

Mean of means among attributes of the numeric type.

Quartile1SkewnessOfNumericAtts

-0.57

First quartile of skewness among attributes of the numeric type.

AutoCorrelation

0.57

Average class difference between consecutive instances.

MeanMutualInformation

0.04

Average mutual information between the nominal attributes and the target attribute.

Quartile1StdDevOfNumericAtts

3.97

First quartile of standard deviation of attributes of the numeric type.

Show all 62 properties