Skip to content

Commit

Permalink
Included ESL data
Browse files Browse the repository at this point in the history
  • Loading branch information
pagutierrez committed Jan 20, 2018
1 parent a5cad02 commit 53b58b8
Show file tree
Hide file tree
Showing 2 changed files with 491 additions and 3 deletions.
6 changes: 3 additions & 3 deletions doc/orca-tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -106,7 +106,7 @@ title('AMAE performance (smaller is better)')

*** Exercise *** : you should repeat this barplots but considering:
- One `global` (i.e. a metric where the class a priori probability is not considered) **nominal** metric.
- One `global` **ordinal** metric.
- One `global` **ordinal** metric.
- One **nominal** metric specifically designed for imbalanced datasets.
- One **ordinal** metric specifically designed for imbalanced datasets.

Expand Down Expand Up @@ -531,9 +531,9 @@ end
```
The source code of this example is in [exampleERAHHoldout.m](../src/code-examples/exampleERAHHoldout.m). As can be checked, the `cvpartition` function performs the partitions, receiving the target vector. The targets are used in order to obtain a stratified partition.

*** Exercise *** : you should prepare a `30holdout` set of partitions for the dataset `ESL`, which is included in the [exampledata](/exampledata). Try to find the differences between this dataset and ERA.
*** Exercise *** : you should prepare a `30holdout` set of partitions for the dataset `ESL`, which is included in the folder [exampledata](/exampledata). Try to find the description of this dataset in the Internet and spot the main differences with respect to ERA.

*** Exercise *** : compare the results obtained for `ERA` and `ESL` datasets using the same experimental design you used in the [experiment section](orca-tutorial.md#launch-experiments-through-ini-files). Generate bar plots for comparing accuracy and AMAE.
*** Exercise *** : train classifiers for both `ERA` and `ESL` datasets, using the same experimental design you used in the [experiment section](orca-tutorial.md#launch-experiments-through-ini-files). Compare the results obtained for both datasets. Generate bar plots for comparing accuracy and AMAE. Which one is better classified? Which one is better ordered?

### Warning about highly imbalanced datasets

Expand Down
Loading

0 comments on commit 53b58b8

Please sign in to comment.