notebook1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Why R Conference? Introduction to mlr"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Spam E-mail Database  \n",
    "--------------------\n",
    "\n",
    "\n",
    "### Description\n",
    "\n",
    "A data set collected at Hewlett-Packard Labs, that classifies 4601 e-mails as spam or non-spam. In addition to this class label there are 57 variables indicating the frequency of certain words and characters in the e-mail.\n",
    "\n",
    "### Format\n",
    "\n",
    "A data frame with 4601 observations and 58 variables.\n",
    "\n",
    "The first 48 variables contain the frequency of the variable name (e.g., business) in the e-mail. If the variable name starts with num (e.g., num650) the it indicates the frequency of the corresponding number (e.g., 650). The variables 49-54 indicate the frequency of the characters ‘;’, ‘(’, ‘\\[’, ‘!’, ‘\\\\$’, and ‘\\\\#’. The variables 55-57 contain the average, longest and total run-length of capital letters. Variable 58 indicates the type of the mail and is either `\"nonspam\"` or `\"spam\"`, i.e. unsolicited commercial e-mail.\n",
    "\n",
    "### Details\n",
    "\n",
    "The data set contains 2788 e-mails classified as `\"nonspam\"` and 1813 classified as `\"spam\"`.\n",
    "\n",
    "The “spam” concept is diverse: advertisements for products/web sites, make money fast schemes, chain letters, pornography... This collection of spam e-mails came from the collectors' postmaster and individuals who had filed spam. The collection of non-spam e-mails came from filed work and personal e-mails, and hence the word 'george' and the area code '650' are indicators of non-spam. These are useful when constructing a personalized spam filter. One would either have to blind such non-spam indicators or get a very wide collection of non-spam to generate a general purpose spam filter.\n",
    "\n",
    "### Source\n",
    "\n",
    "*   Creators: Mark Hopkins, Erik Reeber, George Forman, Jaap Suermondt at Hewlett-Packard Labs, 1501 Page Mill Rd., Palo Alto, CA 94304\n",
    "    \n",
    "*   Donor: George Forman (gforman at nospam hpl.hp.com) 650-857-7835\n",
    "    \n",
    "\n",
    "These data have been taken from the UCI Repository Of Machine Learning Databases at [http://www.ics.uci.edu/~mlearn/MLRepository.html](http://www.ics.uci.edu/~mlearn/MLRepository.html)\n",
    "\n",
    "### References\n",
    "\n",
    "T. Hastie, R. Tibshirani, J.H. Friedman. _The Elements of Statistical Learning._ Springer, 2001.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercise\n",
    "---------------\n",
    "\n",
    "a) Create a binary classifcation task from the spam data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Supervised task: spam\n",
       "Type: classif\n",
       "Target: type\n",
       "Observations: 4601\n",
       "Features:\n",
       "   numerics     factors     ordered functionals \n",
       "         57           0           0           0 \n",
       "Missings: FALSE\n",
       "Has weights: FALSE\n",
       "Has blocking: FALSE\n",
       "Has coordinates: FALSE\n",
       "Classes: 2\n",
       "nonspam    spam \n",
       "   2788    1813 \n",
       "Positive class: spam"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "library(mlr)\n",
    "data(spam, package = \"kernlab\")\n",
    "spam.task = makeClassifTask(id = \"spam\", data = spam, target = \"type\", positive = \"spam\")\n",
    "spam.task"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "b) List all learners that could be trained on `spam.task`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead><tr><th scope=col>class</th><th scope=col>name</th><th scope=col>short.name</th><th scope=col>package</th><th scope=col>note</th><th scope=col>type</th><th scope=col>installed</th><th scope=col>numerics</th><th scope=col>factors</th><th scope=col>ordered</th><th scope=col>⋯</th><th scope=col>multiclass</th><th scope=col>class.weights</th><th scope=col>featimp</th><th scope=col>oobpreds</th><th scope=col>functionals</th><th scope=col>single.functional</th><th scope=col>se</th><th scope=col>lcens</th><th scope=col>rcens</th><th scope=col>icens</th></tr></thead>\n",
       "<tbody>\n",
       "\t<tr><td>classif.binomial                                                                                                                                                                                                                        </td><td>Binomial Regression                                                                                                                                                                                                                     </td><td>binomial                                                                                                                                                                                                                                </td><td>stats                                                                                                                                                                                                                                   </td><td>Delegates to `glm` with freely choosable binomial link function via learner parameter `link`. We set 'model' to FALSE by default to save memory.                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.cforest                                                                                                                                                                                                                         </td><td>Random forest based on conditional inference trees                                                                                                                                                                                      </td><td>cforest                                                                                                                                                                                                                                 </td><td>party                                                                                                                                                                                                                                   </td><td>See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                       </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.ctree                                                                                                                                                                                                                           </td><td>Conditional Inference Trees                                                                                                                                                                                                             </td><td>ctree                                                                                                                                                                                                                                   </td><td>party                                                                                                                                                                                                                                   </td><td>See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                       </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.featureless                                                                                                                                                                                                                     </td><td>Featureless classifier                                                                                                                                                                                                                  </td><td>featureless                                                                                                                                                                                                                             </td><td>mlr                                                                                                                                                                                                                                     </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.fnn                                                                                                                                                                                                                             </td><td>Fast k-Nearest Neighbour                                                                                                                                                                                                                </td><td>fnn                                                                                                                                                                                                                                     </td><td>FNN                                                                                                                                                                                                                                     </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.gausspr                                                                                                                                                                                                                         </td><td>Gaussian Processes                                                                                                                                                                                                                      </td><td>gausspr                                                                                                                                                                                                                                 </td><td>kernlab                                                                                                                                                                                                                                 </td><td>Kernel parameters have to be passed directly and not by using the `kpar` list in `gausspr`.\n",
       "    Note that `fit` has been set to `FALSE` by default for speed.                                                                          </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.h2o.deeplearning                                                                                                                                                                                                                </td><td>h2o.deeplearning                                                                                                                                                                                                                        </td><td>h2o.dl                                                                                                                                                                                                                                  </td><td>h2o                                                                                                                                                                                                                                     </td><td>The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                                                                                                 </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.h2o.gbm                                                                                                                                                                                                                         </td><td>h2o.gbm                                                                                                                                                                                                                                 </td><td>h2o.gbm                                                                                                                                                                                                                                 </td><td>h2o                                                                                                                                                                                                                                     </td><td>'distribution' is set automatically to 'gaussian'.                                                                                                                                                                                      </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.h2o.glm                                                                                                                                                                                                                         </td><td>h2o.glm                                                                                                                                                                                                                                 </td><td>h2o.glm                                                                                                                                                                                                                                 </td><td>h2o                                                                                                                                                                                                                                     </td><td>`family` is always set to `\"binomial\"` to get a binary classifier. The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                              </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.h2o.randomForest                                                                                                                                                                                                                </td><td>h2o.randomForest                                                                                                                                                                                                                        </td><td>h2o.rf                                                                                                                                                                                                                                  </td><td>h2o                                                                                                                                                                                                                                     </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.knn                                                                                                                                                                                                                             </td><td>k-Nearest Neighbor                                                                                                                                                                                                                      </td><td>knn                                                                                                                                                                                                                                     </td><td>class                                                                                                                                                                                                                                   </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.ksvm                                                                                                                                                                                                                            </td><td>Support Vector Machines                                                                                                                                                                                                                 </td><td>ksvm                                                                                                                                                                                                                                    </td><td>kernlab                                                                                                                                                                                                                                 </td><td>Kernel parameters have to be passed directly and not by using the `kpar` list in `ksvm`. Note that `fit` has been set to `FALSE` by default for speed.                                                                                  </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.lda                                                                                                                                                                                                                             </td><td>Linear Discriminant Analysis                                                                                                                                                                                                            </td><td>lda                                                                                                                                                                                                                                     </td><td>MASS                                                                                                                                                                                                                                    </td><td>Learner parameter `predict.method` maps to `method` in `predict.lda`.                                                                                                                                                                   </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.logreg                                                                                                                                                                                                                          </td><td>Logistic Regression                                                                                                                                                                                                                     </td><td>logreg                                                                                                                                                                                                                                  </td><td>stats                                                                                                                                                                                                                                   </td><td>Delegates to `glm` with `family = binomial(link = 'logit')`. We set 'model' to FALSE by default to save memory.                                                                                                                         </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.lssvm                                                                                                                                                                                                                           </td><td>Least Squares Support Vector Machine                                                                                                                                                                                                    </td><td>lssvm                                                                                                                                                                                                                                   </td><td>kernlab                                                                                                                                                                                                                                 </td><td>`fitted` has been set to `FALSE` by default for speed.                                                                                                                                                                                  </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.lvq1                                                                                                                                                                                                                            </td><td>Learning Vector Quantization                                                                                                                                                                                                            </td><td>lvq1                                                                                                                                                                                                                                    </td><td>class                                                                                                                                                                                                                                   </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.multinom                                                                                                                                                                                                                        </td><td>Multinomial Regression                                                                                                                                                                                                                  </td><td>multinom                                                                                                                                                                                                                                </td><td>nnet                                                                                                                                                                                                                                    </td><td>                                                                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.nnet                                                                                                                                                                                                                            </td><td>Neural Network                                                                                                                                                                                                                          </td><td>nnet                                                                                                                                                                                                                                    </td><td>nnet                                                                                                                                                                                                                                    </td><td>`size` has been set to `3` by default.                                                                                                                                                                                                  </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.probit                                                                                                                                                                                                                          </td><td>Probit Regression                                                                                                                                                                                                                       </td><td>probit                                                                                                                                                                                                                                  </td><td>stats                                                                                                                                                                                                                                   </td><td>Delegates to `glm` with `family = binomial(link = 'probit')`. We set 'model' to FALSE by default to save memory.                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.qda                                                                                                                                                                                                                             </td><td>Quadratic Discriminant Analysis                                                                                                                                                                                                         </td><td>qda                                                                                                                                                                                                                                     </td><td>MASS                                                                                                                                                                                                                                    </td><td>Learner parameter `predict.method` maps to `method` in `predict.qda`.                                                                                                                                                                   </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.randomForest                                                                                                                                                                                                                    </td><td>Random Forest                                                                                                                                                                                                                           </td><td>rf                                                                                                                                                                                                                                      </td><td>randomForest                                                                                                                                                                                                                            </td><td>Note that the rf can freeze the R process if trained on a task with 1 feature which is constant. This can happen in feature forward selection, also due to resampling, and you need to remove such features with removeConstantFeatures.</td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.rpart                                                                                                                                                                                                                           </td><td>Decision Tree                                                                                                                                                                                                                           </td><td>rpart                                                                                                                                                                                                                                   </td><td>rpart                                                                                                                                                                                                                                   </td><td>`xval` has been set to `0` by default for speed.                                                                                                                                                                                        </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td> TRUE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "\t<tr><td>classif.xgboost                                                                                                                                                                                                                         </td><td>eXtreme Gradient Boosting                                                                                                                                                                                                               </td><td>xgboost                                                                                                                                                                                                                                 </td><td>xgboost                                                                                                                                                                                                                                 </td><td>All settings are passed directly, rather than through `xgboost`'s `params` argument. `nrounds` has been set to `1` and `verbose` to `0` by default. `num_class` is set internally, so do not set this manually.                         </td><td>classif                                                                                                                                                                                                                                 </td><td>TRUE                                                                                                                                                                                                                                    </td><td>TRUE                                                                                                                                                                                                                                    </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>⋯                                                                                                                                                                                                                                       </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td> TRUE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td><td>FALSE                                                                                                                                                                                                                                   </td></tr>\n",
       "</tbody>\n",
       "</table>\n"
      ],
      "text/latex": [
       "\\begin{tabular}{r|lllllllllllllllllllllllll}\n",
       " class & name & short.name & package & note & type & installed & numerics & factors & ordered & ⋯ & multiclass & class.weights & featimp & oobpreds & functionals & single.functional & se & lcens & rcens & icens\\\\\n",
       "\\hline\n",
       "\t classif.binomial                                                                                                                                                                                                                         & Binomial Regression                                                                                                                                                                                                                      & binomial                                                                                                                                                                                                                                 & stats                                                                                                                                                                                                                                    & Delegates to `glm` with freely choosable binomial link function via learner parameter `link`. We set 'model' to FALSE by default to save memory.                                                                                         & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.cforest                                                                                                                                                                                                                            & Random forest based on conditional inference trees                                                                                                                                                                                         & cforest                                                                                                                                                                                                                                    & party                                                                                                                                                                                                                                      & See `?ctree\\_control` for possible breakage for nominal features with missingness.                                                                                                                                                        & classif                                                                                                                                                                                                                                    & TRUE                                                                                                                                                                                                                                       & TRUE                                                                                                                                                                                                                                       &  TRUE                                                                                                                                                                                                                                      &  TRUE                                                                                                                                                                                                                                      & ⋯                                                                                                                                                                                                                                          &  TRUE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      &  TRUE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                     \\\\\n",
       "\t classif.ctree                                                                                                                                                                                                                              & Conditional Inference Trees                                                                                                                                                                                                                & ctree                                                                                                                                                                                                                                      & party                                                                                                                                                                                                                                      & See `?ctree\\_control` for possible breakage for nominal features with missingness.                                                                                                                                                        & classif                                                                                                                                                                                                                                    & TRUE                                                                                                                                                                                                                                       & TRUE                                                                                                                                                                                                                                       &  TRUE                                                                                                                                                                                                                                      &  TRUE                                                                                                                                                                                                                                      & ⋯                                                                                                                                                                                                                                          &  TRUE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                     \\\\\n",
       "\t classif.featureless                                                                                                                                                                                                                      & Featureless classifier                                                                                                                                                                                                                   & featureless                                                                                                                                                                                                                              & mlr                                                                                                                                                                                                                                      &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.fnn                                                                                                                                                                                                                              & Fast k-Nearest Neighbour                                                                                                                                                                                                                 & fnn                                                                                                                                                                                                                                      & FNN                                                                                                                                                                                                                                      &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.gausspr                                                                                                                                                                                                                          & Gaussian Processes                                                                                                                                                                                                                       & gausspr                                                                                                                                                                                                                                  & kernlab                                                                                                                                                                                                                                  & Kernel parameters have to be passed directly and not by using the `kpar` list in `gausspr`.\n",
       "    Note that `fit` has been set to `FALSE` by default for speed.                                                                           & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.h2o.deeplearning                                                                                                                                                                                                                     & h2o.deeplearning                                                                                                                                                                                                                             & h2o.dl                                                                                                                                                                                                                                       & h2o                                                                                                                                                                                                                                          & The default value of `missing\\_values\\_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                                                                                                  & classif                                                                                                                                                                                                                                      & TRUE                                                                                                                                                                                                                                         & TRUE                                                                                                                                                                                                                                         &  TRUE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & ⋯                                                                                                                                                                                                                                            &  TRUE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                       \\\\\n",
       "\t classif.h2o.gbm                                                                                                                                                                                                                          & h2o.gbm                                                                                                                                                                                                                                  & h2o.gbm                                                                                                                                                                                                                                  & h2o                                                                                                                                                                                                                                      & 'distribution' is set automatically to 'gaussian'.                                                                                                                                                                                       & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.h2o.glm                                                                                                                                                                                                                              & h2o.glm                                                                                                                                                                                                                                      & h2o.glm                                                                                                                                                                                                                                      & h2o                                                                                                                                                                                                                                          & `family` is always set to `\"binomial\"` to get a binary classifier. The default value of `missing\\_values\\_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                               & classif                                                                                                                                                                                                                                      & TRUE                                                                                                                                                                                                                                         & TRUE                                                                                                                                                                                                                                         &  TRUE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & ⋯                                                                                                                                                                                                                                            & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                       \\\\\n",
       "\t classif.h2o.randomForest                                                                                                                                                                                                                 & h2o.randomForest                                                                                                                                                                                                                         & h2o.rf                                                                                                                                                                                                                                   & h2o                                                                                                                                                                                                                                      &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.knn                                                                                                                                                                                                                              & k-Nearest Neighbor                                                                                                                                                                                                                       & knn                                                                                                                                                                                                                                      & class                                                                                                                                                                                                                                    &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.ksvm                                                                                                                                                                                                                             & Support Vector Machines                                                                                                                                                                                                                  & ksvm                                                                                                                                                                                                                                     & kernlab                                                                                                                                                                                                                                  & Kernel parameters have to be passed directly and not by using the `kpar` list in `ksvm`. Note that `fit` has been set to `FALSE` by default for speed.                                                                                   & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.lda                                                                                                                                                                                                                              & Linear Discriminant Analysis                                                                                                                                                                                                             & lda                                                                                                                                                                                                                                      & MASS                                                                                                                                                                                                                                     & Learner parameter `predict.method` maps to `method` in `predict.lda`.                                                                                                                                                                    & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.logreg                                                                                                                                                                                                                           & Logistic Regression                                                                                                                                                                                                                      & logreg                                                                                                                                                                                                                                   & stats                                                                                                                                                                                                                                    & Delegates to `glm` with `family = binomial(link = 'logit')`. We set 'model' to FALSE by default to save memory.                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.lssvm                                                                                                                                                                                                                            & Least Squares Support Vector Machine                                                                                                                                                                                                     & lssvm                                                                                                                                                                                                                                    & kernlab                                                                                                                                                                                                                                  & `fitted` has been set to `FALSE` by default for speed.                                                                                                                                                                                   & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.lvq1                                                                                                                                                                                                                             & Learning Vector Quantization                                                                                                                                                                                                             & lvq1                                                                                                                                                                                                                                     & class                                                                                                                                                                                                                                    &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.multinom                                                                                                                                                                                                                         & Multinomial Regression                                                                                                                                                                                                                   & multinom                                                                                                                                                                                                                                 & nnet                                                                                                                                                                                                                                     &                                                                                                                                                                                                                                          & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.nnet                                                                                                                                                                                                                             & Neural Network                                                                                                                                                                                                                           & nnet                                                                                                                                                                                                                                     & nnet                                                                                                                                                                                                                                     & `size` has been set to `3` by default.                                                                                                                                                                                                   & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.probit                                                                                                                                                                                                                           & Probit Regression                                                                                                                                                                                                                        & probit                                                                                                                                                                                                                                   & stats                                                                                                                                                                                                                                    & Delegates to `glm` with `family = binomial(link = 'probit')`. We set 'model' to FALSE by default to save memory.                                                                                                                         & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.qda                                                                                                                                                                                                                              & Quadratic Discriminant Analysis                                                                                                                                                                                                          & qda                                                                                                                                                                                                                                      & MASS                                                                                                                                                                                                                                     & Learner parameter `predict.method` maps to `method` in `predict.qda`.                                                                                                                                                                    & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.randomForest                                                                                                                                                                                                                     & Random Forest                                                                                                                                                                                                                            & rf                                                                                                                                                                                                                                       & randomForest                                                                                                                                                                                                                             & Note that the rf can freeze the R process if trained on a task with 1 feature which is constant. This can happen in feature forward selection, also due to resampling, and you need to remove such features with removeConstantFeatures. & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.rpart                                                                                                                                                                                                                            & Decision Tree                                                                                                                                                                                                                            & rpart                                                                                                                                                                                                                                    & rpart                                                                                                                                                                                                                                    & `xval` has been set to `0` by default for speed.                                                                                                                                                                                         & classif                                                                                                                                                                                                                                  & TRUE                                                                                                                                                                                                                                     & TRUE                                                                                                                                                                                                                                     &  TRUE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & ⋯                                                                                                                                                                                                                                        &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    &  TRUE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                    & FALSE                                                                                                                                                                                                                                   \\\\\n",
       "\t classif.xgboost                                                                                                                                                                                                                            & eXtreme Gradient Boosting                                                                                                                                                                                                                  & xgboost                                                                                                                                                                                                                                    & xgboost                                                                                                                                                                                                                                    & All settings are passed directly, rather than through `xgboost`'s `params` argument. `nrounds` has been set to `1` and `verbose` to `0` by default. `num\\_class` is set internally, so do not set this manually.                          & classif                                                                                                                                                                                                                                    & TRUE                                                                                                                                                                                                                                       & TRUE                                                                                                                                                                                                                                       & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & ⋯                                                                                                                                                                                                                                          &  TRUE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      &  TRUE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                      & FALSE                                                                                                                                                                                                                                     \\\\\n",
       "\\end{tabular}\n"
      ],
      "text/markdown": [
       "\n",
       "class | name | short.name | package | note | type | installed | numerics | factors | ordered | ⋯ | multiclass | class.weights | featimp | oobpreds | functionals | single.functional | se | lcens | rcens | icens | \n",
       "|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|\n",
       "| classif.binomial                                                                                                                                                                                                                         | Binomial Regression                                                                                                                                                                                                                      | binomial                                                                                                                                                                                                                                 | stats                                                                                                                                                                                                                                    | Delegates to `glm` with freely choosable binomial link function via learner parameter `link`. We set 'model' to FALSE by default to save memory.                                                                                         | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.cforest                                                                                                                                                                                                                          | Random forest based on conditional inference trees                                                                                                                                                                                       | cforest                                                                                                                                                                                                                                  | party                                                                                                                                                                                                                                    | See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                        | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.ctree                                                                                                                                                                                                                            | Conditional Inference Trees                                                                                                                                                                                                              | ctree                                                                                                                                                                                                                                    | party                                                                                                                                                                                                                                    | See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                        | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.featureless                                                                                                                                                                                                                      | Featureless classifier                                                                                                                                                                                                                   | featureless                                                                                                                                                                                                                              | mlr                                                                                                                                                                                                                                      |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.fnn                                                                                                                                                                                                                              | Fast k-Nearest Neighbour                                                                                                                                                                                                                 | fnn                                                                                                                                                                                                                                      | FNN                                                                                                                                                                                                                                      |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.gausspr                                                                                                                                                                                                                          | Gaussian Processes                                                                                                                                                                                                                       | gausspr                                                                                                                                                                                                                                  | kernlab                                                                                                                                                                                                                                  | Kernel parameters have to be passed directly and not by using the `kpar` list in `gausspr`.\n",
       "    Note that `fit` has been set to `FALSE` by default for speed.                                                                           | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.h2o.deeplearning                                                                                                                                                                                                                 | h2o.deeplearning                                                                                                                                                                                                                         | h2o.dl                                                                                                                                                                                                                                   | h2o                                                                                                                                                                                                                                      | The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                                                                                                  | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.h2o.gbm                                                                                                                                                                                                                          | h2o.gbm                                                                                                                                                                                                                                  | h2o.gbm                                                                                                                                                                                                                                  | h2o                                                                                                                                                                                                                                      | 'distribution' is set automatically to 'gaussian'.                                                                                                                                                                                       | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.h2o.glm                                                                                                                                                                                                                          | h2o.glm                                                                                                                                                                                                                                  | h2o.glm                                                                                                                                                                                                                                  | h2o                                                                                                                                                                                                                                      | `family` is always set to `\"binomial\"` to get a binary classifier. The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                               | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.h2o.randomForest                                                                                                                                                                                                                 | h2o.randomForest                                                                                                                                                                                                                         | h2o.rf                                                                                                                                                                                                                                   | h2o                                                                                                                                                                                                                                      |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.knn                                                                                                                                                                                                                              | k-Nearest Neighbor                                                                                                                                                                                                                       | knn                                                                                                                                                                                                                                      | class                                                                                                                                                                                                                                    |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.ksvm                                                                                                                                                                                                                             | Support Vector Machines                                                                                                                                                                                                                  | ksvm                                                                                                                                                                                                                                     | kernlab                                                                                                                                                                                                                                  | Kernel parameters have to be passed directly and not by using the `kpar` list in `ksvm`. Note that `fit` has been set to `FALSE` by default for speed.                                                                                   | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.lda                                                                                                                                                                                                                              | Linear Discriminant Analysis                                                                                                                                                                                                             | lda                                                                                                                                                                                                                                      | MASS                                                                                                                                                                                                                                     | Learner parameter `predict.method` maps to `method` in `predict.lda`.                                                                                                                                                                    | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.logreg                                                                                                                                                                                                                           | Logistic Regression                                                                                                                                                                                                                      | logreg                                                                                                                                                                                                                                   | stats                                                                                                                                                                                                                                    | Delegates to `glm` with `family = binomial(link = 'logit')`. We set 'model' to FALSE by default to save memory.                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.lssvm                                                                                                                                                                                                                            | Least Squares Support Vector Machine                                                                                                                                                                                                     | lssvm                                                                                                                                                                                                                                    | kernlab                                                                                                                                                                                                                                  | `fitted` has been set to `FALSE` by default for speed.                                                                                                                                                                                   | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.lvq1                                                                                                                                                                                                                             | Learning Vector Quantization                                                                                                                                                                                                             | lvq1                                                                                                                                                                                                                                     | class                                                                                                                                                                                                                                    |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.multinom                                                                                                                                                                                                                         | Multinomial Regression                                                                                                                                                                                                                   | multinom                                                                                                                                                                                                                                 | nnet                                                                                                                                                                                                                                     |                                                                                                                                                                                                                                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.nnet                                                                                                                                                                                                                             | Neural Network                                                                                                                                                                                                                           | nnet                                                                                                                                                                                                                                     | nnet                                                                                                                                                                                                                                     | `size` has been set to `3` by default.                                                                                                                                                                                                   | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.probit                                                                                                                                                                                                                           | Probit Regression                                                                                                                                                                                                                        | probit                                                                                                                                                                                                                                   | stats                                                                                                                                                                                                                                    | Delegates to `glm` with `family = binomial(link = 'probit')`. We set 'model' to FALSE by default to save memory.                                                                                                                         | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.qda                                                                                                                                                                                                                              | Quadratic Discriminant Analysis                                                                                                                                                                                                          | qda                                                                                                                                                                                                                                      | MASS                                                                                                                                                                                                                                     | Learner parameter `predict.method` maps to `method` in `predict.qda`.                                                                                                                                                                    | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.randomForest                                                                                                                                                                                                                     | Random Forest                                                                                                                                                                                                                            | rf                                                                                                                                                                                                                                       | randomForest                                                                                                                                                                                                                             | Note that the rf can freeze the R process if trained on a task with 1 feature which is constant. This can happen in feature forward selection, also due to resampling, and you need to remove such features with removeConstantFeatures. | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.rpart                                                                                                                                                                                                                            | Decision Tree                                                                                                                                                                                                                            | rpart                                                                                                                                                                                                                                    | rpart                                                                                                                                                                                                                                    | `xval` has been set to `0` by default for speed.                                                                                                                                                                                         | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     |  TRUE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "| classif.xgboost                                                                                                                                                                                                                          | eXtreme Gradient Boosting                                                                                                                                                                                                                | xgboost                                                                                                                                                                                                                                  | xgboost                                                                                                                                                                                                                                  | All settings are passed directly, rather than through `xgboost`'s `params` argument. `nrounds` has been set to `1` and `verbose` to `0` by default. `num_class` is set internally, so do not set this manually.                          | classif                                                                                                                                                                                                                                  | TRUE                                                                                                                                                                                                                                     | TRUE                                                                                                                                                                                                                                     | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | ⋯                                                                                                                                                                                                                                        |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    |  TRUE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | FALSE                                                                                                                                                                                                                                    | \n",
       "\n",
       "\n"
      ],
      "text/plain": [
       "   class                    name                                              \n",
       "1  classif.binomial         Binomial Regression                               \n",
       "2  classif.cforest          Random forest based on conditional inference trees\n",
       "3  classif.ctree            Conditional Inference Trees                       \n",
       "4  classif.featureless      Featureless classifier                            \n",
       "5  classif.fnn              Fast k-Nearest Neighbour                          \n",
       "6  classif.gausspr          Gaussian Processes                                \n",
       "7  classif.h2o.deeplearning h2o.deeplearning                                  \n",
       "8  classif.h2o.gbm          h2o.gbm                                           \n",
       "9  classif.h2o.glm          h2o.glm                                           \n",
       "10 classif.h2o.randomForest h2o.randomForest                                  \n",
       "11 classif.knn              k-Nearest Neighbor                                \n",
       "12 classif.ksvm             Support Vector Machines                           \n",
       "13 classif.lda              Linear Discriminant Analysis                      \n",
       "14 classif.logreg           Logistic Regression                               \n",
       "15 classif.lssvm            Least Squares Support Vector Machine              \n",
       "16 classif.lvq1             Learning Vector Quantization                      \n",
       "17 classif.multinom         Multinomial Regression                            \n",
       "18 classif.nnet             Neural Network                                    \n",
       "19 classif.probit           Probit Regression                                 \n",
       "20 classif.qda              Quadratic Discriminant Analysis                   \n",
       "21 classif.randomForest     Random Forest                                     \n",
       "22 classif.rpart            Decision Tree                                     \n",
       "23 classif.xgboost          eXtreme Gradient Boosting                         \n",
       "   short.name  package     \n",
       "1  binomial    stats       \n",
       "2  cforest     party       \n",
       "3  ctree       party       \n",
       "4  featureless mlr         \n",
       "5  fnn         FNN         \n",
       "6  gausspr     kernlab     \n",
       "7  h2o.dl      h2o         \n",
       "8  h2o.gbm     h2o         \n",
       "9  h2o.glm     h2o         \n",
       "10 h2o.rf      h2o         \n",
       "11 knn         class       \n",
       "12 ksvm        kernlab     \n",
       "13 lda         MASS        \n",
       "14 logreg      stats       \n",
       "15 lssvm       kernlab     \n",
       "16 lvq1        class       \n",
       "17 multinom    nnet        \n",
       "18 nnet        nnet        \n",
       "19 probit      stats       \n",
       "20 qda         MASS        \n",
       "21 rf          randomForest\n",
       "22 rpart       rpart       \n",
       "23 xgboost     xgboost     \n",
       "   note                                                                                                                                                                                                                                    \n",
       "1  Delegates to `glm` with freely choosable binomial link function via learner parameter `link`. We set 'model' to FALSE by default to save memory.                                                                                        \n",
       "2  See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                       \n",
       "3  See `?ctree_control` for possible breakage for nominal features with missingness.                                                                                                                                                       \n",
       "4                                                                                                                                                                                                                                          \n",
       "5                                                                                                                                                                                                                                          \n",
       "6  Kernel parameters have to be passed directly and not by using the `kpar` list in `gausspr`.\\n    Note that `fit` has been set to `FALSE` by default for speed.                                                                          \n",
       "7  The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                                                                                                 \n",
       "8  'distribution' is set automatically to 'gaussian'.                                                                                                                                                                                      \n",
       "9  `family` is always set to `\"binomial\"` to get a binary classifier. The default value of `missing_values_handling` is `\"MeanImputation\"`, so missing values are automatically mean-imputed.                                              \n",
       "10                                                                                                                                                                                                                                         \n",
       "11                                                                                                                                                                                                                                         \n",
       "12 Kernel parameters have to be passed directly and not by using the `kpar` list in `ksvm`. Note that `fit` has been set to `FALSE` by default for speed.                                                                                  \n",
       "13 Learner parameter `predict.method` maps to `method` in `predict.lda`.                                                                                                                                                                   \n",
       "14 Delegates to `glm` with `family = binomial(link = 'logit')`. We set 'model' to FALSE by default to save memory.                                                                                                                         \n",
       "15 `fitted` has been set to `FALSE` by default for speed.                                                                                                                                                                                  \n",
       "16                                                                                                                                                                                                                                         \n",
       "17                                                                                                                                                                                                                                         \n",
       "18 `size` has been set to `3` by default.                                                                                                                                                                                                  \n",
       "19 Delegates to `glm` with `family = binomial(link = 'probit')`. We set 'model' to FALSE by default to save memory.                                                                                                                        \n",
       "20 Learner parameter `predict.method` maps to `method` in `predict.qda`.                                                                                                                                                                   \n",
       "21 Note that the rf can freeze the R process if trained on a task with 1 feature which is constant. This can happen in feature forward selection, also due to resampling, and you need to remove such features with removeConstantFeatures.\n",
       "22 `xval` has been set to `0` by default for speed.                                                                                                                                                                                        \n",
       "23 All settings are passed directly, rather than through `xgboost`'s `params` argument. `nrounds` has been set to `1` and `verbose` to `0` by default. `num_class` is set internally, so do not set this manually.                         \n",
       "   type    installed numerics factors ordered ⋯ multiclass class.weights\n",
       "1  classif TRUE      TRUE      TRUE   FALSE   ⋯ FALSE      FALSE        \n",
       "2  classif TRUE      TRUE      TRUE    TRUE   ⋯  TRUE      FALSE        \n",
       "3  classif TRUE      TRUE      TRUE    TRUE   ⋯  TRUE      FALSE        \n",
       "4  classif TRUE      TRUE      TRUE    TRUE   ⋯  TRUE      FALSE        \n",
       "5  classif TRUE      TRUE     FALSE   FALSE   ⋯  TRUE      FALSE        \n",
       "6  classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "7  classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "8  classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "9  classif TRUE      TRUE      TRUE   FALSE   ⋯ FALSE      FALSE        \n",
       "10 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "11 classif TRUE      TRUE     FALSE   FALSE   ⋯  TRUE      FALSE        \n",
       "12 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE       TRUE        \n",
       "13 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "14 classif TRUE      TRUE      TRUE   FALSE   ⋯ FALSE      FALSE        \n",
       "15 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "16 classif TRUE      TRUE     FALSE   FALSE   ⋯  TRUE      FALSE        \n",
       "17 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "18 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "19 classif TRUE      TRUE      TRUE   FALSE   ⋯ FALSE      FALSE        \n",
       "20 classif TRUE      TRUE      TRUE   FALSE   ⋯  TRUE      FALSE        \n",
       "21 classif TRUE      TRUE      TRUE    TRUE   ⋯  TRUE       TRUE        \n",
       "22 classif TRUE      TRUE      TRUE    TRUE   ⋯  TRUE      FALSE        \n",
       "23 classif TRUE      TRUE     FALSE   FALSE   ⋯  TRUE      FALSE        \n",
       "   featimp oobpreds functionals single.functional se    lcens rcens icens\n",
       "1  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "2   TRUE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "3  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "4  FALSE   FALSE     TRUE       FALSE             FALSE FALSE FALSE FALSE\n",
       "5  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "6  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "7  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "8  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "9  FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "10 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "11 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "12 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "13 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "14 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "15 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "16 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "17 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "18 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "19 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "20 FALSE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "21  TRUE    TRUE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "22  TRUE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE\n",
       "23  TRUE   FALSE    FALSE       FALSE             FALSE FALSE FALSE FALSE"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "listLearners(spam.task, warn.missing.packages = FALSE)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "c) Select a learner you like and create it. If you want to can change its hyperparameters "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "lrn = makeLearner(\"classif.rpart\", predict.type = \"prob\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "d) Create an index set of train and test indicies. The test set should have 1000 observations.\n",
    "\n",
    "d*) Ensure that the fraction between `\"spam\"` and `\"nonspam\"` is the training and test set is the same as in the full dataset. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<ol class=list-inline>\n",
       "\t<li>1849</li>\n",
       "\t<li>3260</li>\n",
       "\t<li>808</li>\n",
       "\t<li>1473</li>\n",
       "\t<li>4069</li>\n",
       "\t<li>4061</li>\n",
       "</ol>\n"
      ],
      "text/latex": [
       "\\begin{enumerate*}\n",
       "\\item 1849\n",
       "\\item 3260\n",
       "\\item 808\n",
       "\\item 1473\n",
       "\\item 4069\n",
       "\\item 4061\n",
       "\\end{enumerate*}\n"
      ],
      "text/markdown": [
       "1. 1849\n",
       "2. 3260\n",
       "3. 808\n",
       "4. 1473\n",
       "5. 4069\n",
       "6. 4061\n",
       "\n",
       "\n"
      ],
      "text/plain": [
       "[1] 1849 3260  808 1473 4069 4061"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<ol class=list-inline>\n",
       "\t<li>2</li>\n",
       "\t<li>4</li>\n",
       "\t<li>5</li>\n",
       "\t<li>6</li>\n",
       "\t<li>7</li>\n",
       "\t<li>8</li>\n",
       "</ol>\n"
      ],
      "text/latex": [
       "\\begin{enumerate*}\n",
       "\\item 2\n",
       "\\item 4\n",
       "\\item 5\n",
       "\\item 6\n",
       "\\item 7\n",
       "\\item 8\n",
       "\\end{enumerate*}\n"
      ],
      "text/markdown": [
       "1. 2\n",
       "2. 4\n",
       "3. 5\n",
       "4. 6\n",
       "5. 7\n",
       "6. 8\n",
       "\n",
       "\n"
      ],
      "text/plain": [
       "[1] 2 4 5 6 7 8"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "n = getTaskSize(spam.task)\n",
    "test.inds = sample(1:n, size = 1000)\n",
    "train.inds = setdiff(1:n, test.inds) \n",
    "head(test.inds)\n",
    "head(train.inds)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "e) Train your model on the train subset of the spam data and predict on the test subset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Model for learner.id=classif.rpart; learner.class=classif.rpart\n",
      "Trained on: task.id = spam; obs = 3601; features = 57\n",
      "Hyperparameters: xval=0\n",
      "Prediction: 1000 observations\n",
      "predict.type: prob\n",
      "threshold: nonspam=0.50,spam=0.50\n",
      "time: 0.01\n",
      "       id   truth prob.nonspam prob.spam response\n",
      "1849 1849 nonspam      0.91453   0.08547  nonspam\n",
      "3260 3260 nonspam      0.91453   0.08547  nonspam\n",
      "808   808    spam      0.81266   0.18734  nonspam\n",
      "1473 1473    spam      0.05836   0.94164     spam\n",
      "4069 4069 nonspam      0.91453   0.08547  nonspam\n",
      "4061 4061 nonspam      0.81266   0.18734  nonspam\n",
      "... (#rows: 1000, #cols: 5)\n"
     ]
    }
   ],
   "source": [
    "mod = train(lrn, spam.task, subset = train.inds)\n",
    "preds = predict(mod, spam.task, subset = test.inds)\n",
    "print(mod)\n",
    "\n",
    "print(preds)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "f) Evaluate the performance of your model based on accuracy and area under the curve."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<dl class=dl-horizontal>\n",
       "\t<dt>acc</dt>\n",
       "\t\t<dd>0.886</dd>\n",
       "\t<dt>auc</dt>\n",
       "\t\t<dd>0.905605780425998</dd>\n",
       "</dl>\n"
      ],
      "text/latex": [
       "\\begin{description*}\n",
       "\\item[acc] 0.886\n",
       "\\item[auc] 0.905605780425998\n",
       "\\end{description*}\n"
      ],
      "text/markdown": [
       "acc\n",
       ":   0.886auc\n",
       ":   0.905605780425998\n",
       "\n"
      ],
      "text/plain": [
       "   acc    auc \n",
       "0.8860 0.9056 "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "perf = performance(preds, measures = list(acc, auc))\n",
    "perf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "g) Try to find a model with an AUC of at least 98%. \n",
    "- Try different models\n",
    "- Change hyperparameters \n",
    "- Have a closer look at the feature and try to find transformations or combination of features that improve your model's performance   "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<strong>auc:</strong> 0.981743544962674"
      ],
      "text/latex": [
       "\\textbf{auc:} 0.981743544962674"
      ],
      "text/markdown": [
       "**auc:** 0.981743544962674"
      ],
      "text/plain": [
       "   auc \n",
       "0.9817 "
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "lrn2 = makeLearner(\"classif.randomForest\", predict.type = \"prob\")\n",
    "mod = train(lrn2, spam.task, subset = train.inds)\n",
    "preds = predict(mod, spam.task, subset = test.inds)\n",
    "performance(preds, measures = auc)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "R",
   "language": "R",
   "name": "ir"
  },
  "language_info": {
   "codemirror_mode": "r",
   "file_extension": ".r",
   "mimetype": "text/x-r-source",
   "name": "R",
   "pygments_lexer": "r",
   "version": "3.4.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}