CRAN Package Check Results for Package mlr3benchmark

Last updated on 2026-08-16 08:50:37 CEST.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang 0.1.7 6.32 71.38 77.70 ERROR
r-devel-linux-x86_64-debian-gcc 0.1.7 4.23 51.05 55.28 ERROR
r-devel-linux-x86_64-fedora-clang 0.1.7 5.00 50.15 55.15 ERROR
r-devel-linux-x86_64-fedora-gcc 0.1.7 5.00 47.90 52.90 ERROR
r-devel-windows-x86_64 0.1.7 9.00 78.00 87.00 ERROR
r-patched-linux-x86_64 0.1.7 5.37 63.03 68.40 ERROR
r-release-linux-x86_64 0.1.7 6.43 62.68 69.11 ERROR
r-release-macos-arm64 0.1.7 2.00 21.00 23.00 OK
r-release-macos-x86_64 0.1.7 5.00 84.00 89.00 OK
r-release-windows-x86_64 0.1.7 9.00 76.00 85.00 ERROR
r-oldrel-macos-arm64 0.1.7 OK
r-oldrel-macos-x86_64 0.1.7 4.00 59.00 63.00 OK
r-oldrel-windows-x86_64 0.1.7 11.00 100.00 111.00 ERROR

Check Details

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > base::assign(".ptime", proc.time(), pos = "CheckExEnv") > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-patched-linux-x86_64, r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/10s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [07:03:47.109] [mlr3] Running benchmark with 18 resampling iterations INFO [07:03:47.348] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [07:03:47.460] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [07:03:47.544] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [07:03:47.642] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [07:03:47.755] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [07:03:47.831] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [07:03:47.873] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [07:03:47.912] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [07:03:47.958] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [07:03:47.998] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [07:03:48.043] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [07:03:48.089] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [07:03:48.135] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [07:03:48.198] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [07:03:48.258] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [07:03:48.320] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [07:03:48.378] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [07:03:48.449] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [07:03:48.525] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/9s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:21:18.781] [mlr3] Running benchmark with 18 resampling iterations INFO [18:21:19.138] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:21:19.191] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:21:19.242] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:21:19.285] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:21:19.326] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:21:19.406] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:21:19.464] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:21:19.502] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:21:19.563] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:21:19.599] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:21:19.672] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:21:19.750] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:21:19.823] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:21:19.887] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:21:19.968] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:21:20.034] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:21:20.128] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:21:20.202] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:21:20.314] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-gcc

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-release-windows-x86_64, r-oldrel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/12s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [20:45:44.423] [mlr3] Running benchmark with 18 resampling iterations INFO [20:45:45.076] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [20:45:45.190] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [20:45:45.251] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [20:45:45.313] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [20:45:45.392] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [20:45:45.432] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [20:45:45.502] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [20:45:45.566] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [20:45:45.623] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [20:45:45.693] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [20:45:45.738] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [20:45:45.779] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [20:45:45.832] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [20:45:45.933] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [20:45:46.014] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [20:45:46.095] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [20:45:46.193] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [20:45:46.283] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [20:45:46.381] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/15s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [19:50:21.333] [mlr3] Running benchmark with 18 resampling iterations INFO [19:50:22.232] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [19:50:22.339] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [19:50:22.395] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [19:50:22.480] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [19:50:22.555] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [19:50:22.622] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [19:50:22.689] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [19:50:22.771] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [19:50:22.875] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [19:50:22.959] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [19:50:23.023] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [19:50:23.089] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [19:50:23.161] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [19:50:23.243] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [19:50:23.331] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [19:50:23.393] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [19:50:23.469] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [19:50:23.559] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [19:50:23.664] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-gcc

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [7s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [22:09:54.099] [mlr3] Running benchmark with 18 resampling iterations INFO [22:09:54.261] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [22:09:54.330] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [22:09:54.370] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [22:09:54.411] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [22:09:54.465] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [22:09:54.515] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [22:09:54.581] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [22:09:54.639] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [22:09:54.694] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [22:09:54.749] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [22:09:54.803] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [22:09:54.837] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [22:09:54.862] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [22:09:54.901] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [22:09:54.950] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [22:09:55.009] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [22:09:55.062] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [22:09:55.114] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [22:09:55.171] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/10s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:18:19.453] [mlr3] Running benchmark with 18 resampling iterations INFO [18:18:19.880] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:18:19.967] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:18:20.036] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:18:20.118] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:18:20.213] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:18:20.306] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:18:20.402] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:18:20.451] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:18:20.495] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:18:20.538] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:18:20.590] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:18:20.642] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:18:20.678] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:18:20.736] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:18:20.796] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:18:20.852] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:18:20.926] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:18:20.991] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:18:21.065] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-patched-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [7s/11s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:18:18.476] [mlr3] Running benchmark with 18 resampling iterations INFO [18:18:19.027] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:18:19.100] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:18:19.177] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:18:19.262] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:18:19.367] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:18:19.463] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:18:19.564] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:18:19.629] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:18:19.711] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:18:19.806] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:18:19.892] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:18:19.982] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:18:20.036] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:18:20.094] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:18:20.156] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:18:20.218] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:18:20.308] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:18:20.472] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:18:20.618] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [6s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [16:07:40.055] [mlr3] Running benchmark with 18 resampling iterations INFO [16:07:40.305] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [16:07:40.363] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [16:07:40.411] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [16:07:40.454] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [16:07:40.504] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [16:07:40.537] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [16:07:40.569] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [16:07:40.620] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [16:07:40.668] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [16:07:40.707] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [16:07:40.753] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [16:07:40.796] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [16:07:40.831] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [16:07:40.877] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [16:07:40.930] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [16:07:40.986] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [16:07:41.034] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [16:07:41.085] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [16:07:41.149] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [10s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [20:00:03.446] [mlr3] Running benchmark with 18 resampling iterations INFO [20:00:03.719] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [20:00:03.824] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [20:00:03.885] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [20:00:03.946] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [20:00:04.017] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [20:00:04.077] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [20:00:04.138] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [20:00:04.203] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [20:00:04.273] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [20:00:04.329] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [20:00:04.399] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [20:00:04.441] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [20:00:04.494] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [20:00:04.574] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [20:00:04.657] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [20:00:04.741] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [20:00:04.821] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [20:00:04.902] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [20:00:04.995] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-oldrel-windows-x86_64