/mtry_experiment.txt

  1removing inefficient cause columns and useless rows in set: 1
  2set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493
  3set reduced to 276737871 items (78% of original size).
  4downsampled set 1 from 276737871 items to 39993642 items (14%)
  51 - rf - mtry 10 : Rsqr : 0.46758, used time: 269.991
  61 - rf - mtry 25 : Rsqr : 0.52781, used time: 402.908
  71 - rf - mtry 50 : Rsqr : 0.52096, used time: 351.209
  81 - rf - mtry 100 : Rsqr : 0.53403, used time: 370.373
  9Time 21:48:45, done 7 %, time elapsed 25, exp. time left 346, exp. full time 370
 10downsampled set 2 from 51241364 items to 39988958 items (78%)
 112 - rf - mtry 10 : Rsqr : 0.62297, used time: 3858.578
 122 - rf - mtry 25 : Rsqr : 0.64151, used time: 2204.061
 132 - rf - mtry 50 : Rsqr : 0.65923, used time: 1959.537
 142 - rf - mtry 100 : Rsqr : 0.66887, used time: 2211.073
 15Time 00:42:10, done 13 %, time elapsed 3, exp. time left 21, exp. full time 25
 163 - rf - mtry 10 : Rsqr : 0.6067, used time: 2860.315
 173 - rf - mtry 25 : Rsqr : 0.634, used time: 2137.594
 183 - rf - mtry 50 : Rsqr : 0.65573, used time: 2195.583
 193 - rf - mtry 100 : Rsqr : 0.67606, used time: 2217.373
 20Time 03:24:14, done 20 %, time elapsed 6, exp. time left 24, exp. full time 30
 214 - rf - mtry 10 : Rsqr : 0.52143, used time: 60.21
 224 - rf - mtry 25 : Rsqr : 0.55479, used time: 30.666
 234 - rf - mtry 50 : Rsqr : 0.58122, used time: 33.104
 244 - rf - mtry 100 : Rsqr : 0.58962, used time: 40.485
 25Time 03:27:39, done 27 %, time elapsed 6, exp. time left 17, exp. full time 23
 265 - rf - mtry 10 : Rsqr : 0.66725, used time: 161.91
 275 - rf - mtry 25 : Rsqr : 0.68734, used time: 97.276
 285 - rf - mtry 50 : Rsqr : 0.698, used time: 96.752
 295 - rf - mtry 100 : Rsqr : 0.71093, used time: 109.577
 30Time 03:35:34, done 33 %, time elapsed 6, exp. time left 12, exp. full time 19
 31downsampled set 6 from 333613124 items to 39992886 items (12%)
 326 - rf - mtry 10 : Rsqr : 0.61467, used time: 2978.895
 336 - rf - mtry 25 : Rsqr : 0.62634, used time: 1866.602
 346 - rf - mtry 50 : Rsqr : 0.6385, used time: 1752.19
 356 - rf - mtry 100 : Rsqr : 0.64486, used time: 2661.496
 36Time 06:15:34, done 40 %, time elapsed 9, exp. time left 13, exp. full time 22
 37removing inefficient cause columns and useless rows in set: 7
 38set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507
 39set reduced to 6461142 items (91% of original size).
 407 - rf - mtry 10 : Rsqr : 0.51111, used time: 57.494
 417 - rf - mtry 25 : Rsqr : 0.53342, used time: 26.677
 427 - rf - mtry 50 : Rsqr : 0.55046, used time: 29.458
 437 - rf - mtry 100 : Rsqr : 0.5676, used time: 35.197
 44Time 06:18:08, done 47 %, time elapsed 9, exp. time left 10, exp. full time 19
 45downsampled set 8 from 57846825 items to 39996450 items (69%)
 468 - rf - mtry 10 : Rsqr : 0.65597, used time: 3540.161
 478 - rf - mtry 25 : Rsqr : 0.68117, used time: 2876.923
 488 - rf - mtry 50 : Rsqr : 0.70006, used time: 2391.232
 498 - rf - mtry 100 : Rsqr : 0.70829, used time: 2670.287
 50Time 09:32:22, done 53 %, time elapsed 12, exp. time left 11, exp. full time 23
 519 - rf - mtry 10 : Rsqr : 0.66972, used time: 813.899
 529 - rf - mtry 25 : Rsqr : 0.70111, used time: 370.194
 539 - rf - mtry 50 : Rsqr : 0.71348, used time: 531.49
 549 - rf - mtry 100 : Rsqr : 0.72678, used time: 815.269
 55Time 10:15:58, done 60 %, time elapsed 13, exp. time left 9, exp. full time 21
 56downsampled set 10 from 64586592 items to 39999552 items (62%)
 5710 - rf - mtry 10 : Rsqr : 0.65459, used time: 2885.216
 5810 - rf - mtry 25 : Rsqr : 0.67741, used time: 2815.623
 5910 - rf - mtry 50 : Rsqr : 0.69002, used time: 2468.193
 6010 - rf - mtry 100 : Rsqr : 0.69734, used time: 3388.195
 61Time 13:33:04, done 67 %, time elapsed 16, exp. time left 8, exp. full time 24
 6211 - rf - mtry 10 : Rsqr : 0.51475, used time: 3374.336
 6311 - rf - mtry 25 : Rsqr : 0.53893, used time: 2358.746
 6411 - rf - mtry 50 : Rsqr : 0.55779, used time: 2105.517
 6511 - rf - mtry 100 : Rsqr : 0.57779, used time: 2407.6
 66Time 16:26:42, done 73 %, time elapsed 19, exp. time left 7, exp. full time 26
 67downsampled set 12 from 47338272 items to 39989376 items (84%)
 6812 - rf - mtry 10 : Rsqr : 0.51216, used time: 3831.043
 6912 - rf - mtry 25 : Rsqr : 0.54288, used time: 2905.716
 7012 - rf - mtry 50 : Rsqr : 0.56467, used time: 3009.606
 7112 - rf - mtry 100 : Rsqr : 0.58474, used time: 3097.952
 72Time 20:02:53, done 80 %, time elapsed 23, exp. time left 6, exp. full time 28
 7313 - rf - mtry 10 : Rsqr : 0.43743, used time: 2764.245
 7413 - rf - mtry 25 : Rsqr : 0.46324, used time: 3108.395
 7513 - rf - mtry 50 : Rsqr : 0.47484, used time: 3269.687
 7613 - rf - mtry 100 : Rsqr : 0.49047, used time: 3134.987
 77Time 23:30:54, done 87 %, time elapsed 1, exp. time left 0, exp. full time 1
 7814 - rf - mtry 10 : Rsqr : 0.36023, used time: 967.392
 7914 - rf - mtry 25 : Rsqr : 0.38709, used time: 451.194
 8014 - rf - mtry 50 : Rsqr : 0.40813, used time: 789.77
 8114 - rf - mtry 100 : Rsqr : 0.42536, used time: 861.232
 82Time 00:25:20, done 93 %, time elapsed 1, exp. time left 0, exp. full time 1
 8315 - rf - mtry 10 : Rsqr : 0.67446, used time: 302.802
 8415 - rf - mtry 25 : Rsqr : 0.71083, used time: 279.809
 8515 - rf - mtry 50 : Rsqr : 0.73352, used time: 272.292
 8615 - rf - mtry 100 : Rsqr : 0.75464, used time: 296.682
 87
 88removing inefficient cause columns and useless rows in set: 1
 89set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493
 90set reduced to 276737871 items (78% of original size).
 91downsampled set 1 from 276737871 items to 39993642 items (14%)
 921 - rf - mtry 100 : Rsqr : 0.54028, used time: 1348.785
 93Time 11:43:12, done 7 %, time elapsed 31, exp. time left 427, exp. full time 458
 94downsampled set 2 from 51241364 items to 39988958 items (78%)
 952 - rf - mtry 100 : Rsqr : 0.66616, used time: 2315.678
 96Time 12:24:01, done 13 %, time elapsed 1, exp. time left 8, exp. full time 9
 973 - rf - mtry 100 : Rsqr : 0.67413, used time: 1203.814
 98Time 12:48:14, done 20 %, time elapsed 2, exp. time left 6, exp. full time 8
 994 - rf - mtry 100 : Rsqr : 0.58702, used time: 59.748
100Time 12:50:01, done 27 %, time elapsed 2, exp. time left 4, exp. full time 6
1015 - rf - mtry 100 : Rsqr : 0.70997, used time: 159.084
102Time 12:52:50, done 33 %, time elapsed 2, exp. time left 3, exp. full time 5
103downsampled set 6 from 333613124 items to 39992886 items (12%)
1046 - rf - mtry 100 : Rsqr : 0.66158, used time: 2571.409
105Time 13:45:33, done 40 %, time elapsed 3, exp. time left 4, exp. full time 6
106removing inefficient cause columns and useless rows in set: 7
107set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507
108set reduced to 6461142 items (91% of original size).
1097 - rf - mtry 100 : Rsqr : 0.57127, used time: 120.971
110Time 13:47:44, done 47 %, time elapsed 3, exp. time left 3, exp. full time 6
111downsampled set 8 from 57846825 items to 39996450 items (69%)
1128 - rf - mtry 100 : Rsqr : 0.69487, used time: 2057.486
113Time 14:25:17, done 53 %, time elapsed 3, exp. time left 3, exp. full time 6
1149 - rf - mtry 100 : Rsqr : 0.72863, used time: 515.658
115Time 14:34:34, done 60 %, time elapsed 3, exp. time left 2, exp. full time 6
116downsampled set 10 from 64586592 items to 39999552 items (62%)
11710 - rf - mtry 100 : Rsqr : 0.71172, used time: 1942.968
118Time 15:10:11, done 67 %, time elapsed 4, exp. time left 2, exp. full time 6
11911 - rf - mtry 100 : Rsqr : 0.56769, used time: 994.197
120Time 15:28:34, done 73 %, time elapsed 4, exp. time left 2, exp. full time 6
121downsampled set 12 from 47338272 items to 39989376 items (84%)
12212 - rf - mtry 100 : Rsqr : 0.58312, used time: 2513.502
123Time 16:13:54, done 80 %, time elapsed 5, exp. time left 1, exp. full time 6
12413 - rf - mtry 100 : Rsqr : 0.48583, used time: 1043.787
125Time 16:32:03, done 87 %, time elapsed 5, exp. time left 1, exp. full time 6
12614 - rf - mtry 100 : Rsqr : 0.42532, used time: 260.751
127Time 16:37:37, done 93 %, time elapsed 5, exp. time left 0, exp. full time 6
128removing inefficient cause columns and useless rows in set: 15
129set: 15 , kept 5059 rows of 5059 and 5276 cols of 5554
130set reduced to 26691284 items (94% of original size).
13115 - rf - mtry 100 : Rsqr : 0.75357, used time: 797.019
132Time 16:51:42, done 100 %, time elapsed 6, exp. time left 0, exp. full time 6
133finished prediction loop, report size is 58743336
134Time difference of 5.650599 hours
135all finished
136
1371 - rf - mtry 100 : Rsqr : 0.54399, used time: 351.804
1381 - rf - mtry 200 : Rsqr : 0.5658, used time: 403.143
1391 - rf - mtry 500 : Rsqr : 0.5857, used time: 585.845
1401 - rf - mtry 1000 : Rsqr : 0.59552, used time: 891.393
141
142