/mtry_experiment.txt
Plain Text | 142 lines | 138 code | 4 blank | 0 comment | 0 complexity | 847450f06d89c582fcea4aef04cf7a7c MD5 | raw file
1removing inefficient cause columns and useless rows in set: 1 2set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493 3set reduced to 276737871 items (78% of original size). 4downsampled set 1 from 276737871 items to 39993642 items (14%) 51 - rf - mtry 10 : Rsqr : 0.46758, used time: 269.991 61 - rf - mtry 25 : Rsqr : 0.52781, used time: 402.908 71 - rf - mtry 50 : Rsqr : 0.52096, used time: 351.209 81 - rf - mtry 100 : Rsqr : 0.53403, used time: 370.373 9Time 21:48:45, done 7 %, time elapsed 25, exp. time left 346, exp. full time 370 10downsampled set 2 from 51241364 items to 39988958 items (78%) 112 - rf - mtry 10 : Rsqr : 0.62297, used time: 3858.578 122 - rf - mtry 25 : Rsqr : 0.64151, used time: 2204.061 132 - rf - mtry 50 : Rsqr : 0.65923, used time: 1959.537 142 - rf - mtry 100 : Rsqr : 0.66887, used time: 2211.073 15Time 00:42:10, done 13 %, time elapsed 3, exp. time left 21, exp. full time 25 163 - rf - mtry 10 : Rsqr : 0.6067, used time: 2860.315 173 - rf - mtry 25 : Rsqr : 0.634, used time: 2137.594 183 - rf - mtry 50 : Rsqr : 0.65573, used time: 2195.583 193 - rf - mtry 100 : Rsqr : 0.67606, used time: 2217.373 20Time 03:24:14, done 20 %, time elapsed 6, exp. time left 24, exp. full time 30 214 - rf - mtry 10 : Rsqr : 0.52143, used time: 60.21 224 - rf - mtry 25 : Rsqr : 0.55479, used time: 30.666 234 - rf - mtry 50 : Rsqr : 0.58122, used time: 33.104 244 - rf - mtry 100 : Rsqr : 0.58962, used time: 40.485 25Time 03:27:39, done 27 %, time elapsed 6, exp. time left 17, exp. full time 23 265 - rf - mtry 10 : Rsqr : 0.66725, used time: 161.91 275 - rf - mtry 25 : Rsqr : 0.68734, used time: 97.276 285 - rf - mtry 50 : Rsqr : 0.698, used time: 96.752 295 - rf - mtry 100 : Rsqr : 0.71093, used time: 109.577 30Time 03:35:34, done 33 %, time elapsed 6, exp. time left 12, exp. full time 19 31downsampled set 6 from 333613124 items to 39992886 items (12%) 326 - rf - mtry 10 : Rsqr : 0.61467, used time: 2978.895 336 - rf - mtry 25 : Rsqr : 0.62634, used time: 1866.602 346 - rf - mtry 50 : Rsqr : 0.6385, used time: 1752.19 356 - rf - mtry 100 : Rsqr : 0.64486, used time: 2661.496 36Time 06:15:34, done 40 %, time elapsed 9, exp. time left 13, exp. full time 22 37removing inefficient cause columns and useless rows in set: 7 38set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507 39set reduced to 6461142 items (91% of original size). 407 - rf - mtry 10 : Rsqr : 0.51111, used time: 57.494 417 - rf - mtry 25 : Rsqr : 0.53342, used time: 26.677 427 - rf - mtry 50 : Rsqr : 0.55046, used time: 29.458 437 - rf - mtry 100 : Rsqr : 0.5676, used time: 35.197 44Time 06:18:08, done 47 %, time elapsed 9, exp. time left 10, exp. full time 19 45downsampled set 8 from 57846825 items to 39996450 items (69%) 468 - rf - mtry 10 : Rsqr : 0.65597, used time: 3540.161 478 - rf - mtry 25 : Rsqr : 0.68117, used time: 2876.923 488 - rf - mtry 50 : Rsqr : 0.70006, used time: 2391.232 498 - rf - mtry 100 : Rsqr : 0.70829, used time: 2670.287 50Time 09:32:22, done 53 %, time elapsed 12, exp. time left 11, exp. full time 23 519 - rf - mtry 10 : Rsqr : 0.66972, used time: 813.899 529 - rf - mtry 25 : Rsqr : 0.70111, used time: 370.194 539 - rf - mtry 50 : Rsqr : 0.71348, used time: 531.49 549 - rf - mtry 100 : Rsqr : 0.72678, used time: 815.269 55Time 10:15:58, done 60 %, time elapsed 13, exp. time left 9, exp. full time 21 56downsampled set 10 from 64586592 items to 39999552 items (62%) 5710 - rf - mtry 10 : Rsqr : 0.65459, used time: 2885.216 5810 - rf - mtry 25 : Rsqr : 0.67741, used time: 2815.623 5910 - rf - mtry 50 : Rsqr : 0.69002, used time: 2468.193 6010 - rf - mtry 100 : Rsqr : 0.69734, used time: 3388.195 61Time 13:33:04, done 67 %, time elapsed 16, exp. time left 8, exp. full time 24 6211 - rf - mtry 10 : Rsqr : 0.51475, used time: 3374.336 6311 - rf - mtry 25 : Rsqr : 0.53893, used time: 2358.746 6411 - rf - mtry 50 : Rsqr : 0.55779, used time: 2105.517 6511 - rf - mtry 100 : Rsqr : 0.57779, used time: 2407.6 66Time 16:26:42, done 73 %, time elapsed 19, exp. time left 7, exp. full time 26 67downsampled set 12 from 47338272 items to 39989376 items (84%) 6812 - rf - mtry 10 : Rsqr : 0.51216, used time: 3831.043 6912 - rf - mtry 25 : Rsqr : 0.54288, used time: 2905.716 7012 - rf - mtry 50 : Rsqr : 0.56467, used time: 3009.606 7112 - rf - mtry 100 : Rsqr : 0.58474, used time: 3097.952 72Time 20:02:53, done 80 %, time elapsed 23, exp. time left 6, exp. full time 28 7313 - rf - mtry 10 : Rsqr : 0.43743, used time: 2764.245 7413 - rf - mtry 25 : Rsqr : 0.46324, used time: 3108.395 7513 - rf - mtry 50 : Rsqr : 0.47484, used time: 3269.687 7613 - rf - mtry 100 : Rsqr : 0.49047, used time: 3134.987 77Time 23:30:54, done 87 %, time elapsed 1, exp. time left 0, exp. full time 1 7814 - rf - mtry 10 : Rsqr : 0.36023, used time: 967.392 7914 - rf - mtry 25 : Rsqr : 0.38709, used time: 451.194 8014 - rf - mtry 50 : Rsqr : 0.40813, used time: 789.77 8114 - rf - mtry 100 : Rsqr : 0.42536, used time: 861.232 82Time 00:25:20, done 93 %, time elapsed 1, exp. time left 0, exp. full time 1 8315 - rf - mtry 10 : Rsqr : 0.67446, used time: 302.802 8415 - rf - mtry 25 : Rsqr : 0.71083, used time: 279.809 8515 - rf - mtry 50 : Rsqr : 0.73352, used time: 272.292 8615 - rf - mtry 100 : Rsqr : 0.75464, used time: 296.682 87 88removing inefficient cause columns and useless rows in set: 1 89set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493 90set reduced to 276737871 items (78% of original size). 91downsampled set 1 from 276737871 items to 39993642 items (14%) 921 - rf - mtry 100 : Rsqr : 0.54028, used time: 1348.785 93Time 11:43:12, done 7 %, time elapsed 31, exp. time left 427, exp. full time 458 94downsampled set 2 from 51241364 items to 39988958 items (78%) 952 - rf - mtry 100 : Rsqr : 0.66616, used time: 2315.678 96Time 12:24:01, done 13 %, time elapsed 1, exp. time left 8, exp. full time 9 973 - rf - mtry 100 : Rsqr : 0.67413, used time: 1203.814 98Time 12:48:14, done 20 %, time elapsed 2, exp. time left 6, exp. full time 8 994 - rf - mtry 100 : Rsqr : 0.58702, used time: 59.748 100Time 12:50:01, done 27 %, time elapsed 2, exp. time left 4, exp. full time 6 1015 - rf - mtry 100 : Rsqr : 0.70997, used time: 159.084 102Time 12:52:50, done 33 %, time elapsed 2, exp. time left 3, exp. full time 5 103downsampled set 6 from 333613124 items to 39992886 items (12%) 1046 - rf - mtry 100 : Rsqr : 0.66158, used time: 2571.409 105Time 13:45:33, done 40 %, time elapsed 3, exp. time left 4, exp. full time 6 106removing inefficient cause columns and useless rows in set: 7 107set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507 108set reduced to 6461142 items (91% of original size). 1097 - rf - mtry 100 : Rsqr : 0.57127, used time: 120.971 110Time 13:47:44, done 47 %, time elapsed 3, exp. time left 3, exp. full time 6 111downsampled set 8 from 57846825 items to 39996450 items (69%) 1128 - rf - mtry 100 : Rsqr : 0.69487, used time: 2057.486 113Time 14:25:17, done 53 %, time elapsed 3, exp. time left 3, exp. full time 6 1149 - rf - mtry 100 : Rsqr : 0.72863, used time: 515.658 115Time 14:34:34, done 60 %, time elapsed 3, exp. time left 2, exp. full time 6 116downsampled set 10 from 64586592 items to 39999552 items (62%) 11710 - rf - mtry 100 : Rsqr : 0.71172, used time: 1942.968 118Time 15:10:11, done 67 %, time elapsed 4, exp. time left 2, exp. full time 6 11911 - rf - mtry 100 : Rsqr : 0.56769, used time: 994.197 120Time 15:28:34, done 73 %, time elapsed 4, exp. time left 2, exp. full time 6 121downsampled set 12 from 47338272 items to 39989376 items (84%) 12212 - rf - mtry 100 : Rsqr : 0.58312, used time: 2513.502 123Time 16:13:54, done 80 %, time elapsed 5, exp. time left 1, exp. full time 6 12413 - rf - mtry 100 : Rsqr : 0.48583, used time: 1043.787 125Time 16:32:03, done 87 %, time elapsed 5, exp. time left 1, exp. full time 6 12614 - rf - mtry 100 : Rsqr : 0.42532, used time: 260.751 127Time 16:37:37, done 93 %, time elapsed 5, exp. time left 0, exp. full time 6 128removing inefficient cause columns and useless rows in set: 15 129set: 15 , kept 5059 rows of 5059 and 5276 cols of 5554 130set reduced to 26691284 items (94% of original size). 13115 - rf - mtry 100 : Rsqr : 0.75357, used time: 797.019 132Time 16:51:42, done 100 %, time elapsed 6, exp. time left 0, exp. full time 6 133finished prediction loop, report size is 58743336 134Time difference of 5.650599 hours 135all finished 136 1371 - rf - mtry 100 : Rsqr : 0.54399, used time: 351.804 1381 - rf - mtry 200 : Rsqr : 0.5658, used time: 403.143 1391 - rf - mtry 500 : Rsqr : 0.5857, used time: 585.845 1401 - rf - mtry 1000 : Rsqr : 0.59552, used time: 891.393 141 142