/mtry_experiment.txt

https://bitbucket.org/jontis/merck · Plain Text · 142 lines · 138 code · 4 blank · 0 comment · 0 complexity · 847450f06d89c582fcea4aef04cf7a7c MD5 · raw file 

    

  1. removing inefficient cause columns and useless rows in set: 1
    2. 

  2. set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493
    3. 

  3. set reduced to 276737871 items (78% of original size).
    4. 

  4. downsampled set 1 from 276737871 items to 39993642 items (14%)
    5. 

  5. 1 - rf - mtry 10 : Rsqr : 0.46758, used time: 269.991
    6. 

  6. 1 - rf - mtry 25 : Rsqr : 0.52781, used time: 402.908
    7. 

  7. 1 - rf - mtry 50 : Rsqr : 0.52096, used time: 351.209
    8. 

  8. 1 - rf - mtry 100 : Rsqr : 0.53403, used time: 370.373
    9. 

  9. Time 21:48:45, done 7 %, time elapsed 25, exp. time left 346, exp. full time 370
    10. 

  10. downsampled set 2 from 51241364 items to 39988958 items (78%)
    11. 

  11. 2 - rf - mtry 10 : Rsqr : 0.62297, used time: 3858.578
    12. 

  12. 2 - rf - mtry 25 : Rsqr : 0.64151, used time: 2204.061
    13. 

  13. 2 - rf - mtry 50 : Rsqr : 0.65923, used time: 1959.537
    14. 

  14. 2 - rf - mtry 100 : Rsqr : 0.66887, used time: 2211.073
    15. 

  15. Time 00:42:10, done 13 %, time elapsed 3, exp. time left 21, exp. full time 25
    16. 

  16. 3 - rf - mtry 10 : Rsqr : 0.6067, used time: 2860.315
    17. 

  17. 3 - rf - mtry 25 : Rsqr : 0.634, used time: 2137.594
    18. 

  18. 3 - rf - mtry 50 : Rsqr : 0.65573, used time: 2195.583
    19. 

  19. 3 - rf - mtry 100 : Rsqr : 0.67606, used time: 2217.373
    20. 

  20. Time 03:24:14, done 20 %, time elapsed 6, exp. time left 24, exp. full time 30
    21. 

  21. 4 - rf - mtry 10 : Rsqr : 0.52143, used time: 60.21
    22. 

  22. 4 - rf - mtry 25 : Rsqr : 0.55479, used time: 30.666
    23. 

  23. 4 - rf - mtry 50 : Rsqr : 0.58122, used time: 33.104
    24. 

  24. 4 - rf - mtry 100 : Rsqr : 0.58962, used time: 40.485
    25. 

  25. Time 03:27:39, done 27 %, time elapsed 6, exp. time left 17, exp. full time 23
    26. 

  26. 5 - rf - mtry 10 : Rsqr : 0.66725, used time: 161.91
    27. 

  27. 5 - rf - mtry 25 : Rsqr : 0.68734, used time: 97.276
    28. 

  28. 5 - rf - mtry 50 : Rsqr : 0.698, used time: 96.752
    29. 

  29. 5 - rf - mtry 100 : Rsqr : 0.71093, used time: 109.577
    30. 

  30. Time 03:35:34, done 33 %, time elapsed 6, exp. time left 12, exp. full time 19
    31. 

  31. downsampled set 6 from 333613124 items to 39992886 items (12%)
    32. 

  32. 6 - rf - mtry 10 : Rsqr : 0.61467, used time: 2978.895
    33. 

  33. 6 - rf - mtry 25 : Rsqr : 0.62634, used time: 1866.602
    34. 

  34. 6 - rf - mtry 50 : Rsqr : 0.6385, used time: 1752.19
    35. 

  35. 6 - rf - mtry 100 : Rsqr : 0.64486, used time: 2661.496
    36. 

  36. Time 06:15:34, done 40 %, time elapsed 9, exp. time left 13, exp. full time 22
    37. 

  37. removing inefficient cause columns and useless rows in set: 7
    38. 

  38. set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507
    39. 

  39. set reduced to 6461142 items (91% of original size).
    40. 

  40. 7 - rf - mtry 10 : Rsqr : 0.51111, used time: 57.494
    41. 

  41. 7 - rf - mtry 25 : Rsqr : 0.53342, used time: 26.677
    42. 

  42. 7 - rf - mtry 50 : Rsqr : 0.55046, used time: 29.458
    43. 

  43. 7 - rf - mtry 100 : Rsqr : 0.5676, used time: 35.197
    44. 

  44. Time 06:18:08, done 47 %, time elapsed 9, exp. time left 10, exp. full time 19
    45. 

  45. downsampled set 8 from 57846825 items to 39996450 items (69%)
    46. 

  46. 8 - rf - mtry 10 : Rsqr : 0.65597, used time: 3540.161
    47. 

  47. 8 - rf - mtry 25 : Rsqr : 0.68117, used time: 2876.923
    48. 

  48. 8 - rf - mtry 50 : Rsqr : 0.70006, used time: 2391.232
    49. 

  49. 8 - rf - mtry 100 : Rsqr : 0.70829, used time: 2670.287
    50. 

  50. Time 09:32:22, done 53 %, time elapsed 12, exp. time left 11, exp. full time 23
    51. 

  51. 9 - rf - mtry 10 : Rsqr : 0.66972, used time: 813.899
    52. 

  52. 9 - rf - mtry 25 : Rsqr : 0.70111, used time: 370.194
    53. 

  53. 9 - rf - mtry 50 : Rsqr : 0.71348, used time: 531.49
    54. 

  54. 9 - rf - mtry 100 : Rsqr : 0.72678, used time: 815.269
    55. 

  55. Time 10:15:58, done 60 %, time elapsed 13, exp. time left 9, exp. full time 21
    56. 

  56. downsampled set 10 from 64586592 items to 39999552 items (62%)
    57. 

  57. 10 - rf - mtry 10 : Rsqr : 0.65459, used time: 2885.216
    58. 

  58. 10 - rf - mtry 25 : Rsqr : 0.67741, used time: 2815.623
    59. 

  59. 10 - rf - mtry 50 : Rsqr : 0.69002, used time: 2468.193
    60. 

  60. 10 - rf - mtry 100 : Rsqr : 0.69734, used time: 3388.195
    61. 

  61. Time 13:33:04, done 67 %, time elapsed 16, exp. time left 8, exp. full time 24
    62. 

  62. 11 - rf - mtry 10 : Rsqr : 0.51475, used time: 3374.336
    63. 

  63. 11 - rf - mtry 25 : Rsqr : 0.53893, used time: 2358.746
    64. 

  64. 11 - rf - mtry 50 : Rsqr : 0.55779, used time: 2105.517
    65. 

  65. 11 - rf - mtry 100 : Rsqr : 0.57779, used time: 2407.6
    66. 

  66. Time 16:26:42, done 73 %, time elapsed 19, exp. time left 7, exp. full time 26
    67. 

  67. downsampled set 12 from 47338272 items to 39989376 items (84%)
    68. 

  68. 12 - rf - mtry 10 : Rsqr : 0.51216, used time: 3831.043
    69. 

  69. 12 - rf - mtry 25 : Rsqr : 0.54288, used time: 2905.716
    70. 

  70. 12 - rf - mtry 50 : Rsqr : 0.56467, used time: 3009.606
    71. 

  71. 12 - rf - mtry 100 : Rsqr : 0.58474, used time: 3097.952
    72. 

  72. Time 20:02:53, done 80 %, time elapsed 23, exp. time left 6, exp. full time 28
    73. 

  73. 13 - rf - mtry 10 : Rsqr : 0.43743, used time: 2764.245
    74. 

  74. 13 - rf - mtry 25 : Rsqr : 0.46324, used time: 3108.395
    75. 

  75. 13 - rf - mtry 50 : Rsqr : 0.47484, used time: 3269.687
    76. 

  76. 13 - rf - mtry 100 : Rsqr : 0.49047, used time: 3134.987
    77. 

  77. Time 23:30:54, done 87 %, time elapsed 1, exp. time left 0, exp. full time 1
    78. 

  78. 14 - rf - mtry 10 : Rsqr : 0.36023, used time: 967.392
    79. 

  79. 14 - rf - mtry 25 : Rsqr : 0.38709, used time: 451.194
    80. 

  80. 14 - rf - mtry 50 : Rsqr : 0.40813, used time: 789.77
    81. 

  81. 14 - rf - mtry 100 : Rsqr : 0.42536, used time: 861.232
    82. 

  82. Time 00:25:20, done 93 %, time elapsed 1, exp. time left 0, exp. full time 1
    83. 

  83. 15 - rf - mtry 10 : Rsqr : 0.67446, used time: 302.802
    84. 

  84. 15 - rf - mtry 25 : Rsqr : 0.71083, used time: 279.809
    85. 

  85. 15 - rf - mtry 50 : Rsqr : 0.73352, used time: 272.292
    86. 

  86. 15 - rf - mtry 100 : Rsqr : 0.75464, used time: 296.682
    87. 

  87. 

  88. removing inefficient cause columns and useless rows in set: 1
    89. 

  89. set: 1 , kept 37241 rows of 37241 and 7431 cols of 9493
    90. 

  90. set reduced to 276737871 items (78% of original size).
    91. 

  91. downsampled set 1 from 276737871 items to 39993642 items (14%)
    92. 

  92. 1 - rf - mtry 100 : Rsqr : 0.54028, used time: 1348.785
    93. 

  93. Time 11:43:12, done 7 %, time elapsed 31, exp. time left 427, exp. full time 458
    94. 

  94. downsampled set 2 from 51241364 items to 39988958 items (78%)
    95. 

  95. 2 - rf - mtry 100 : Rsqr : 0.66616, used time: 2315.678
    96. 

  96. Time 12:24:01, done 13 %, time elapsed 1, exp. time left 8, exp. full time 9
    97. 

  97. 3 - rf - mtry 100 : Rsqr : 0.67413, used time: 1203.814
    98. 

  98. Time 12:48:14, done 20 %, time elapsed 2, exp. time left 6, exp. full time 8
    99. 

  99. 4 - rf - mtry 100 : Rsqr : 0.58702, used time: 59.748
    100. 

  100. Time 12:50:01, done 27 %, time elapsed 2, exp. time left 4, exp. full time 6
    101. 

  101. 5 - rf - mtry 100 : Rsqr : 0.70997, used time: 159.084
    102. 

  102. Time 12:52:50, done 33 %, time elapsed 2, exp. time left 3, exp. full time 5
    103. 

  103. downsampled set 6 from 333613124 items to 39992886 items (12%)
    104. 

  104. 6 - rf - mtry 100 : Rsqr : 0.66158, used time: 2571.409
    105. 

  105. Time 13:45:33, done 40 %, time elapsed 3, exp. time left 4, exp. full time 6
    106. 

  106. removing inefficient cause columns and useless rows in set: 7
    107. 

  107. set: 7 , kept 1569 rows of 1569 and 4118 cols of 4507
    108. 

  108. set reduced to 6461142 items (91% of original size).
    109. 

  109. 7 - rf - mtry 100 : Rsqr : 0.57127, used time: 120.971
    110. 

  110. Time 13:47:44, done 47 %, time elapsed 3, exp. time left 3, exp. full time 6
    111. 

  111. downsampled set 8 from 57846825 items to 39996450 items (69%)
    112. 

  112. 8 - rf - mtry 100 : Rsqr : 0.69487, used time: 2057.486
    113. 

  113. Time 14:25:17, done 53 %, time elapsed 3, exp. time left 3, exp. full time 6
    114. 

  114. 9 - rf - mtry 100 : Rsqr : 0.72863, used time: 515.658
    115. 

  115. Time 14:34:34, done 60 %, time elapsed 3, exp. time left 2, exp. full time 6
    116. 

  116. downsampled set 10 from 64586592 items to 39999552 items (62%)
    117. 

  117. 10 - rf - mtry 100 : Rsqr : 0.71172, used time: 1942.968
    118. 

  118. Time 15:10:11, done 67 %, time elapsed 4, exp. time left 2, exp. full time 6
    119. 

  119. 11 - rf - mtry 100 : Rsqr : 0.56769, used time: 994.197
    120. 

  120. Time 15:28:34, done 73 %, time elapsed 4, exp. time left 2, exp. full time 6
    121. 

  121. downsampled set 12 from 47338272 items to 39989376 items (84%)
    122. 

  122. 12 - rf - mtry 100 : Rsqr : 0.58312, used time: 2513.502
    123. 

  123. Time 16:13:54, done 80 %, time elapsed 5, exp. time left 1, exp. full time 6
    124. 

  124. 13 - rf - mtry 100 : Rsqr : 0.48583, used time: 1043.787
    125. 

  125. Time 16:32:03, done 87 %, time elapsed 5, exp. time left 1, exp. full time 6
    126. 

  126. 14 - rf - mtry 100 : Rsqr : 0.42532, used time: 260.751
    127. 

  127. Time 16:37:37, done 93 %, time elapsed 5, exp. time left 0, exp. full time 6
    128. 

  128. removing inefficient cause columns and useless rows in set: 15
    129. 

  129. set: 15 , kept 5059 rows of 5059 and 5276 cols of 5554
    130. 

  130. set reduced to 26691284 items (94% of original size).
    131. 

  131. 15 - rf - mtry 100 : Rsqr : 0.75357, used time: 797.019
    132. 

  132. Time 16:51:42, done 100 %, time elapsed 6, exp. time left 0, exp. full time 6
    133. 

  133. finished prediction loop, report size is 58743336
    134. 

  134. Time difference of 5.650599 hours
    135. 

  135. all finished
    136. 

  136. 

  137. 1 - rf - mtry 100 : Rsqr : 0.54399, used time: 351.804
    138. 

  138. 1 - rf - mtry 200 : Rsqr : 0.5658, used time: 403.143
    139. 

  139. 1 - rf - mtry 500 : Rsqr : 0.5857, used time: 585.845
    140. 

  140. 1 - rf - mtry 1000 : Rsqr : 0.59552, used time: 891.393
    141.