See the forest and the trees!
Published:
Congratulations to Dave Connelly, who just submitted his first paper! It is about the use of regression forest to represent atmospheric gravity wave momentum transport to JAMES! The manuscript makes two important steps forward. First, it shows that a “boosted forest” approach, where you train each subsequent decision tree on the residual (as sketched below), can out perform a “random forest” where you combine a number of decision trees, averaging the result. This was well known in the ML community, but less so in the climate sciences. Second, Dave found that techniques from interpretable AI could be used to improve the training of a data driven parameterization. Using feature importance metrics, he found that his origional boosted forest wasn’t using enough information about latitude. By forcing the method to predict the latitude as well, he could build trees that incorporate this information more effectively!