Is Differentiable Programming Actually Necessary? Can't you just train the neural networks separately?

22 · Christopher Rackauckas · Oct. 4, 2022, 8:32 a.m.
Is differentiable programming actually necessary, or can you just train the neural network in isolation against data and then stick the trained neural network into the simulation? We looked at this problem in detail in our new manuscript titled Capturing missing physics in climate model parameterizations using neural differential equations. The goal of this project is to understand temperature mixing in large eddy simulations, essentially columns of water in the ocean. I.e., can we take a "true"...