With due respect I argue quite opposite, NN always extrapolates not interpolates. We were hoping that with advance architectures NN would have been learning better distribution but because the search space is so big it can't interpolate (from the convex hull definition). And also it extrapolates in the sense that the points are outside the convex hull, that's it. Not extrapolation in the sense of continuing a distribution function.