I’ve been working on fitting a convolutional model of neurons in primary and intermediate visual cortex. A non-convex optimization problem must be solved to estimate the parameters of the model. It has a form similar to: There are some shared weights to further complicate things, but the most salient features is that it’s a 3-layer … More Why second-order methods can be futile in non-convex problems