You can use the iteration history of the solution to plot the trajectory from the initial guess. For an example, see "Optimization with nonlinear constraints in SAS."
If you are fitting parameters of a model to data (for example, maximum likelihood optimization), this behavior often indicates that the model does not fit the data and the likelihood function is very flat. It can indicate a misspecified model or a sample size that is too small.
... View more