<p>To address your second point, I think taking the changes from <a href="https://github.com/mlpack/mlpack/issues/370" class="issue-link" title="evaluate various changes to L-BFGS optimizer">#370</a> that I proposed would help to address this issue. Your recent commit <a href="https://github.com/mlpack/mlpack/commit/658962feb431677099cc88d895b4e0b5fa2ae404" class="commit-link"><tt>658962f</tt></a> doesn't entirely address the issue because, while the function values are not changing much the gradient is all over the place and takes a while to settle down. </p>

<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">&mdash;<br>Reply to this email directly or <a href="https://github.com/mlpack/mlpack/pull/373#issuecomment-68801369">view it on GitHub</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AJ4bFJsELDjiNNxeF0T-YyWUXf_g6O7zks5nexX7gaJpZM4DN9un.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
  <div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
    <link itemprop="url" href="https://github.com/mlpack/mlpack/pull/373#issuecomment-68801369"></link>
    <meta itemprop="name" content="View Pull Request"></meta>
  </div>
  <meta itemprop="description" content="View this Pull Request on GitHub"></meta>
</div>