<p>Hi. Thanks for the suggestions. I have made the required changes <a href="https://github.com/abhinavchanda/mlpack/blob/412_leakyReLULayer/src/mlpack/methods/ann/layer/leaky_relu_layer.hpp">here</a>.Regarding testing I have a doubt. As leakyReLu is a layer, as opposed to a single neuron, so it should have only forwad and backward as public methods and the activation function and derivative should not be exposed, but in tests/activation_functions_test.cpp only activation functions and their derivatives are being tested.</p>

<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">&mdash;<br>Reply to this email directly or <a href="https://github.com/mlpack/mlpack/issues/412#issuecomment-191624240">view it on GitHub</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AJ4bFL7JhPSC1imdjT-bNJqBIyQs5nDMks5ppovigaJpZM4DnsOk.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
  <link itemprop="url" href="https://github.com/mlpack/mlpack/issues/412#issuecomment-191624240"></link>
  <meta itemprop="name" content="View Issue"></meta>
</div>
<meta itemprop="description" content="View this Issue on GitHub"></meta>
</div>