<p>Hi, so i have added LeakyReLU and its tests. Also adding hard tanh activation. Please check if any modifications. I have not tested the Boost tests on my system yet. I might add PReLU as well if you'll agree, that will require training alpha as well. Thanks. </p>

<hr>

<h4>You can view, comment on, or merge this pull request online at:</h4>
<p>&nbsp;&nbsp;<a href='https://github.com/mlpack/mlpack/pull/544'>https://github.com/mlpack/mlpack/pull/544</a></p>

<h4>Commit Summary</h4>
<ul>
  <li>Added LeakyReLU activation layer and its test</li>
</ul>

<h4>File Changes</h4>
<ul>
  <li>
    <strong>A</strong>
    <a href="https://github.com/mlpack/mlpack/pull/544/files#diff-0">src/mlpack/methods/ann/activation_functions/leaky_relu_function.hpp</a>
    (230)
  </li>
  <li>
    <strong>M</strong>
    <a href="https://github.com/mlpack/mlpack/pull/544/files#diff-1">src/mlpack/tests/activation_functions_test.cpp</a>
    (71)
  </li>
</ul>

<h4>Patch Links:</h4>
<ul>
  <li><a href='https://github.com/mlpack/mlpack/pull/544.patch'>https://github.com/mlpack/mlpack/pull/544.patch</a></li>
  <li><a href='https://github.com/mlpack/mlpack/pull/544.diff'>https://github.com/mlpack/mlpack/pull/544.diff</a></li>
</ul>

<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">&mdash;<br>Reply to this email directly or <a href="https://github.com/mlpack/mlpack/pull/544">view it on GitHub</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AJ4bFBaSPYdbr54jpC7t072O6CZMF3Ygks5ppoSigaJpZM4HoKi1.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
  <link itemprop="url" href="https://github.com/mlpack/mlpack/pull/544"></link>
  <meta itemprop="name" content="View Pull Request"></meta>
</div>
<meta itemprop="description" content="View this Pull Request on GitHub"></meta>
</div>