<p>Hi, so i have added LeakyReLU and its tests. Also adding hard tanh activation. Please check if any modifications. I have not tested the Boost tests on my system yet. I might add PReLU as well if you'll agree, that will require training alpha as well. Thanks. </p>
<hr>
<h4>You can view, comment on, or merge this pull request online at:</h4>
<p> <a href='https://github.com/mlpack/mlpack/pull/544'>https://github.com/mlpack/mlpack/pull/544</a></p>
<h4>Commit Summary</h4>
<ul>
<li>Added LeakyReLU activation layer and its test</li>
</ul>
<h4>File Changes</h4>
<ul>
<li>
<strong>A</strong>
<a href="https://github.com/mlpack/mlpack/pull/544/files#diff-0">src/mlpack/methods/ann/activation_functions/leaky_relu_function.hpp</a>
(230)
</li>
<li>
<strong>M</strong>
<a href="https://github.com/mlpack/mlpack/pull/544/files#diff-1">src/mlpack/tests/activation_functions_test.cpp</a>
(71)
</li>
</ul>
<h4>Patch Links:</h4>
<ul>
<li><a href='https://github.com/mlpack/mlpack/pull/544.patch'>https://github.com/mlpack/mlpack/pull/544.patch</a></li>
<li><a href='https://github.com/mlpack/mlpack/pull/544.diff'>https://github.com/mlpack/mlpack/pull/544.diff</a></li>
</ul>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br>Reply to this email directly or <a href="https://github.com/mlpack/mlpack/pull/544">view it on GitHub</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AJ4bFBaSPYdbr54jpC7t072O6CZMF3Ygks5ppoSigaJpZM4HoKi1.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
<link itemprop="url" href="https://github.com/mlpack/mlpack/pull/544"></link>
<meta itemprop="name" content="View Pull Request"></meta>
</div>
<meta itemprop="description" content="View this Pull Request on GitHub"></meta>
</div>