<p>In <a href="https://github.com/mlpack/mlpack/pull/686#discussion_r69488137">src/mlpack/methods/ne/genome.hpp</a>:</p>
<pre style='color:#555'>> + ssize_t fromNeuronIdx = GetNeuronIndex(aLinkGenes[i].FromNeuronId());
> + double input = aNeuronGenes[toNeuronIdx].Input() +
> + aNeuronGenes[fromNeuronIdx].Activation() * aLinkGenes[i].Weight();
> + aNeuronGenes[toNeuronIdx].Input(input);
> +
> + if (i == NumLink() - 1) {
> + aNeuronGenes[toNeuronIdx].CalcActivation();
> + } else if (GetNeuronIndex(aLinkGenes[i + 1].ToNeuronId()) != toNeuronIdx) {
> + aNeuronGenes[toNeuronIdx].CalcActivation();
> + }
> + }
> + }
> + }
> +
> + // Get output vector.
> + std::vector<double> Output() {
</pre>
<p>Yeah, right.</p>
<p>I did some testing, and encounter an unexpected behaviour. This are the modifications I made: <a href="https://gist.github.com/zoq/181c036cb4b903f8e7cb2977639ee6b8">https://gist.github.com/zoq/181c036cb4b903f8e7cb2977639ee6b8</a></p>
<p>I've also, printed the activation function type in CalcActivation(), which is the RELU function, but I expected it to be SIGMOID, do we randomly choose the activation function, somewhere? The seed genome uses the SIGMOID for all neurons except for the BIAS neuron.</p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br />You are receiving this because you are subscribed to this thread.<br />Reply to this email directly, <a href="https://github.com/mlpack/mlpack/pull/686/files/554a279b0089e4385dfb40077e578d6ae2a42ece#r69488137">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe/AJ4bFGUvdB-jbyRhcZXpqCwAYLw7Z19-ks5qSWRPgaJpZM4IwJa6">mute the thread</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AJ4bFKGA-mF6wdaMdVMAXJXnT1_S1_ikks5qSWRPgaJpZM4IwJa6.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
<link itemprop="url" href="https://github.com/mlpack/mlpack/pull/686/files/554a279b0089e4385dfb40077e578d6ae2a42ece#r69488137"></link>
<meta itemprop="name" content="View Pull Request"></meta>
</div>
<meta itemprop="description" content="View this Pull Request on GitHub"></meta>
</div>