Contents tagged with activation functions

  • Simple math behind neuron

    Hello everybody,

    today I want to share with you some ideas about activation functions in neural networks. 

    But before I'll do this let's see simplified edition of neuron:

    As usually many books describe following schema of working neuron:

    ignals go into dendrites into neuron body. Neuron body does some kind of converting signal into another signal and sends output through axon to another neuron.

    What is origin of signals, or where they come from? It can be any place of your body. It can be your eyes, it can be your nose, it can be touching of your hand, etc. Anything 

    that your body signals is processed in the brain. 

    So now, imagine, that you are mathematician and want to provide … more