Contents tagged with Rectified Linear Neurons
today I want to describe some simple models of neurons. Bet before I'll continue, just few words why to worry at all about simplification of neurons. The answer on question why is simple: simplification helps to understand bigger picture ( well not always ) and also allows to apply mathematics and make analogies to other familiar systems.
Now let's see models of "Idealized" neurons:
1. Linear neurons. Output is sum of bias plus multiplication of multiplication of inputs with weights.
Here is how it's chart look like:
2. Binary threshold neurons. It has following stages of calculation:
Compute a weighted sum of the inputs (1)
Send out fixed size spike of … more