How to make efficient usage of Neural Networks

Small note of how to use more effective of Neural Networks:

1. Use different numbers of hidden layers

2. Different numbers of units per layer

3. Different types of unit

4. Different types of strengths of weight penalty

5. Different learning algorithms