In addition to the above, there are often additional hyperparamaters which are included in the setup of a neural network. These will be discussed below.