Neural Networks: Difference between revisions
Jump to navigation
Jump to search
| Line 13: | Line 13: | ||
The θ vector represents the model's ''parameters'' (model's ''weights''). For a multi-layer neural network, the model parameters are collected in matrices named Θ, which will be describe below. | The θ vector represents the model's ''parameters'' (model's ''weights''). For a multi-layer neural network, the model parameters are collected in matrices named Θ, which will be describe below. | ||
The bias unit is optional, | The bias unit is optional, and it is equal with 1 when it is provided. | ||
=Multi-Layer Neural Network= | =Multi-Layer Neural Network= | ||
Revision as of 02:36, 4 January 2018
Internal
Individual Neuron
Individual neurons are computational units that read input features, represented as an unidimensional vector x1 ... xn in the diagram below, and calculate the hypothesis function as output. Note that x0 is not part of the feature vector, but it represents a bias value for the unit.
A common option is to use a logistic function as hypothesis, thus the unit is referred to as a logistic unit with a sigmoid (logistic) activation function.
The θ vector represents the model's parameters (model's weights). For a multi-layer neural network, the model parameters are collected in matrices named Θ, which will be describe below.
The bias unit is optional, and it is equal with 1 when it is provided.
Multi-Layer Neural Network
When the output