Neural Networks: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
Line 9: Line 9:
This is a representation of a logistic unit with a sigmoid ([[Sigmoid_Function#Logistic_Function|logistic]]) activation function.
This is a representation of a logistic unit with a sigmoid ([[Sigmoid_Function#Logistic_Function|logistic]]) activation function.


The θ vector represents the model's ''parameters'' (model's ''weights'').
The θ vector represents the model's ''parameters'' (model's ''weights''). For a multi-layer neural network, the model parameters are collected in matrices named Θ, which will be describe below.


The bias unit is optional, but when it is provided, it is always 1.
The bias unit is optional, but when it is provided, it is always 1.

Revision as of 01:58, 4 January 2018

Internal

Individual Neuron

Neuron.png

This is a representation of a logistic unit with a sigmoid (logistic) activation function.

The θ vector represents the model's parameters (model's weights). For a multi-layer neural network, the model parameters are collected in matrices named Θ, which will be describe below.

The bias unit is optional, but when it is provided, it is always 1.