Machine Learning

Week 1 - Intro

What is Machine Learning

• Checkers playing computer (Arthur Samuel)

Supervised Learning

Right answer is provided. Types of problems

• Regression
• Classification

Unsupervised Learning

The data has no "correct answer"

Cocktail party algorithm

Week 1 - Linear Regression with One variable

Model Representation

Working with housing prices in Portland as our dataset.

Symbols used

• m - number of training examples
• x - input variables
• y - output variable
• h - hypothesis (function h(x) = y)

Univariate linear regression

Cost Function

h_Θ(x) = Θ₀ + Θ₁x

sum of square error as our cost function. He's using 1/2m rather than 1/m, I'm not sure why.

Cost Function - Intuition : 1

Demo of technique.

Cost Function - Intuition : 2

Contour plots.

Gradient Descent

Θ_j = Θ_j - α (d/dΘ_j) * J(Θ₀, Θ₁)

Gradient Descent Intuition

Explaining gradient descent.

Gradient Descent for Linear Regression

• Θ₀ = Θ₀ - α(1/m) Σ^m (h_Θ(x_i) - y_i)
• Θ₁ = Θ₁ - α(1/m) Σ^m (h_Θ(x_i) - y_i) * x_i

Linear Regression with Multiple Variables - Week 2

Gradient Descent for Multiple Variables

• Parameters: Θ₀,Θ₁,...,Θ_n
• Cost Function: J( Θ₀,Θ₁,...,Θ_n ) or simply J(Θ)

Much like before, gradient descent is calculated for all Θs before being applied. To make the formula more uniform we set x_0,i = 1 for all i then the formula becomes

 Θj = Θj - (α/m) * Σi=1m (h(Θ, xi) - yi) * xi,j

Note: I may have my notation for rows and columns mixed up in the formula - double check before using.