Machine Learning

Week 1 - Intro

What is Machine Learning

• Checkers playing computer (Arthur Samuel)

Supervised Learning

Right answer is provided. Types of problems

• Regression
• Classification

Unsupervised Learning

The data has no "correct answer"

Cocktail party algorithm

Week 1 - Linear Regression with One variable

Model Representation

Working with housing prices in Portland as our dataset.

Symbols used

• m - number of training examples
• x - input variables
• y - output variable
• h - hypothesis (function h(x) = y)

Univariate linear regression

Cost Function

h_Θ(x) = Θ₀ + Θ₁x

sum of square error as our cost function. He's using 1/2m rather than 1/m, I'm not sure why.

Cost Function - Intuition : 1

Demo of technique.

Cost Function - Intuition : 2

Contour plots.

Gradient Descent

Θ_j = Θ_j - α (d/dΘ_j) * J(Θ₀, Θ₁)

Gradient Descent Intuition

Explaining gradient descent.

Gradient Descent for Linear Regression

• Θ₀ = Θ₀ - α(1/m) Σ^m (h_Θ(x_i) - y_i)
• Θ₁ = Θ₁ - α(1/m) Σ^m (h_Θ(x_i) - y_i) * x_i