Unsupervised Learning

Andrew Ng's framing: 'Don't let the name fool you — unsupervised learning is just as super as supervised learning.'

In unsupervised learning, your dataset has no output labels Y — just input features X. You're not trying to predict anything specific. Instead, the algorithm must discover hidden structure, patterns, or groupings all by itself.

The most common type is clustering — grouping similar data points together. Real example from the topic: Google News. Every day, thousands of news articles are published. Google News groups stories about the same event across hundreds of different sources — no human manually labels which articles belong together. The clustering algorithm discovers the groups by text similarity.

Another example from the topic: DNA microarray data — researchers measure gene activity across thousands of people and cluster them to discover which individuals share similar genetic patterns. No one told the algorithm what to look for.

Other unsupervised types you'll learn later: anomaly detection (fraud detection) and dimensionality reduction (compressing data while preserving structure).

Deepening Notes

Source-backed reinforcement: these points are extracted from the session source note to strengthen your theory intuition.

• Let's take a look at what that means, we've talked about supervised learning and this video is about unsupervised learning.
• When we're looking at supervised learning in the last video recalled, it looks something like this in the case of a classification problem.
• We're not asked to diagnose whether the tumor is benign or malignant, because we're not given any labels.
• This is unsupervised learning, we call it unsupervised because we're not trying to supervise the algorithm.
• This is a particular type of unsupervised learning, called a clustering algorithm.

Interview-Ready Deepening

Source-backed reinforcement: these points add detail beyond short-duration UI hints and emphasize production tradeoffs.

• Finding hidden structure in data with no labels — clustering, anomaly detection, and more.
• Which is a type of unsupervised learning algorithm, takes data without labels and tries to automatically group them into clusters.
• This is unsupervised learning, we call it unsupervised because we're not trying to supervise the algorithm.
• This is a particular type of unsupervised learning, called a clustering algorithm.
• An unsupervised learning algorithm, might decide that the data can be assigned to two different groups or two different clusters.
• This is unsupervised learning, because we're not telling the algorithm in advance, that there is a type one person with certain characteristics.
• This is unsupervised learning, here's the third example, many companies have huge databases of customer information given this data.
• We're not asked to diagnose whether the tumor is benign or malignant, because we're not given any labels.

Tradeoffs You Should Be Able to Explain

• More expressive models improve fit but can reduce interpretability and raise overfitting risk.
• Higher optimization speed can reduce training time but may increase instability if learning dynamics are not monitored.
• Feature-rich pipelines improve performance ceilings but increase maintenance and monitoring complexity.

First-time learner note: Read each model as a dataflow system: inputs become representations, representations become scores, and scores become decisions through a chosen loss and thresholding policy.

Production note: Track three things relentlessly in ML systems: data shape contracts, evaluation methodology, and the operational meaning of the model's errors. Most expensive failures come from one of those three.