ML Definition & Types

The most important early ML decision is problem framing. Before selecting algorithms, you must decide which learning paradigm matches the available data and business objective.

Three paradigms and when they apply:

• Supervised Learning: you have labelled examples (X -> Y). Use when target is explicit and measurable. Subtypes: regression (continuous output) and classification (discrete categories).
• Unsupervised Learning: you only have inputs (X), no labels. Use for structure discovery: clustering, anomaly detection, dimensionality reduction.
• Reinforcement Learning: an agent takes actions over time and learns from reward signals. Use for sequential decision policies where outcomes depend on action history.

Practical framing checklist:

1. Do we have trustworthy labels at scale?
2. Is output a number, class, cluster, anomaly flag, or long-horizon policy?
3. Can success be measured immediately or only after delayed feedback?

Common failure mode: forcing a supervised model when labels are noisy or sparse, then blaming algorithm quality. In many projects, the real bottleneck is label quality and problem definition, not model complexity.

Production guidance: start with the simplest valid framing and establish evaluation baseline early. Paradigm changes later are expensive because data pipelines, metrics, and governance controls all shift.

Deepening Notes

Source-backed reinforcement: these points are extracted from the session source note to strengthen your theory intuition.

• Machine Learning became powerful not because computers got smarter.
• It became powerful because: We stopped trying to program intelligence And started teaching machines to learn from data.
• Now I want to understand you better as a learner: 1️⃣ Are you learning ML for career, research, business, or curiosity?
• 2️⃣ Do you have programming experience already (Python)?
• Samuel's claim to fame was that back in the 1950s, he wrote a checkers playing program.

Interview-Ready Deepening

Source-backed reinforcement: these points add detail beyond short-duration UI hints and emphasize production tradeoffs.

• Supervised, unsupervised, and reinforcement learning — when to use each.
• The two main types of machine learning are supervised learning and unsupervised learning.
• By far, the most used types of learning algorithms today are supervised learning, unsupervised learning, and recommender systems.
• In this specialization, which has three courses in total, the first and second courses will focus on supervised learning, and the third will focus on unsupervised learning, recommender systems, and reinforcement learning.
• Reinforcement Learning : an agent takes actions over time and learns from reward signals. Use for sequential decision policies where outcomes depend on action history.
• It became powerful because: We stopped trying to program intelligence And started teaching machines to learn from data.
• Here's a definition of what is machine learning that is attributed to Arthur Samuel.
• Of these two, supervised learning is the type of machine learning that is used most in many real-world applications and has seen the most rapid advancements and innovation.

Tradeoffs You Should Be Able to Explain

• More expressive models improve fit but can reduce interpretability and raise overfitting risk.
• Higher optimization speed can reduce training time but may increase instability if learning dynamics are not monitored.
• Feature-rich pipelines improve performance ceilings but increase maintenance and monitoring complexity.

First-time learner note: Read each model as a dataflow system: inputs become representations, representations become scores, and scores become decisions through a chosen loss and thresholding policy.

Production note: Track three things relentlessly in ML systems: data shape contracts, evaluation methodology, and the operational meaning of the model's errors. Most expensive failures come from one of those three.