Iterables and Generators

advanced-python-patterns

Understand iteration and produce values lazily with generators.

Level: Intermediate
Estimated time: 35–50 minutes
You will learn: Understand iteration and produce values lazily with generators.
Practice in: VS Code, Jupyter, or Colab

Open this lesson in Google Colab

Questions

What problem does Iterables and Generators help us solve in a small Python program?
What should we predict before running the example?
What value, output, or error should we inspect after changing one line?

Objectives

Run a complete example for iterables and generators in Colab.
Explain the example line by line using plain language.
Change one part of the code and predict the result before running it.
Recognize one common mistake and use the error message as evidence.

Hands-on episode: Iterables and Generators

An iterable can be looped over. An iterator produces the next value when asked. A generator function uses yield to pause and resume.

We will learn this by running code, not by memorizing a definition first. Open the Colab notebook from the button above, find this section, and run each cell in order. Keep a small note beside the notebook with three columns: prediction, actual result, and what changed.

Example 1.1

Predict when each value is produced, not only what values appear.

def countdown(start):
current = start
while current > 0:
yield current
current = current - 1

for number in countdown(3):
print(number)

Run the cell once without editing it. If the result is different from your prediction, leave the prediction visible and write one sentence about the difference. That sentence is more useful than a perfect first guess.

Explain Example 1.1

Calling countdown(3) creates a generator object; the body does not finish immediately.
The loop asks for one value, so the function runs until yield current.
After yielding, the function pauses and later resumes with the next line.
The loop ends when the while condition becomes false.

Now explain the example out loud or in a Markdown cell. Use short sentences: “this line creates…”, “this name stores…”, “this output appears because…”. If you cannot explain a line yet, run only the lines above it and inspect the values that exist at that moment.

Challenge 1.1

Challenge

Turn the generator into list(countdown(3)) and compare that with looping directly. One approach collects all values; the other consumes them one at a time.

Show a safe way to approach the challenge

Copy Example 1.1 into a new Colab cell.
Change exactly one value, name, condition, or line.
Write the expected output before running the cell.
Run the cell and compare the actual result with your prediction.
If the result surprises you, undo the change and try a smaller one.

Suggested first move: Turn the generator into list(countdown(3)) and compare that with looping directly.

Debugging checkpoint 1.1

Debugging checkpoint

Iterators can be exhausted. If you loop over the same iterator twice and the second loop is empty, the values may already have been consumed. Create a fresh iterator or store values in a list if you need to reuse them.

Do not debug by rewriting the whole example. Read the error type or surprising output, inspect the closest value with print(...) or type(...), then change one thing. This is the same routine you will use in larger projects.

Apply it

Write a generator that yields even numbers up to a limit. Print values one by one, then convert the generator to a list and explain the difference.

Finish by adding a Markdown cell that answers: What did this example teach me that I can reuse in a project?

Key points

Learn the concept by running a complete, small example first.
Predict before execution so your thinking becomes visible.
Change one thing at a time so cause and effect stay clear.
Treat errors as clues about the exact line or value Python could not handle.

Why this matters

Understand iteration and produce values lazily with generators.

This lesson combines related subtopics that belong together in one learning conversation. You will still pause for a quiz after each section, but you do not need to jump between separate pages while building one clear explanation.

Guiding questions

By the end of this lesson, you should be able to answer:

How do the sections in Iterables and Generators fit together?
Which small example demonstrates each section?
Which debugging clue should I check first for each section?

Learning objectives

You will practice how to:

explain the shared concept for this lesson;
use each section as one step in a larger workflow;
complete 2 short section quizzes before moving on;
connect examples, mistakes, and debugging routines.

Lesson map

1. Iterables and Iterators — Understand objects that can be looped over and the mechanism that produces one item at a time.
2. Generators — Write functions that yield values lazily instead of returning a complete collection.

How iteration produces one value at a time

A generator produces one value, pauses, remembers its state, and resumes when the next value is requested.

stateDiagram-v2
  [*] --> Ready
  Ready --> YieldOne: next()
  YieldOne --> Paused: yield value
  Paused --> YieldTwo: next()
  YieldTwo --> PausedAgain: yield next value
  PausedAgain --> Done: no more values
  Done --> [*]

Generators are useful when you want a sequence over time instead of building the whole collection immediately.

1. Iterables and Iterators

Understand objects that can be looped over and the mechanism that produces one item at a time.

Analogy

An iterator is a bookmark moving through a book one page at a time.

What this means

An iterable can provide an iterator; an iterator remembers where it is in a sequence of values.

Example 1

Predict what will happen before you run the code.

numbers = iter([10, 20, 30])
print(next(numbers))
print(next(numbers))

Step-by-step explanation

numbers = iter([10, 20, 30]) — pause here and say what this line reads, creates, changes, or displays.
print(next(numbers)) — pause here and say what this line reads, creates, changes, or displays.
print(next(numbers)) — pause here and say what this line reads, creates, changes, or displays.

After running the example, compare the actual output with your prediction. If they differ, do not erase your prediction. The difference is the part that can teach you the most.

Challenge

Practice

Change one input value, predict the new output, run the code, and explain the difference in one sentence.

Show one possible solution path

Copy Example 1 into Colab, Jupyter, or a .py file.
Mark the line you plan to change.
Write a one-sentence prediction.
Run the changed code.
If the result surprises you, restore the original and change a smaller part.

The goal is not to find the only correct answer. The goal is to create a small experiment where you can explain cause and effect.

Common mistakes

Common mistake

An iterator can be consumed. If it is exhausted, looping over it again may produce nothing.

When you get stuck, use this debugging routine:

Read the last line of the error message or inspect the unexpected output.
Find the smallest line of code that could be responsible.
Print or inspect the value and type at that point.
Change one thing.
Run again and record what changed.

Check your understanding

This quiz checks the ideas in this section before you move on.

{
  const scripts = Array.from(
    document.querySelectorAll("script.fcpython-ojs-quiz-config")
  );
  const script = scripts.find(
    (node) => node.dataset.fcpythonRendered !== "true"
  );

  if (!script) {
    return html`<div class="fcpython-quiz fcpython-quiz-warning">
      Quiz configuration was not found.
    </div>`;
  }

  script.dataset.fcpythonRendered = "true";
  const quiz = JSON.parse(script.textContent);
  const container = html`<div class="fcpython-quiz"></div>`;
  const title = document.createElement("h3");
  title.textContent = quiz.title;
  container.appendChild(title);

  const instructions = document.createElement("p");
  instructions.textContent = quiz.instructions;
  container.appendChild(instructions);

  const feedbackNodes = [];

  quiz.questions.forEach((question, questionIndex) => {
    const fieldset = document.createElement("fieldset");
    fieldset.className = "fcpython-quiz-question";

    const legend = document.createElement("legend");
    legend.textContent = `${questionIndex + 1}. ${question.prompt}`;
    fieldset.appendChild(legend);

    question.options.forEach((option, optionIndex) => {
      const label = document.createElement("label");
      label.className = "fcpython-quiz-option";

      const input = document.createElement("input");
      input.type = "radio";
      input.name = `${quiz.id}-${question.id}`;
      input.value = String(optionIndex);

      const text = document.createElement("span");
      text.textContent = option;

      label.appendChild(input);
      label.appendChild(text);
      fieldset.appendChild(label);
    });

    const feedback = document.createElement("p");
    feedback.className = "fcpython-quiz-feedback";
    feedback.setAttribute("aria-live", "polite");
    feedbackNodes.push(feedback);
    fieldset.appendChild(feedback);
    container.appendChild(fieldset);
  });

  const actions = document.createElement("div");
  actions.className = "fcpython-quiz-actions";

  const check = document.createElement("button");
  check.type = "button";
  check.textContent = "Check answers";

  const reset = document.createElement("button");
  reset.type = "button";
  reset.textContent = "Reset";

  const score = document.createElement("p");
  score.className = "fcpython-quiz-score";
  score.setAttribute("aria-live", "polite");

  check.addEventListener("click", () => {
    let correctCount = 0;

    quiz.questions.forEach((question, questionIndex) => {
      const selected = container.querySelector(
        `input[name="${quiz.id}-${question.id}"]:checked`
      );
      const feedback = feedbackNodes[questionIndex];

      if (!selected) {
        feedback.textContent = "Choose an answer before checking.";
        feedback.className = "fcpython-quiz-feedback";
        return;
      }

      const selectedIndex = Number(selected.value);
      if (selectedIndex === question.answer_index) {
        correctCount += 1;
        feedback.textContent = `✅ Correct. ${question.explanation}`;
        feedback.className = "fcpython-quiz-feedback is-correct";
      } else {
        const answer = question.options[question.answer_index];
        feedback.textContent = `❌ Not yet. Correct answer: ${answer}. ${question.explanation}`;
        feedback.className = "fcpython-quiz-feedback is-incorrect";
      }
    });

    score.textContent = `Score: ${correctCount}/${quiz.questions.length}`;
  });

  reset.addEventListener("click", () => {
    container.querySelectorAll("input[type='radio']").forEach((input) => {
      input.checked = false;
    });
    feedbackNodes.forEach((feedback) => {
      feedback.textContent = "";
      feedback.className = "fcpython-quiz-feedback";
    });
    score.textContent = "";
  });

  actions.appendChild(check);
  actions.appendChild(reset);
  container.appendChild(actions);
  container.appendChild(score);
  return container;
}

2. Generators

Write functions that yield values lazily instead of returning a complete collection.

Analogy

A generator is a vending machine: it gives one item when asked, not the whole warehouse.

What this means

A generator produces values one at a time, pausing between yields.

Example 2

Predict what will happen before you run the code.

def countdown(start):
    while start > 0:
        yield start
        start -= 1

for number in countdown(3):
    print(number)

Step-by-step explanation

def countdown(start): — pause here and say what this line reads, creates, changes, or displays.
while start > 0: — pause here and say what this line reads, creates, changes, or displays.
yield start — pause here and say what this line reads, creates, changes, or displays.
start -= 1 — pause here and say what this line reads, creates, changes, or displays.
for number in countdown(3): — pause here and say what this line reads, creates, changes, or displays.
Continue the same process for the remaining lines, one line at a time.

After running the example, compare the actual output with your prediction. If they differ, do not erase your prediction. The difference is the part that can teach you the most.

Challenge

Practice

Change one input value, predict the new output, run the code, and explain the difference in one sentence.

Show one possible solution path

Copy Example 1 into Colab, Jupyter, or a .py file.
Mark the line you plan to change.
Write a one-sentence prediction.
Run the changed code.
If the result surprises you, restore the original and change a smaller part.

The goal is not to find the only correct answer. The goal is to create a small experiment where you can explain cause and effect.

Common mistakes

Common mistake

yield pauses the function; return ends it. Use yield when callers should receive a sequence over time.

When you get stuck, use this debugging routine:

Read the last line of the error message or inspect the unexpected output.
Find the smallest line of code that could be responsible.
Print or inspect the value and type at that point.
Change one thing.
Run again and record what changed.

Check your understanding

This quiz checks the ideas in this section before you move on.

{
  const scripts = Array.from(
    document.querySelectorAll("script.fcpython-ojs-quiz-config")
  );
  const script = scripts.find(
    (node) => node.dataset.fcpythonRendered !== "true"
  );

  if (!script) {
    return html`<div class="fcpython-quiz fcpython-quiz-warning">
      Quiz configuration was not found.
    </div>`;
  }

  script.dataset.fcpythonRendered = "true";
  const quiz = JSON.parse(script.textContent);
  const container = html`<div class="fcpython-quiz"></div>`;
  const title = document.createElement("h3");
  title.textContent = quiz.title;
  container.appendChild(title);

  const instructions = document.createElement("p");
  instructions.textContent = quiz.instructions;
  container.appendChild(instructions);

  const feedbackNodes = [];

  quiz.questions.forEach((question, questionIndex) => {
    const fieldset = document.createElement("fieldset");
    fieldset.className = "fcpython-quiz-question";

    const legend = document.createElement("legend");
    legend.textContent = `${questionIndex + 1}. ${question.prompt}`;
    fieldset.appendChild(legend);

    question.options.forEach((option, optionIndex) => {
      const label = document.createElement("label");
      label.className = "fcpython-quiz-option";

      const input = document.createElement("input");
      input.type = "radio";
      input.name = `${quiz.id}-${question.id}`;
      input.value = String(optionIndex);

      const text = document.createElement("span");
      text.textContent = option;

      label.appendChild(input);
      label.appendChild(text);
      fieldset.appendChild(label);
    });

    const feedback = document.createElement("p");
    feedback.className = "fcpython-quiz-feedback";
    feedback.setAttribute("aria-live", "polite");
    feedbackNodes.push(feedback);
    fieldset.appendChild(feedback);
    container.appendChild(fieldset);
  });

  const actions = document.createElement("div");
  actions.className = "fcpython-quiz-actions";

  const check = document.createElement("button");
  check.type = "button";
  check.textContent = "Check answers";

  const reset = document.createElement("button");
  reset.type = "button";
  reset.textContent = "Reset";

  const score = document.createElement("p");
  score.className = "fcpython-quiz-score";
  score.setAttribute("aria-live", "polite");

  check.addEventListener("click", () => {
    let correctCount = 0;

    quiz.questions.forEach((question, questionIndex) => {
      const selected = container.querySelector(
        `input[name="${quiz.id}-${question.id}"]:checked`
      );
      const feedback = feedbackNodes[questionIndex];

      if (!selected) {
        feedback.textContent = "Choose an answer before checking.";
        feedback.className = "fcpython-quiz-feedback";
        return;
      }

      const selectedIndex = Number(selected.value);
      if (selectedIndex === question.answer_index) {
        correctCount += 1;
        feedback.textContent = `✅ Correct. ${question.explanation}`;
        feedback.className = "fcpython-quiz-feedback is-correct";
      } else {
        const answer = question.options[question.answer_index];
        feedback.textContent = `❌ Not yet. Correct answer: ${answer}. ${question.explanation}`;
        feedback.className = "fcpython-quiz-feedback is-incorrect";
      }
    });

    score.textContent = `Score: ${correctCount}/${quiz.questions.length}`;
  });

  reset.addEventListener("click", () => {
    container.querySelectorAll("input[type='radio']").forEach((input) => {
      input.checked = false;
    });
    feedbackNodes.forEach((feedback) => {
      feedback.textContent = "";
      feedback.className = "fcpython-quiz-feedback";
    });
    score.textContent = "";
  });

  actions.appendChild(check);
  actions.appendChild(reset);
  container.appendChild(actions);
  container.appendChild(score);
  return container;
}

Notebook and Colab practice

Open a blank notebook at https://colab.new. Use one section at a time: copy the Example 1, predict the result, run it, answer the section quiz, and then move to the next section. This is better than copying the entire page at once.

Instructor note

Teaching notes

Treat each section as a short teaching episode.
Pause for the section quiz before introducing the next section.
Ask learners to compare sections: what stayed the same, and what changed?
If time is short, teach the first two sections live and assign the rest as practice.

Key points

Iterables and Iterators: An iterable can provide an iterator; an iterator remembers where it is in a sequence of values.
Generators: A generator produces values one at a time, pausing between yields.
Use the section quizzes as gates: review before moving on if a quiz feels uncertain.

References

Python functional tools: https://docs.python.org/3/howto/functional.html
contextlib documentation: https://docs.python.org/3/library/contextlib.html
logging documentation: https://docs.python.org/3/library/logging.html
Python Tutorial: https://docs.python.org/3/tutorial/
Quarto OJS documentation: https://quarto.org/docs/interactive/ojs/
ipywidgets documentation: https://ipywidgets.readthedocs.io/en/stable/