Back to Course

Same Question, Two Responses

35-45 minutesCreative makersWork-focusedBest for: People who've used AI a bit and want to see why the model you pick matters

What You'll Do

In class we talked about big, medium, and small AI models. In this task you'll run three practice prompts through a small, fast model and a big model, then compare the answers. Some prompts show a big difference and some don't. Both are useful to know.

1Pick your setup

Free account, or not sure what you have? Use Gemini: https://gemini.google.com Sign in with a Google account. Find the model menu (near the message box, or at the top of the screen). You'll see a few options. For this task, use Fast and Pro. Paid ChatGPT, Claude, or Gemini? Use your own tool's model menu and pick the smallest and the biggest model. Use the model slide from class as a guide, since the names change often.

2Start a new chat with the small model and paste in Prompt 1

3Start a second new chat with the big model and paste in the same prompt

Two browser tabs side by side works well. On a phone, do one and then the other.

4Compare the two answers using the questions below

5Repeat with Prompts 2 and 3

Spot the Difference

After each prompt, ask yourself:

  • •Which one answered faster?
  • •Which one was more specific?
  • •Did either one get something wrong, or ignore something I asked for?
  • •Which answer would I actually use?

Prompt 1: Simple Cleanup

Copy and paste this into both models:
Turn these messy notes into a short, friendly email to the group. Put who's bringing what in a list. potluck sat 6pm at the grange. jen- potato salad, maybe rolls?? bob said chili (2 crockpots). need plates + cups, carol might have. dessert TBD. tables set up by 5:30, need 2 ppl. kids games? ask mike

What to notice:

  • -Both will probably do fine. Was the big model worth the wait?

Prompt 2: Bigger Research Question

Copy and paste this into both models:
I live in Polson, Montana and I'm thinking about replacing my propane furnace with a heat pump. Will a heat pump keep my house warm in our winters? What would it roughly cost, what should I ask an installer, and are there any rebates or tax credits available right now? Tell me where your information comes from.

What to notice:

  • -How specific is each answer to Montana winters?
  • -Does either one give sources?
  • -Does either one say what it's unsure about?
  • -Rebates and tax credits change often. Turn on your baloney detector and check what each one says against an official source, like https://energystar.gov or your power company.

Prompt 3: Planning With Lots of Moving Parts

Copy and paste this into both models:
I'm hosting Thanksgiving for 12 people and dinner is at 4:00 pm. I have one oven. My 16 lb turkey needs to roast at 325°F and rest 30 minutes before carving. Stuffing bakes at 375°F for 45 minutes. Rolls bake at 400°F for 15 minutes. Pumpkin pie bakes at 350°F for 55 minutes and can be made in the morning. Make me a timeline for the day starting at 8:00 am, and point out any problems with my plan.

What to notice:

  • -There's a problem hidden in this plan. Does each model catch it, or does it quietly put two things in the oven at once? (The answer is at the bottom of this task.)

What to Expect

  • •Prompt 1: Both models will likely give you a usable email. The fast one will be quicker.
  • •Prompt 2: The big model usually takes longer and gives more detail, more caveats, and sometimes sources.
  • •Prompt 3: This is where the difference usually shows up. Small models are more likely to skip a rule you gave them.
  • •The big model may show that it's "thinking" before it answers. That's normal.
  • •Free Gemini only gives you a handful of Pro answers. If you hit a limit, that's normal and part of how free plans work. Finish with Fast, or compare two different chatbots instead.

Tips

  • •Use a new chat for each model, so the first answer doesn't shape the second.
  • •Longer isn't always better. Judge on whether it's right and useful.
  • •If both answers look about the same, that's a real finding. You don't need the big model for that kind of job.
  • •No model menu? Some free plans don't have one. Compare two different chatbots instead (for example, Gemini and ChatGPT).

Go Further

Take a question from your own life or work and run it through both models. Leave out private details, and if your workplace has rules about AI, use made-up names and numbers. Was the big model worth it?

Prompt 3 answer

The stuffing needs 45 minutes at a hotter temperature, but the turkey only rests for 30. A good answer notices and suggests a fix, like baking the stuffing earlier and reheating it, or letting the turkey rest longer.

General Tips for All Tasks

Saving Your Conversation (All Tasks):

  • •If you're signed in to your account, your chats are saved automatically and show up in the history list (usually along the left side of the screen). You can come back to them any time.
  • •ChatGPT: Your chat appears in the left sidebar. Click the three dots next to a chat to rename it or share it.
  • •Claude: Your chat appears under your recent chats in the left sidebar. Click the chat's title at the top to rename it.
  • •Gemini: Your chat appears in the left menu under recent chats. Click the three dots next to a chat to rename or pin it.
  • •Used a Temporary or Incognito chat? Those aren't saved. Copy anything you want to keep before you close it.
  • •Not signed in? The chat may disappear when you close the page. Copy what you want to keep and paste it into a document before you leave.
  • •Remember: if you share a chat, anyone with the link can read the whole conversation.

Getting Unstuck:

  • •If AI gives you an unhelpful response, try rephrasing your question
  • •Add more details or context
  • •Ask it to try again with specific changes

Technical Issues:

  • •If the AI tool isn't loading, try refreshing the page or switching to a different tool
  • •Make sure you're connected to wifi
  • •Ask Connor for help! Working from home? Email hello@connormulvaney.com

Remember:

  • •There's no "wrong" way to do this
  • •Experimentation is encouraged
  • •You can switch tasks if you want to try something different
  • •AI makes mistakes. Keep your baloney detector on

What to Bring Next Week (Optional)

Next class is Monday, Oct 19, and Loga is running it while I'm out of town. There's no class Oct 26. I'll see you Nov 2.

  • •Something AI got wrong, and how you caught it (Task 1)
  • •Which model you'd use for what (Task 2)
  • •Your plan and what step 2 looks like (Task 3)
  • •Questions about AI that came up while you were experimenting
Back to Course