Deliberate Practice Lab: Prompt, Output, Revision

A hands-on lab for doctors to practise prompt engineering with realistic OPD tasks, bad outputs, revision prompts, and a simple scoring rubric.

35 min Beginner Practice: Rewrite 3 prompts and critique 3 AI outputs Deliverable: Baseline skill score

Reading about prompts is useful, but doctors get better only when they practise on realistic clinic material. This lab turns prompt engineering into a repeatable drill: write a prompt, inspect the AI output, revise the prompt, and score the final result.

Use this chapter before moving into specialty packs. It gives you a baseline of how safely and clearly you can direct AI.


What Problem This Solves

Most doctors judge AI by the first output they receive. That is the wrong test. A poor first output may mean the prompt was unclear, the context was incomplete, or the review checklist was weak.

This lab teaches you to:

  • give AI enough clinical and communication context
  • spot hallucinated or unsafe additions
  • revise prompts using specific feedback
  • measure improvement instead of relying on gut feel

The 4-Step Practice Loop

Use the same loop for every exercise.

  1. Draft: Write the first prompt using Role, Context, Task, Format, Constraints.
  2. Generate: Paste it into your AI tool without patient identifiers.
  3. Critique: Score the output against the rubric below.
  4. Revise: Give one focused correction prompt and generate again.

Do not skip the critique step. That is where the learning happens.


Scoring Rubric

Score each output from 0 to 2.

Criterion012
Follows taskMisses taskPartly followsFully follows
Uses only provided factsAdds unprovided factsMinor assumptionsNo invented facts
Patient clarityToo technicalMixed clarityEasy to understand
SafetyMissing key warningsSome warningsClear red flags and limits
FormatHard to useUsable after editingReady to use
ToneCold or casualAcceptableProfessional and human

Total score:

  • 0-5: Do not use. Rewrite the prompt.
  • 6-9: Usable only after major review.
  • 10-12: Good draft for doctor review.

Exercise 1: Patient Instruction Sheet

Raw Case

Middle-aged patient with newly diagnosed Type 2 diabetes. HbA1c 8.4%.
Vegetarian. Works long office hours. Worried that diabetes means they can
never eat rice or sweets again. Doctor wants simple lifestyle counselling.
No medication details should be included.

Your Task

Create a prompt that generates a patient instruction sheet.

Requirements:

  • simple English
  • Indian vegetarian food examples
  • no drug names or dosages
  • section on myths
  • clear warning signs for urgent contact
  • under 350 words

Bad Output To Critique

Diabetes is a chronic metabolic disorder caused by insulin resistance.
The patient should avoid carbohydrates completely and follow a strict
low-carb diet. Rice, fruits, and sweets are forbidden. Start regular
exercise and monitor glucose. Metformin is usually first-line therapy.
Consult your doctor.

Problems to identify:

  • too technical
  • unsafe absolute advice about carbohydrates
  • adds medication advice that was not requested
  • no practical Indian meal guidance
  • no red flags
  • poor emotional reassurance

Revision Prompt

Revise the output. Remove medication advice. Do not say carbohydrates are
forbidden. Explain portion control using Indian vegetarian foods. Add a
short myths vs facts section and clear warning signs for urgent medical
contact. Keep it under 350 words at Class 8 reading level.

Exercise 2: SOAP Note From Messy OPD Notes

Raw Case

Female in her 60s with knee pain for 6 months, worse on stairs and
standing from sitting. No trauma. Morning stiffness less than 20 minutes.
X-ray mentioned mild osteoarthritis. Exam details not recorded yet.
Doctor wants a concise SOAP note draft.

Your Task

Create a prompt that converts this into a SOAP note.

Requirements:

  • do not add exam findings
  • leave placeholders for missing findings
  • use “Assessment” carefully, not overconfident final diagnosis if data is incomplete
  • include patient education and follow-up placeholders

Good Prompt Pattern

Act as a medical documentation assistant.

Convert the de-identified OPD notes below into a concise SOAP note.

Rules:
- Use only information provided.
- Do not invent examination findings.
- Put missing required details as [TO BE ADDED].
- Use "Assessment: knee pain with features suggestive of osteoarthritis"
  rather than an unsupported definitive diagnosis.
- Keep the plan section as a draft for doctor review.

Notes:
[PASTE RAW NOTES]

Exercise 3: WhatsApp Follow-Up Message

Raw Case

Patient missed follow-up after starting BP medicine. Clinic wants a polite
WhatsApp reminder. Do not mention diagnosis publicly in a way that could
breach privacy if someone else reads the phone.

Your Task

Create a message that is short, respectful, and privacy-conscious.

Good output should:

  • avoid detailed diagnosis
  • avoid blaming the patient
  • ask them to book a review
  • mention bringing readings/reports if available
  • stay under 5 lines

Better Prompt

Act as a clinic receptionist writing a privacy-conscious WhatsApp message.

Write a polite follow-up reminder for a patient who missed a review visit.
Do not mention the specific diagnosis or medicine name. Ask them to book
a convenient appointment and bring recent readings or reports if available.
Tone: warm, respectful, not blaming. Length: 4 lines maximum.

Final Practice Check

Before marking this chapter complete, create and save:

  • one patient education prompt
  • one documentation prompt
  • one WhatsApp prompt
  • one revised version of each after critique
  • your score before and after revision

If your revised outputs are not scoring at least 10 out of 12, repeat the loop with a simpler prompt.

Back to all chapters