Deliberate Practice Lab: Prompt, Output, Revision
A hands-on lab for doctors to practise prompt engineering with realistic OPD tasks, bad outputs, revision prompts, and a simple scoring rubric.
Reading about prompts is useful, but doctors get better only when they practise on realistic clinic material. This lab turns prompt engineering into a repeatable drill: write a prompt, inspect the AI output, revise the prompt, and score the final result.
Use this chapter before moving into specialty packs. It gives you a baseline of how safely and clearly you can direct AI.
What Problem This Solves
Most doctors judge AI by the first output they receive. That is the wrong test. A poor first output may mean the prompt was unclear, the context was incomplete, or the review checklist was weak.
This lab teaches you to:
- give AI enough clinical and communication context
- spot hallucinated or unsafe additions
- revise prompts using specific feedback
- measure improvement instead of relying on gut feel
The 4-Step Practice Loop
Use the same loop for every exercise.
- Draft: Write the first prompt using Role, Context, Task, Format, Constraints.
- Generate: Paste it into your AI tool without patient identifiers.
- Critique: Score the output against the rubric below.
- Revise: Give one focused correction prompt and generate again.
Do not skip the critique step. That is where the learning happens.
Scoring Rubric
Score each output from 0 to 2.
| Criterion | 0 | 1 | 2 |
|---|---|---|---|
| Follows task | Misses task | Partly follows | Fully follows |
| Uses only provided facts | Adds unprovided facts | Minor assumptions | No invented facts |
| Patient clarity | Too technical | Mixed clarity | Easy to understand |
| Safety | Missing key warnings | Some warnings | Clear red flags and limits |
| Format | Hard to use | Usable after editing | Ready to use |
| Tone | Cold or casual | Acceptable | Professional and human |
Total score:
- 0-5: Do not use. Rewrite the prompt.
- 6-9: Usable only after major review.
- 10-12: Good draft for doctor review.
Exercise 1: Patient Instruction Sheet
Raw Case
Middle-aged patient with newly diagnosed Type 2 diabetes. HbA1c 8.4%.
Vegetarian. Works long office hours. Worried that diabetes means they can
never eat rice or sweets again. Doctor wants simple lifestyle counselling.
No medication details should be included.
Your Task
Create a prompt that generates a patient instruction sheet.
Requirements:
- simple English
- Indian vegetarian food examples
- no drug names or dosages
- section on myths
- clear warning signs for urgent contact
- under 350 words
Bad Output To Critique
Diabetes is a chronic metabolic disorder caused by insulin resistance.
The patient should avoid carbohydrates completely and follow a strict
low-carb diet. Rice, fruits, and sweets are forbidden. Start regular
exercise and monitor glucose. Metformin is usually first-line therapy.
Consult your doctor.
Problems to identify:
- too technical
- unsafe absolute advice about carbohydrates
- adds medication advice that was not requested
- no practical Indian meal guidance
- no red flags
- poor emotional reassurance
Revision Prompt
Revise the output. Remove medication advice. Do not say carbohydrates are
forbidden. Explain portion control using Indian vegetarian foods. Add a
short myths vs facts section and clear warning signs for urgent medical
contact. Keep it under 350 words at Class 8 reading level.
Exercise 2: SOAP Note From Messy OPD Notes
Raw Case
Female in her 60s with knee pain for 6 months, worse on stairs and
standing from sitting. No trauma. Morning stiffness less than 20 minutes.
X-ray mentioned mild osteoarthritis. Exam details not recorded yet.
Doctor wants a concise SOAP note draft.
Your Task
Create a prompt that converts this into a SOAP note.
Requirements:
- do not add exam findings
- leave placeholders for missing findings
- use “Assessment” carefully, not overconfident final diagnosis if data is incomplete
- include patient education and follow-up placeholders
Good Prompt Pattern
Act as a medical documentation assistant.
Convert the de-identified OPD notes below into a concise SOAP note.
Rules:
- Use only information provided.
- Do not invent examination findings.
- Put missing required details as [TO BE ADDED].
- Use "Assessment: knee pain with features suggestive of osteoarthritis"
rather than an unsupported definitive diagnosis.
- Keep the plan section as a draft for doctor review.
Notes:
[PASTE RAW NOTES]
Exercise 3: WhatsApp Follow-Up Message
Raw Case
Patient missed follow-up after starting BP medicine. Clinic wants a polite
WhatsApp reminder. Do not mention diagnosis publicly in a way that could
breach privacy if someone else reads the phone.
Your Task
Create a message that is short, respectful, and privacy-conscious.
Good output should:
- avoid detailed diagnosis
- avoid blaming the patient
- ask them to book a review
- mention bringing readings/reports if available
- stay under 5 lines
Better Prompt
Act as a clinic receptionist writing a privacy-conscious WhatsApp message.
Write a polite follow-up reminder for a patient who missed a review visit.
Do not mention the specific diagnosis or medicine name. Ask them to book
a convenient appointment and bring recent readings or reports if available.
Tone: warm, respectful, not blaming. Length: 4 lines maximum.
Final Practice Check
Before marking this chapter complete, create and save:
- one patient education prompt
- one documentation prompt
- one WhatsApp prompt
- one revised version of each after critique
- your score before and after revision
If your revised outputs are not scoring at least 10 out of 12, repeat the loop with a simpler prompt.