Medical Q&A Benchmark Grading (Internal Medicine)

What you'll do

• Score AI answers to internal-medicine questions on accuracy, reasoning, and calibration
• Write better reference answers where the model's best attempt falls short
• Tag error types (anchoring, outdated guideline, fabricated statistic)
• Rank multiple model responses head-to-head with written justification

Requirements

Minimum credential: Resident, fellow, or attending

• IM resident (PGY-1+) or attending; strong recent board performance welcome
• Active US license or current residency enrollment
• Clear clinical writing, because your reference answers become training data
• Flexible hours; consistent weekly output expected

From application to first case