Study: Human Experts Beat Gemini 2.5 Pro 7.67 Cm vs 1.3 Cm in Flexibility Gains

Human experts beat Google’s Gemini 2.5 Pro by a wide margin in a head-to-head clinical trial measuring flexibility gains for office workers, Nature reported.

The quasi-randomized controlled trial pitted a 15-minute, thrice-weekly home program designed by human clinicians against a single-shot routine generated by the large language model. After four weeks, the expert group improved their sit-and-reach scores by 7.67 centimeters on average; the AI group gained just 1.3 centimeters. The interaction effect was massive — ηp² = 0.502 — meaning half the variance in flexibility improvement was explained simply by who wrote the prescription.

The protocol called for simple randomization via coin toss. The executed design used a random start followed by alternating allocation — a methodological drift that introduces selection bias risk. Thirty male participants were split evenly. Baseline characteristics matched (p > .05), but the allocation deviation remains a limitation the authors flag explicitly.

Oswestry Disability Index scores diverged significantly (F(1,28) = 7.49, p = .011, ηp² = 0.211). MyotonPRO stiffness readings hardened the picture: dominant biceps femoris (F(1,28) = 11.01, p = .003, ηp² = 0.282) and non-dominant gastrocnemius (F(1,28) = 11.16, p = .002, ηp² = 0.285) both showed robust Time × Group interactions favoring the human protocol after Benjamini–Hochberg FDR correction across eight tests.

Dominant erector spinae stiffness missed the corrected threshold (raw p = .045). No other muscle groups reached significance.

The human protocol blended dynamic and static stretching. Gemini 2.5 Pro delivered a static-only routine in a single prompt — no iterative refinement, no patient-history conditioning, no progressive overload logic. The study registers as NCT07242287 (registered 17 Nov 2025).

"A single prompt cannot replicate the clinical decision tree a therapist builds in real time."

A study found that a single-shot static stretching program generated by Gemini 2.5 Pro yielded less improvement in flexibility and lower-back health than a human expert-designed program with dynamic and static exercises.

Photo of author

Technology Desk

Technology Desk at Archyde.

Bitcoin Dropped Below $60,000 Friday for the First Time