Can Computers Do Math for Doctors?

Computers and Doctors

Computers are helping doctors more and more. They help with notes, looking at X-rays, and even talking to patients. Now, they are trying to help with big math problems in health studies.

A new study looked at a computer program called GPT-5.1. Doctors wanted to know if this program could do the same math that special computer tools do. The short answer is: sometimes. The long answer is: be careful!

Same Numbers, Different Brains

Researchers gave GPT-5.1 numbers from two old health studies. They asked the computer to do important math, like finding averages and how sure we can be about results. Then, they compared the computer's answers to the answers from trusted computer tools.

This was not about what the numbers meant. It was just about the math itself.

Almost Right, But Not Always

At first, it looked like the computer did well. It got the general idea right every time. This is good for quick checks.

But when they looked closer, they found problems:

• 3 times (43%), the answers were a little bit off.
• 1 time (14%), the answer was a medium amount off.
• 3 times (43%), the answers were very different.

Almost half the time, the differences were big. They were not just small mistakes.

Where the Computer Had Trouble

The biggest problem was when the studies had many differences. For example, different surgeries, different doctors, or different patients.

The computer did best when all the studies were very much alike. But in health, studies are often very different. This is because people are different, and treatments can be different.

The computer often said the studies were more alike than they really were. This is a big problem for doctors.

A Helper, Not the Boss

So, what does this mean for computers helping doctors with studies? Right now, the computer is like a helper, not the main person doing the work. It can help see general ideas and check things quickly.

But it has trouble with hard math and when studies are very different. It can help, but it cannot think for itself or make big decisions.

Where Computers Fit In

Computer programs are getting better at doing math for health studies. But being "close" is not the same as being "right."

For now, if doctors are doing a study that will help decide how to treat patients, they should use their trusted tools. They can use the computer program to check their work, but it should not be the final answer.