Skip to content
All posts

We gave ChatGPT and Gemini the same taxes. The refunds didn't match.

November 19, 2026

The short answer: we gave ChatGPT and Gemini the same made-up tax return, more than once. Both read every form correctly. But the refunds they worked out didn't match, from tool to tool and sometimes from one chat to the next in the same tool. That's why at Navo, a tax engine does every calculation and AI never decides your numbers.

What we tested

We made up a simple household. Jordan is a single parent with one 7-year-old, one job and a W-2, a little bank and Treasury interest on a 1099-INT, and after-school care paid to a neighbor. Nothing about Jordan is real, and the forms were sample forms.

Then we asked AI tools to do Jordan's 2026 taxes, in two rounds on the same day in November 2026:

  • Free versions of ChatGPT and Gemini, signed out, with the forms typed into the chat.
  • Paid versions of both, with the forms uploaded as PDFs. ChatGPT was on its most thorough setting and Gemini on its Thinking model.

In each round we asked two ways. Once plainly ("do my taxes"), and once with a detailed set of instructions that told the tool to gather the documents first and ask about anything it didn't know.

We didn't test Claude in this round.

What came back

The free versions. In our first chats, ChatGPT and Gemini landed on the same refund: Gemini said $5,522.64. In a second chat with the same facts, Gemini said $4,672.10, a difference of $850.54. In that chat it treated the Treasury interest as not taxable on a federal return, and it used a standard deduction of $24,925 instead of the $24,150 the IRS set for a head of household in 2026. The free ChatGPT declined to give a second estimate, because the 2026 tax year wasn't over yet.

The paid versions. Here are the refunds each tool worked out for Jordan:

Tool and how we asked Refund it estimated
ChatGPT, asked plainly $5,521 (it added "possible additional $200")
ChatGPT, detailed instructions $5,721.10
Gemini, asked plainly $5,522.64
Gemini, detailed instructions $5,547.84

Same household, same forms, four answers up to about $200 apart. Counting both rounds, the two tools gave five different refunds, from $4,672.10 to $5,721.10.

Why the numbers differed

The inputs weren't the problem. In the paid round, both tools copied every box from the W-2 and the 1099-INT correctly. The differences came from the tax work itself.

The same interest, handled two ways

Treasury interest goes in its own box on the 1099-INT (box 3), separate from regular interest in box 1. It's taxable on your federal return, though states don't tax it. Gemini counted it in one chat and left it out in another. It also wrote that box 3 "is normally included inside" box 1, which isn't how the form works.

A credit one tool found and the other didn't

With detailed instructions, ChatGPT asked the questions the saver's credit depends on, such as recent retirement withdrawals, and added that credit, worth $200 in its estimate. Neither of Gemini's estimates included it. Both can't be right. A credit like this depends on asking the right question, and an AI chat doesn't always ask it.

Different ways to do the arithmetic

ChatGPT used the IRS tax table and whole dollars. Gemini used the bracket formula and cents. For taxable income under $100,000, the IRS instructions say to use the tax table, so the two methods can land a few dollars apart even when everything else agrees.

What the AI tools did well

This isn't a knock on ChatGPT or Gemini. Both were genuinely helpful:

  • They read every box on the uploaded forms correctly.
  • They kept the Social Security number out of their answers.
  • They pointed out that the 2026 form was still a draft and the year wasn't over.
  • With instructions, they asked sensible follow-up questions. ChatGPT asked about the care provider, gifts to charity and retirement withdrawals.

ChatGPT's most thorough setting even filled in a draft Form 1040, and said plainly that it wasn't ready to file.

The trouble is the last step: turning the right facts into the one right number, the same way every time. That's where language models are weakest. They write the most likely answer, and the most likely answer can shift from one chat to the next.

Why a few hundred dollars matters

  • You'd sign it. When you sign a return, you declare it's true and correct.
  • The IRS checks the math. A wrong number can mean a smaller refund, a bill with interest, or a letter months later.
  • You can't tell which chat is right. If two chats give you two refunds, nothing on the screen tells you which one to trust.

How Navo handles it

Navo splits the work the way this test suggests:

  • A tax engine does the math. It follows the IRS's rules line by line, so the same facts always give the same result. It started from the engine the IRS built for Direct File. How Navo started from Direct File.
  • Navo asks the questions behind each credit it covers, in plain language, instead of hoping they come up in a chat.
  • AI helps with the conversation, not the calculation. It can explain a form or a question. It never decides your numbers. Why Navo never lets AI do the math.

You review your return before you sign it, and filing with Navo is free.

The limits of our test

We want to be fair about what this shows and what it doesn't:

  • It was one made-up household with a simple return, and a chat or two per tool.
  • We ran it in November, before the 2026 tax year was over and before the final 2026 forms were out, and the tools said so.
  • The refunds above are the AI tools' own figures. We didn't run Jordan's return through Navo for this post, and we're not claiming which estimate is correct. The point is that the same facts gave different answers.
  • AI tools change quickly, and a test on another day could come out differently.

Using AI for your taxes safely

AI can still save you time. A few habits help:

  • Use it to understand a form, a term or a letter, not to produce the final numbers.
  • Never paste your Social Security number, bank details or IRS PIN into a chat.
  • If you ask an AI for a refund estimate, treat it as a rough guess, and expect a different number if you ask again.
  • File with software that calculates your return from the IRS's rules, and check the return before you sign.

See how Navo works

Frequently asked questions

Which refund was right? We didn't check these figures against Navo's engine for this post, so we're not saying. What we can say is that the tools disagreed with each other, and Gemini disagreed with itself, on the same facts.

Is ChatGPT or Gemini accurate enough to do my taxes? In our test both read the forms well, but neither gave the same number every time. Public benchmarks show the same pattern. Can ChatGPT, Claude or Gemini do your taxes?

Can I use AI and still file with Navo? Yes. Ask an AI to explain anything you like. Navo works out your return with its tax engine, and you sign and file on Navo.

Related guides


Navo is a private company and isn't affiliated with or endorsed by the IRS, OpenAI or Google. The household in this test is made up, and the refund figures are the AI tools' own estimates from 19 November 2026. This post is general information, not tax advice for your situation.

File your taxes free with Navo

We'll email you the day filing opens. We never sell your information.