AskMyDoc
Ask questions about a company's 10-K and get answers you can check.
2025–2026 · Live app · Source on GitHub
Overview
Upload a 10-K and ask questions in plain English. Answers come only from the filing, every calculation runs through a calculator, and if a number can't be backed by the filing, the app says it isn't in the document instead of guessing.
How a question gets answered
Question
How much did Amazon's net sales grow in 2017?
Search
The 15 closest chunks, plus the income statement, balance sheet and cash flow statement.
Answer model
Finds net sales of 177,866 for 2017 and 135,987 for 2016, in millions.
Calculator
(177,866 − 135,987) ÷ 135,987 × 100 = 30.8
Number check
Every number must be in the filing or come from a checked calculation.
- 177,866 in filing
- 135,987 in filing
- 30.8 calculated
Answer
Net sales grew 30.8%, from $135,987 million to $177,866 million.
If any number can't be backed, the answer becomes "I couldn't find enough information in the document to answer that question."
Results
- Held-out test
- 21 / 26 correct, 8 / 8 traps refused
- Working set
- 5 → 29 / 41 correct
- Cost
- ~$0.12 per full benchmark run
Highlights
- Built an 85-question benchmark with a hand-checked answer key, and kept 34 questions on unseen filings for one final run.
- Checking numbers instead of words, a calculator tool and always including the three financial statements took accuracy from 5 to 29 of 41.
- A 20B to 120B model upgrade changed nothing. The errors were arithmetic, so a calculator fixed them more cheaply.
- Shipped through 50 merged PRs with CI and about 290 backend tests, under a $5 monthly AI budget.