Bilal Irfan
Work

AskMyDoc

Ask questions about a company's 10-K and get answers you can check.

2025–2026 · Live app · Source on GitHub

Overview

Upload a 10-K and ask questions in plain English. Answers come only from the filing, every calculation runs through a calculator, and if a number can't be backed by the filing, the app says it isn't in the document instead of guessing.

How a question gets answered

Question

How much did Amazon's net sales grow in 2017?

  1. Search

    The 15 closest chunks, plus the income statement, balance sheet and cash flow statement.

  2. Answer model

    Finds net sales of 177,866 for 2017 and 135,987 for 2016, in millions.

  3. Calculator

    (177,866 − 135,987) ÷ 135,987 × 100 = 30.8

  4. Number check

    Every number must be in the filing or come from a checked calculation.

    • 177,866 in filing
    • 135,987 in filing
    • 30.8 calculated

Answer

Net sales grew 30.8%, from $135,987 million to $177,866 million.

If any number can't be backed, the answer becomes "I couldn't find enough information in the document to answer that question."

An example with real figures from Amazon's 2017 10-K.

Results

Held-out test
21 / 26 correct, 8 / 8 traps refused
Working set
5 → 29 / 41 correct
Cost
~$0.12 per full benchmark run

Highlights

Built with

PythonFastAPILangChainGroq gpt-ossVoyage AISupabase pgvectorNext.js