What the Numbers Mean
At 17 seconds per document, local inference is fast enough for batch processing. A finance team receiving 20-30 PDF attachments per month could process the entire batch in under 10 minutes. The bottleneck shifts from data entry to human review — which is where it should be.
For comparison, a junior analyst typing figures from a 10-page financial statement takes 15-20 minutes. The local LLM does it in 16 seconds with 90%+ accuracy. The human reviewer then spends 2 minutes catching the remaining 10% of errors. Total time drops from 20 minutes to 18 seconds plus 2 minutes of review.
The cost side is straightforward. Cloud API pricing for GPT-4o is roughly $2.50 per million input tokens and $10 per million output tokens. A 10-page financial document is approximately 15,000-20,000 tokens. Processing 30 documents per month at $5-8 per document via API costs $150-240 monthly. An RTX 5090 at SGD 4,000-5,000 is a one-time investment that pays for itself within the first month of equivalent cloud usage.
For Singapore businesses dealing with sensitive financial data, the local approach eliminates the compliance question entirely. Documents never leave the premise — the web interface is cloud-hosted for accessibility, but inference happens on local hardware.