So you're not caught off guard
This is an early alpha. Rather than let you find the rough edges yourself and wonder if something's broken, here's the specific, current list. If you hit something not on it, that's exactly what Tell us it got something wrong is for.
The specific gaps, today
Statements that are scans or photos don't work.
If your bank gives you a PDF you can select text in, Orby can read it. If your statement is a scanned image or a photo, with no text underneath it, Orby can't extract anything from it yet. There's one narrow exception: images of physical checks embedded inside an otherwise normal statement are read separately. A fully scanned statement itself is not.
Only a handful of banks are recognised out of the box, and they're American.
If yours isn't one of them, your first statement won't be recognised automatically. This isn't rare, it's the common case for most testers outside the US. Adding your bank covers what to do about it.
Answers can be slow on less powerful hardware.
On a Mac that comfortably fits the model it picks, most answers come back in under a minute. On an older or lower-memory machine, the same question can take a couple of minutes. That's Orby working through the question, not stuck, but it's worth knowing before you ask something complicated on an old laptop.
The privacy toggle in Settings isn't something to rely on yet.
Orby has a separate feature that tries to detect and mask personal details, like names and account numbers, before sending text to a model. It exists, but it's newer than the rest of the app and we don't yet have confidence in how accurately it catches everything. The mechanism that actually protects your data during the alpha is which model you've told Orby to trust, covered in full on What happens to your data, not this toggle. Turning it on also requires Docker installed on your Mac, which most people testing right now won't have.
Login details for cloud models are stored in a plain settings file, not your Mac's Keychain.
If you add a cloud provider's API key, it's protected by your normal Mac file permissions, the same as any app's settings file, but not by the system Keychain yet. Worth knowing if you're security-conscious about where keys live, which, given what this product is for, you probably are.
What already holds up
The core loop, reading a real statement, asking a real question, getting a correct answer with the arithmetic actually right, works, and has been checked against the source statement by hand. Bank-statement parsing on the formats Orby does know is fast and accurate. Worth saying plainly, since the rest of this page is a list of gaps.