Box Fresh All articles
AI & Productivity

I Fed Four AI Apps a 22-Page Lease. One Found the Clause That Cost $600.

Box Fresh
I Fed Four AI Apps a 22-Page Lease. One Found the Clause That Cost $600.

Photo by Photo by Vitaly Gariev on Unsplash on Unsplash

My lease renewal showed up on a Tuesday with a rent bump and a 22-page PDF attached. I did what most people do: scrolled to the signature page, skimmed the bold text, and told myself I would read the rest later. Later never came. So I did the next best thing — I handed the whole document to four AI apps and asked them the six questions I actually cared about.

I am describing the apps by role rather than brand, because this category changes every few weeks. What matters here is the pattern of what worked and what quietly failed.

The six questions I asked

  1. How much notice do I have to give if I do not renew?
  2. What is the late fee, exactly, and when does the clock start?
  3. Is there an early-termination option, and what does it cost?
  4. What does the pet addendum require beyond the deposit?
  5. Who is responsible for changing the HVAC filter?
  6. Is there anything in here that renews automatically without me signing anything?

Question six is the one that mattered. More on that in a minute.

How the test ran

Same PDF, same six questions, no hints, and no follow-up prompts on the first pass. I scored each app on four things: whether the answer was correct, whether it cited a page, whether it admitted when something was not in the document, and how long it took. I checked every answer against a paper copy with a highlighter, which felt appropriately old-school for a contract.

The four contenders

The big-name assistant. Fast and conversational. It answered all six in about 40 seconds and got four right. The two it missed were both cases where the lease was silent — it filled the gap with what is 'typical' in my state instead of telling me the document did not say. Useful if you want context. Dangerous if you want the contract.

The PDF specialist. Slower, uglier, and the only one that put a page number and a quoted sentence next to every answer. It also flagged the scanned addendum on page 19 as image-only and low confidence instead of guessing. That single act of humility is why it won.

The free tier. Handled the first eight pages, then told me I had hit my monthly document limit. The eight pages it read were accurate. A 22-page lease is not an eight-page problem.

The one bundled with my phone. Surprisingly good at summarizing, hopeless at specifics. I got a lovely three-paragraph overview of the general shape of the agreement and zero citations. Fine for a first pass. Useless in a dispute.

The clause that would have cost me $600

Page 14, subsection (c): the lease auto-renews for twelve months unless written notice is given 60 days before the end date. My previous lease had a 30-day window, so I had assumed 30 days was standard. Under the new terms, my plan to deal with it in April would have locked me in for another year at the higher rate, and the early-termination fee was $600 plus two months of rent.

The PDF specialist surfaced this on question six, with the quote and the page. The big-name assistant mentioned automatic renewal somewhere in its summary but never connected it to a deadline. That is the difference between a summary and an answer.

Where all four stumbled

Every app struggled with page 19, a scanned addendum with a crooked margin and a staple shadow. Two invented plausible text. One skipped it silently. Only one told me it could not read it, which meant I knew to read it myself. It turned out to be a parking assignment. Not dramatic, but I would have signed without knowing I did not have one.

None of them did arithmetic reliably. Prorated rent for a mid-month move-out came back three different ways from three apps. Do the math yourself.

What I would tell anyone doing this

Verdict

The PDF specialist is not fun. It has no chat bubbles, no personality, and it made me wait. It also found a $600 clause in under a minute and refused to guess when it did not know something. The big-name assistant is the one I would use to understand a document. The specialist is the one I would use before signing one. For a lease, that is not close.

I sent my 60-day notice on time. The renewal rolled to month-to-month, and I am still in the apartment, $600 richer than I would have been.

All Articles

Related Articles

The Training Doc Nobody Reads: Four AI Screen Recorders, One 40-Minute Demo, and the Wiki Page That Finally Got Updated

The Training Doc Nobody Reads: Four AI Screen Recorders, One 40-Minute Demo, and the Wiki Page That Finally Got Updated

312 Logins, Four Password Managers, and the One My Family Stopped Complaining About

312 Logins, Four Password Managers, and the One My Family Stopped Complaining About

The Self-Review Nobody Wants to Write: Four AI Apps, One Manager Who Notices, and the Paragraph That Saved My Raise

The Self-Review Nobody Wants to Write: Four AI Apps, One Manager Who Notices, and the Paragraph That Saved My Raise