All posts

Research / VC diligence

What Customer Usage Tells an Investor About AI Product Retention

Assess AI product retention through repeat workflow use, mature customer cohorts, paid seats, revenue expansion, and the manual services behind accepted results.

By Waypoint ExponentialPublished Revised
Interlocking teal cuboid modules form a squared loop with cream and brass cubes in its sockets, while a separate terracotta cube represents trial activity outside repeated workflow use

For an AI product, customer retention starts with a business task someone chooses to repeat. Ask which accounts return, what work they finish, and whether they keep paying after the initial trial. Read that evidence alongside the human effort required to deliver an accepted result, with cohorts that have had enough time to demonstrate repeat use.

Define the customer task and its return event

Begin with the work the customer buys the product to do. For an invoice assistant, a meaningful event may be an operator accepting a checked invoice into the finance workflow. For a research tool, it may be an analyst using a sourced answer in an approved brief. Define the evidence of completion before interpreting an activity chart.

Keep the steps leading to that result visible. A signup, a connected data source, and a first accepted task answer different questions. A customer who opens the application and leaves has demonstrated interest. A customer who repeatedly finishes the agreed work gives you evidence about operational adoption. Record the path so you can locate where accounts stop progressing.

Choose a return interval that fits the task. Daily retention may suit a support operation, while a month-end reconciliation tool needs a monthly view. A quarterly reporting product needs a longer observation period. Low daily use doesn't establish weak adoption when the customer only has the relevant job at a scheduled close.

Amplitude's retention documentation builds the analysis around a starting event and a return event, and supports different usage intervals. Apply that structure to the customer's actual workflow. Define the start, the qualifying return, and the interval in the evidence pack so someone else can reproduce the chart.

Distinguish frequency from the amount of work available. A customer may process fewer invoices because their business volume fell, while still sending the same share through the product. Request the eligible task count where the customer can supply it. Report coverage of that work separately from the raw number of completed tasks.

For unattended agents, user logins can fall while accepted output continues. Inspect scheduled runs, downstream acceptance, and exceptions instead of treating low screen time as churn. If the team cannot observe whether the receiving workflow accepted the output, label that measurement gap. A model response alone doesn't establish a finished customer job.

Count customers and completed work consistently

Use a stable account identifier that connects product events to the commercial customer. Keep user identifiers for analysing participation within the account. A company with several teams and billing entities may need an explicit hierarchy. Document that mapping; otherwise, a new workspace or renamed account can appear as a new customer or a disappearance.

Separate customer activity from vendor staff, demonstrations, and test traffic. Label automated activity by its purpose rather than excluding every automated event: a customer's production agent may perform the work they pay for. Record who initiated the action, which environment it used, and whether it belonged to a real customer case.

Give each business task an identifier and count its completion once under a stated rule. Retries, regenerated drafts, and repeated tool calls can increase technical activity without increasing delivered work. Track those attempts separately because they affect cost and reliability. The retention chart needs the accepted task, while the engineering review needs its full execution history.

Check the event meaning against selected records. An event called completion may only mean that the model returned text. Inspect the application action that emits it and compare it with the receiving system's state. Record late rejection or reversal separately so the team can distinguish initial acceptance from a result that stayed accepted.

Preserve changes to instrumentation. If a release changes the definition of an accepted task, mark that date and explain how the cohorts compare across it. Don't join incompatible event definitions into a continuous improvement claim. A cleaner measurement system can change the chart even when customer behaviour stays the same.

Use a small, traceable audit sample before requesting a broad export. Ask the team to follow selected task identifiers through the event log and downstream acceptance record. Investigate mismatches and missing coverage. Once you trust the definition, the aggregate analysis has a clearer basis than a dashboard whose events nobody has inspected.

Compare cohorts with enough observation time

State how accounts enter a cohort. You can group by first trial, first paid period, or first accepted production task, but each view answers a different question. Keep all eligible entrants in the denominator, including those who never activate. Show activation-to-repeat use separately if you want to understand behaviour after the first completed task.

Separate trial accounts from paying customers. Also show acquisition channel and onboarding method when the sample supports those splits. A Reddit question about an AI SaaS trial describes different responses from organic and paid-ad signups. That is a founder's reported experience, not a market benchmark; it raises a question about who enters each cohort.

Compare accounts at the same age and with the same required observation window. A customer that started last week cannot yet demonstrate a month-three return. Keep those immature accounts visible as pending observation rather than counting them as retained or lost. Show the number of accounts behind every percentage, particularly in small enterprise cohorts.

Amplitude's retention FAQ explains that interval denominators depend on whether users have had enough time to reach the interval. It also distinguishes returning during an interval from returning on that interval or later. Name the method you use. A later return can answer a different question from consistent monthly workflow use.

Choose a fixed comparison window for the investor review and retain the underlying period detail. For example, show whether each mature account completed an accepted task in months two and three, with the task's expected cadence beside it. Don't combine a cumulative ever-returned measure with a claim about repeated monthly use.

Separate product inactivity from renewal outcomes. An annual contract can keep generating subscription revenue before the customer reaches their renewal decision. Show contracts that have reached renewal, their outcomes, and those still awaiting that date. Low use is evidence to investigate; it doesn't establish the future renewal result by itself.

Reconcile usage with paid seats and revenue

Ask for the account-level link between accepted work, contracted access, and billing. Compare purchased seats with users who perform the qualifying task, and identify accounts where an integration does the work without frequent individual logins. Seat utilisation needs the product's operating context. A low login rate can mean unused access or a successful automated workflow.

Show free access, credits, discounts, and paid pilots explicitly. A customer can use a product heavily during an allowance and decline to pay when it ends. Follow that account through the transition where the observation window permits it. Separate billed recurring revenue from cash collection and flag overdue amounts rather than treating them as identical evidence.

Trace expansion to its cause. More seats, a price increase, and higher task volume have different implications for customer adoption. Ask which team bought more access, what additional work they use it for, and whether that usage persists. An amended contract establishes a commercial change; the product record helps explain its operational basis.

ChartMogul's September 2026 net MRR retention documentation measures recurring revenue from existing subscribers, including expansion and reactivation and subtracting contraction and churn. It excludes new business and non-recurring payments. When reviewing a company's NRR, request its exact definition, period, and treatment of reactivations rather than assuming every report uses identical settings.

For a fixed cohort, reconcile starting recurring revenue to ending recurring revenue with an account-level bridge. Keep new customers outside that cohort's retention numerator. Show gross retention without expansion beside net retention, and inspect the distribution: a large expansion can offset losses elsewhere. Neither percentage explains which workflow accounts depend on or the delivery effort it requires.

If the company charges by completed task, show quantity and realised unit price separately. Seasonal customer demand can move usage revenue without a change in product preference. Contract minimums can support revenue during low activity. Explain those terms and avoid forcing every business into a seat-based SaaS metric that hides how customers actually buy.

Measure the services behind repeat use

Follow accepted tasks back to the work that made them possible. Record vendor onboarding, routine review, and exception handling by account and period. A founder who repairs outputs before delivery may support satisfied customers while leaving an unresolved delivery-capacity question. Count that work alongside the product activity rather than attributing the result entirely to software.

Separate initial implementation from recurring assistance. A forward deployed engineer can connect systems and establish a repeatable workflow, while another account may need ongoing custom repairs. Inspect the reason for the hours and whether the customer can operate within the agreed support arrangement. Our guide to AI inference costs and gross margin covers the wider cost review.

Include customer labour where you can measure it with permission. A product may save drafting time while requiring substantial checking or correction. Ask how long the customer spends to obtain an accepted result, compared with their previous method on comparable work. Keep observed records separate from estimates and avoid extrapolating a small sample across every account.

Track quality alongside volume. Record rejection, correction, and escalation rates under stable definitions. An account may return frequently because the task matters, while absorbing errors that threaten continued use. Another may deliberately send only a narrow subset through the product. State the accepted scope and examine whether usage growth changes the mix of difficult cases.

Compare mature accounts with similar tasks and implementation conditions. Falling assistance hours with stable acceptance can support a claim that delivery has become easier. Check whether the team changed the task scope, shifted work to the customer, or stopped handling difficult cases. The hours alone cannot establish why the delivery burden changed.

Request evidence for the planned operating model without disrupting customers. Inspect existing handover records or agree a bounded test of customer operation within the contract. Don't withdraw necessary support to manufacture a retention experiment. The diligence question concerns what the current service requires and what evidence supports the company's proposed scaling plan.

Read an illustrative retention evidence pack

Consider an invented invoice assistant with monthly finance workflows. The figures below illustrate a method, not a benchmark or a client result. A January cohort contains 24 trial accounts, and all have reached the end of their third month. The definition of activation is a first accepted invoice processed from a customer's production records.

Of those 24 accounts, 15 activate. Nine finish at least an accepted invoice in both month two and month three. That gives 9 of 24, or 37.5%, for repeated use among trial entrants, and 9 of 15, or 60%, among activated accounts. Keep both denominators visible; the second figure excludes the nine accounts that never activate.

Read each illustrative measure with its denominator and unresolved question.
Measure.Observed record.Next check.
Trial activation.15 of 24 accounts finish a first accepted production task.Why do nine accounts stop before acceptance?
Repeated workflow use.Nine accounts finish accepted work in both later months.How much of their eligible work does the product handle?
Payment after trial.Seven of those nine accounts pay after the allowance ends.What explains the two accounts that don't pay?
Vendor assistance.Three of the seven paying accounts need recurring repairs.Which repairs are repeatable, and what do they cost?

The example's repeat-use threshold is deliberately modest. Processing an invoice in each later month doesn't establish that the customer has made the product their standard process. Inspect task coverage and volume next. Keep any accounts with incomplete or missing source records visible instead of allowing the audit to select only accounts with clean data.

Now inspect a separate, mature paid cohort over a completed quarter. It starts with A$20,000 in monthly recurring revenue. Existing accounts add A$4,000, contract reductions remove A$1,000, and churn removes A$2,000; there are no reactivations. Ending MRR from that cohort is A$21,000, giving 105% net retention. Excluding expansion gives 85% gross retention.

New customers add another A$8,000 in MRR during the quarter, but that amount stays outside this retention calculation. These figures show how expansion can outweigh losses without explaining the losses or the product's delivery economics. Review the affected account records and assistance costs. Don't infer a future return or a universal retention target from this constructed example.

Check the explanation with customer evidence

Select customer references across the observed outcomes, with the company's and customers' permission. Include growing accounts and accounts that reduced use or stopped paying where access permits it. Record who declines an interview and which outcomes the sample covers. A reference list made entirely of enthusiastic users cannot explain the full cohort.

Ask customers to describe the last task they completed, the result they accepted, and the work they still did themselves. Follow the task through the surrounding process. Ask what they use when the product is unavailable and what caused their last renewal or expansion decision. Concrete recent work gives you more to check than a general satisfaction statement.

Interview the buyer and the operator when their roles differ. The buyer can explain budget ownership and contract plans; the operator can describe recurring exceptions and checking effort. Record disagreements as questions to resolve. Neither conversation independently establishes the entire account's adoption or future purchase decision.

Compare the account's explanation with records from the same period. A customer may report frequent use while the event log only captures a small portion of their activity. Investigate an offline path or an instrumentation gap before dismissing the account. Conversely, high technical event volume needs reconciliation when the operator reports little accepted work.

Keep the evidence request proportionate. Use pseudonymous account and task identifiers, aggregate counts, and controlled samples when they answer the question. Agree authorised access and retention with the relevant owners. An investor generally doesn't need raw customer documents to check the relationship between task completion and billing.

Document the limits of the explanation. Repeat use may correlate with renewal without causing it; procurement commitments, implementation costs, or a lack of alternatives can affect the decision. If the team claims that a product change improved retention, ask how the comparison accounts for cohort mix and observation time. Treat an untested explanation as a hypothesis.

Set the next diligence question

Turn the review into a short list of unresolved claims with named evidence requests. If activation is weak, inspect the first-task path and which accounts enter it. If accepted use continues but payment stops, examine the buying decision and the trial terms. If revenue grows while repair hours rise, inspect delivery capacity and account economics.

Match the request to the company's stage. A young company may have credible observed work and candid customer accounts while lacking mature renewal cohorts. State that limit and the date when the next cohort reaches a meaningful decision. Don't replace missing history with an unsupported forecast or compare a handful of enterprise accounts with a broad consumer-app chart.

For a PE operating team or a corporate buyer, use the same task evidence to inspect adoption, but adapt the commercial measures. Internal staff don't renew subscriptions to their own employer. Measure accepted work, eligible task coverage, and the operating effort against the organisation's purpose. Keep staff activity separate from realised business savings.

Choose a bounded follow-up that closes the largest remaining gap. That may be an account-level billing reconciliation, a review of recurring repair work, or observation of the next month-end cycle. Record the question, data owner, and completion date. Our AI technical diligence questions connect that evidence to the wider review.

Put the work into practice

AI implementation and delivery

We help SMEs and scale-ups put AI into a specific business workflow. We define the problem, prepare the data, build the software, and help your team operate it in production.