The Three Operational States: Beyond Theoretical Capability
The decision to incorporate artificial intelligence into a workflow should not be based on the theoretical capability of the model, but on real operational viability. There are three possible states for any process: full automation, where the system executes the task without human intervention; human assistance, where the AI prepares information or drafts but a person makes the final decision; and the manual process, which remains as is or is optimized with simple deterministic tools.
The choice between these states depends on specific execution conditions. A process may be technically automatable, but if the model's response latency exceeds the business's maximum allowable time, or if the error rate requires human review that cancels out the time savings, full automation is not viable. In these cases, human assistance or improving the manual process are often more efficient options.
Comparison of Operational States
Summary of key characteristics for each option.
| State | Human Intervention | Main Risk | When Viable |
|---|---|---|---|
| Full Automation | None or minimal (supervision) | Undetected errors, excessive latency | High volume, low variability, low tolerable error |
| Human Assistance | High (review and decision) | Bottleneck in review | High variability, high error impact, incomplete data |
| Manual Process | Total | Labor cost, transcription errors | Low volume, high complexity, lack of structured data |
Viability Criteria: Latency, Error, Cost, and Data
To determine if a workflow is a candidate for automation, four fundamental operational criteria must be evaluated. The first is the maximum allowable latency: the time the business can wait between data input and result output. If the AI model requires seconds or minutes to process and the process demands responses in milliseconds, automation is not viable without a pre-calculation or cache architecture.
Assess the error rate alongside total checking and correction time. Additional intervention in 5% of cases does not by itself determine whether there are savings: measure how many minutes it consumes and what work remains in the other cases. A third criterion is reliable, permitted and accessible data and context. Using a pretrained model does not necessarily require training it again; task-specific tuning, when appropriate, adds its own requirements and preparation costs.
Calculating the Break-Even Point: When AI Stops Being Cost-Effective
The break-even point is reached when the Total Cost of Ownership (TCO) of the AI option equals the TCO of the manual or assistance option. AI TCO includes: license or API consumption costs, development and integration, maintenance, human supervision, and error correction. Manual TCO includes: person-hours dedicated, error costs (rework, fines, customer loss), and the opportunity cost of talent trapped in routine tasks.
Compare the annual cost of manual work with the full cost of each alternative over the same horizon. Include implementation, operation and exceptions, distinguishing valued working time from an actual reduction in spending. A small difference may not compensate for uncertainty or extra maintenance; improvements in quality or service may provide value beyond labour savings, but need an explicit objective. The decision should reflect these assumptions rather than a universal profitability threshold.
Decision Protocol: Applying the Matrix to a Specific Workflow
To apply the viability matrix, follow a five-step protocol. First, define the unit of work: an input, a transformation, and an observable output. Second, measure the current state: volume, cycle time, manual minutes, errors, and exceptions. Third, score the opportunity and risk using criteria such as frequency, manual load, standardization, data availability, and reversibility.
Fourth, choose the simplest mechanism: if rules are deterministic, use a simple integration; if there is free text, use an AI workflow; if you must choose between tools, use a limited agent. Fifth, design the safe failure: define what happens when the system is not sure (stop, request information, escalate to human). This protocol avoids the error of automating a poorly designed process or using AI where a simple rule would solve the problem.
Decision Protocol Steps
Recommended sequence to evaluate a workflow.
- 01Define the unit of work (input, transformation, output).
- 02Measure the baseline: volume, time, errors, exceptions.
- 03Score opportunity (frequency, data, standardization) and risk (error impact, complexity).
- 04Select the simplest mechanism (rule, AI workflow, agent, assistance).
- 05Design failure behavior and human review thresholds.
Common Errors and When to Keep the Manual Process
The most frequent error is assuming that AI is always more efficient than the manual process. This happens when the cost of supervision, data preparation, and error correction is ignored. Another error is automating a process that is not well defined: if the manual process has useless steps or undocumented exceptions, automation will only make the problem travel faster.
Keeping the manual process is the correct option when volume is low, variability is high, and the cost of automation exceeds the savings. It is also viable when data is not available or is of low quality, or when the impact of an error is so high that human review is unavoidable. In these cases, investment should be directed to improving data quality or simplifying the process, not to incorporating AI.
A pilot that can support accepting or rejecting automation
The matrix helps decide what to examine first; it does not certify the outcome. Before the pilot, specify which inputs are accepted, what output is expected and who handles an exception. A demonstration using prepared examples can explain the sequence, but does not by itself represent ordinary work. Use a sample that includes normal cases and known difficulties, retain the observation period and separate measured data from assumptions. An unknown value remains unknown instead of becoming zero simply to complete a score or make one option look more attractive than another.
Compare alternatives using the same unit of work and the same quality standard. If the manual option includes checking and recording the result, the assisted option must include those activities too. Do not compare a generated answer with a completed case: the work of checking, correcting and saving that answer would be missing. Also distinguish elapsed time from active work. A long wait can affect service even if it requires few minutes of a person's attention. Both measures matter, but answer different operational questions and should not be added as though they were equivalent.
Measure exceptions separately. A correct output requiring no intervention, an output corrected before acceptance and an output that had to be redone manually are different outcomes. Record how many cases follow each path and how much time they take. If you record only model execution time, review will appear free. If you record only accepted cases, the cost of rejected ones disappears. Evaluation must also include incomplete inputs, waiting time and interruptions that required the work to start again, rather than excluding these difficulties from the comparison with the existing manual process.
Define stopping conditions before observing the pilot's results. If the agreed quality standard is not met, a necessary authorisation is missing or review exceeds available capacity, stop that execution mode. Preparing a draft for a person or applying rules to the stable part of the process may still be useful. A documented manual alternative makes that transition easier. The decision need not mean either complete automation or no improvement: it can delimit a useful step while keeping difficult decisions within another controlled path with a clear owner and an explicit way to resume work.
Repeat the comparison when a relevant condition changes: volume, data, requirements, provider or review cost. A pilot describes a period and a configuration, rather than permanent savings. Retain the earlier calculation so that the team can explain why a decision was reasonable and what has changed since. Assign an owner for maintenance as well: someone who receives failures, updates rules and checks that metrics still describe actual work. This responsibility belongs in operating cost even when it is absent from the advertised price of a model request or the initial demonstration of the workflow.
Reading the calculation without mixing time and money
The cost example is hypothetical and uses a single currency and the same monthly period. Hours are converted to money using an assumed labour rate; licences are already expressed as a monetary amount. This separation avoids adding hours to dollars or counting a review twice when it is already included in time per case. If assumptions change, repeat the operations with the process's own data. None of these amounts represents an actual provider tariff or a promise of savings for another organisation, and their usefulness depends on keeping every assumption visible alongside the result.
The example's break-even period uses the monthly difference after recurring expenditure to recover initial implementation cost. It is not a guaranteed return: it assumes volume, quality and effort remain unchanged over that period and excludes any unspecified expense. Released working time may also be reassigned without reducing payroll. Present recovered capacity, additional spending and demonstrated cash savings separately. A service improvement can justify a decision, but needs its own objective and evidence; it should not be hidden inside an estimate of labour savings or treated as money already available to fund the next implementation.
Monthly calculation for the hypothetical example
| Item | Calculation | Result |
|---|---|---|
| Manual work | 400 × 15 ÷ 60 | 100 hours |
| Assisted work, including review | 400 × 8 ÷ 60 | 53.33 hours |
| Manual cost | 100 × 30 USD | 3,000 USD |
| Assisted cost with recurring expenditure | 53.33… × 30 USD + 200 USD | 1,800 USD |
| Monthly difference | 3,000 − 1,800 | 1,200 USD |
| Recovering implementation cost | 6,000 ÷ 1,200 | 5 months, under the stated assumptions |
Open questions
- There are no universal thresholds for maximum allowable latency or tolerable error rate; these values depend on the specific business context.
- Required data and context depend on the task and chosen approach; using a pretrained model does not necessarily require a proprietary training dataset.
- AI license, API consumption, and maintenance costs fluctuate and cannot be generalized without an updated market analysis.
Keep exploring
Sources consulted
Corrections and transparency
If you spot incorrect or outdated information, send us a correction with the page and source we should review.
Submit a correction