← Back to Intel

How to Know Your Data Is Build Ready

Mar 29, 2026Omar Trejo8 min read

You have data, a workflow worth automating, and no way to tell whether the first is good enough for the second. The two answers on offer are both expensive. Wait for a broad "AI-ready data foundation" and the workflow stays manual for another year. Start on scattered inputs that were never stable enough for production and the build turns into data archaeology somewhere around the integration milestone, with the budget already spent.

Build-ready data sits between those extremes: accessible enough, representative enough, and stable enough that one specific workflow can move into delivery. It is a property of the workflow, not of the enterprise — a comprehensive survey on data readiness (Hiniduma et al., 2024) makes the same point from the research side, where readiness depends on the task, the model class, and the operating environment rather than on a maturity label.

And the property that decides it is not volume, cleanliness, or schema hygiene. On the property valuation engine ML LABS built for a PropTech platform, the data was abundant and the model was the easy half: the error sources that decided whether the system could be trusted were staged listing photos in postcodes where comparables ran thin, renovations the comparables panel had not caught up with, and satellite imagery going stale over active construction. Each had to be caught by a measurable production signal and priced into the model's confidence bounds. Producing the estimate was straightforward. Knowing when not to trust it was the build.

graph TD
    A["Access Test<br/>Data reachable programmatically"] --> D{"All three pass?"}
    B["Signal Test<br/>Fields carry usable signal"] --> D
    C["Stability Test<br/>Schema and quality are stable"] --> D
    D -->|"Yes"| E["Build-Ready"]
    D -->|"No"| F["Fix the data path first"]

    style A fill:#1a1a2e,stroke:#ffd700,color:#fff
    style B fill:#1a1a2e,stroke:#ffd700,color:#fff
    style C fill:#1a1a2e,stroke:#ffd700,color:#fff
    style D fill:#1a1a2e,stroke:#0f3460,color:#fff
    style E fill:#1a1a2e,stroke:#16c79a,color:#fff
    style F fill:#1a1a2e,stroke:#e94560,color:#fff

The Three Build-Readiness Tests

Data is build-ready when it passes three tests, in this order, against the fields one workflow actually reads.

  1. Access test: the data can be pulled programmatically, on demand, without manual exports or one-off requests that break on the second run.
  2. Signal test: the data carries enough signal for the workflow under realistic conditions — production-representative volumes with real noise, not a curated sample.
  3. Stability test: the source, schema, and quality profile are stable enough that the team is not firefighting upstream changes that invalidate finished work.

The access test is the cheapest and the one that fails most quietly. If the workflow depends on manual exports, inbox attachments, or a spreadsheet somebody assembles on Fridays, there is no build path — there is a person, and the system will inherit their availability. Established ML engineering guidance (Google, 2024) puts simple, reproducible pipelines ahead of heroic one-off preparation for exactly this reason: what cannot be re-run cannot be operated.

Signal Beats Cleanliness

Reachable data can still be unusable. If key fields are mostly null, if labels arrive too late to act on, or if identifiers do not match across systems, the build path looks viable right up to the point where the model starts failing in ways that trace back to the inputs. Research on data quality and ML performance (Mohammed et al., 2022) and quality dimensions for ML pipelines (IEEE, 2024) converge on the same finding: which flaws are present matters more than how many. Build-ready data is not clean in the abstract. It is clean enough in the fields the decision depends on.

That standard is measurable before a model exists, and one number from a real system makes it concrete. On the clinical operations automation ML LABS delivers for HeartSciences, the threshold that stops the work is extraction producing more than 15–20% of records with missing critical fields, or the same event coded differently across sites — past that line, the automation produces more exceptions than it processes, and the billing automation case study says so in those terms. Two other signals belong in the same measurement: labels that land days after the event they describe can support batch scoring but break any workflow needing near-real-time feedback, and identifier mismatches show up as join rates below what the data dictionary implies, cascading into every downstream feature that inherits the gap.

The valuation engine is the counter-example that matters, because its data was messy and it was still build-ready. Comparable scarcity, staged photos, stale satellite passes — each failure mode had a measurable signal, and the spread between channel-specific estimates widened before the ensemble estimate became unreliable, which is what the confidence bound was calibrated against. The system shipped valuations within 10% of closing price in dense metro areas for 90% of cases, and routed the rest to a human appraiser rather than guessing. Messy data with known failure modes and a measurable signal per mode beats clean data nobody has interrogated.

"We needed a valuation engine that could price properties within 10% of closing price in dense markets, in seconds instead of days. Omar built it. That system became the reason investors took us seriously." — Founder / CEO, PropTech company

Stability Is An Upstream Property

A build also fails when the source moves underneath it. Schema changes, freshness gaps, and shifting identifiers create delivery drag even when the historical dataset looked acceptable on day one. A study of production ML deployments at a major cloud provider (MLSys, 2022) found data drift causing accuracy drops of up to forty percent in deployed models, even with routine retraining. The implication for readiness is direct: a dataset that passes today's quality bar is not stable unless the process generating it is stable, and the test of that is whether the team can name a small set of checks that should stay true over time — completeness on critical fields, freshness for scheduled loads, consistency for shared identifiers, validity for values in known ranges. If those checks cannot be named, the build is early.

Three misreadings of readiness are worth naming, because each one is an artifact of looking at the wrong object. A single good historical extract proves nothing about the live stream: a snapshot hides the label that arrives hours late, the taxonomy that was renamed, the identifier that was migrated. A modern data stack proves nothing about the fields in scope — the warehouse can be sophisticated while the four columns the workflow reads remain half-populated. And an enterprise-wide cleanup as a precondition is the most expensive misreading of all, because it converts a bounded workflow question into an unbounded program; research on AI adoption (MIT Sloan, 2018) finds organizations waiting on perfect readiness delaying value for no return.

Build-ready data is not perfect data. It is data the team can reach on demand, trust selectively, and monitor continuously.

When The Source Is The Project

Some workflows are blocked upstream in a way no downstream engineering fixes. If the source process lives in paper, in a vendor tool with no dependable access path, or in a system whose owner will not grant programmatic access, then the data path is the project — and saying so early is worth more than a model that compensates for broken inputs and hides the breakage in its outputs.

There is a quieter version of the same blocker, and it is the expensive one. Data can be reachable, plentiful, and structurally wrong at the same time — aggregated in a way that discards the detail a model needs, or duplicated so that storage grows while information does not. Inside a hedge fund, correcting a foundation of exactly that shape cut storage costs by more than 60% and made the models perform 2% better, and none of it was visible as an error: what a live AI system costs when nobody is reading it is the full account. Nothing in a pipeline objects to being wrong in that direction, which is why readiness has to be checked by someone rather than assumed by everyone.

First Steps

  1. Map the exact fields the workflow reads. Trace each one back to a real source and record how it is accessed, refreshed, and owned today. A field with no owner and no access path is already the finding — no measurement required.
  2. Measure the critical fields, not the warehouse. Completeness, consistency, freshness, and validity on the fields that drive the core decision — against a live sample, never a curated extract.
  3. Decide, and say which. If access and quality clear the bar, start building. If they do not, the data path is the first project, and it gets scoped as one.

Judge Readiness At The Workflow Level

The bar is short enough to check this week. The fields the workflow reads are named. They can be pulled programmatically, twice, without a person in the loop. Their completeness, freshness, consistency, and validity have been measured against live data. And someone can state the failure modes the system will have to survive, with a signal attached to each — which is the property the valuation engine had and a curated dataset never does. An organization that clears that bar can build on imperfect data with its eyes open; one that cannot is going to discover the same facts later, under delivery pressure, at several times the cost.

Where the data path is the open question, the fastest way to settle it is to prove it: an AI system design turns one workflow into an architecture, a written build plan, a fixed-price quote, and a working spike that runs in your stack against your real data — the spike being the part that makes readiness a demonstrated fact rather than an argued one. The broader estate question, and what to do when several workflows depend on the same broken path, is the data foundation an AI build actually needs; the messy-data build described above is the property valuation engine in full.

References

  1. Hiniduma, K., Byna, S., & Bez, J. L. A Comprehensive Survey on Data Readiness for Artificial Intelligence. arXiv, 2024.
  2. Mohammed, S., Budach, L., Feuerpfeil, M., Ihde, N., Nathansen, A., Noack, N., Patzlaff, H., Naumann, F., & Harmouch, H. The Effects of Data Quality on Machine Learning Performance. arXiv, 2022.
  3. IEEE. Research on Data Quality Dimensions for ML Pipelines. IEEE, 2024.
  4. MIT Sloan Management Review. Artificial Intelligence in Business Gets Real. MIT Sloan Management Review, 2018.
  5. Google. Rules of Machine Learning: Best Practices for ML Engineering. Google Developers, 2024.
  6. Mallick, A., Hsieh, K., Arzani, B., & Joshi, G. Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems. Proceedings of Machine Learning and Systems, 2022.
NEXTTO PRODUCTION

Find the real blocker.

Two minutes. What is slowing delivery, and the fastest path through.

Fixed scope · written plan · Design and Build: full refund until you accept