NeoBramPlan an AI project
    Manufacturing

    Predictive Maintenance AI: Data Requirements, Evaluation and Pilot Scope

    How to select assets, assess maintenance and sensor data, choose an evaluation strategy and connect predictive maintenance output to real work.

    Published 17 Jul 20262 min read

    Quick answer

    Predictive maintenance should start with one asset class and one actionable failure question. Historical failures help supervised prediction, but many plants have too few consistent labels. Anomaly detection can start from normal-operation data, yet still needs operating context and expert review. Evaluate lead time, missed events, false-alert workload and completed maintenance actions not only model accuracy and connect output to an owned maintenance workflow.

    Key takeaways

    • Select detectable failure modes, not every critical asset.
    • Time alignment and operating context matter as much as sensor volume.
    • False alerts consume maintenance capacity and belong in the business case.
    • Read-only integration and human review are sensible early production boundaries.

    Begin with the maintenance decision

    Name the asset, failure mode, user, required lead time and available intervention. Predicting a failure that cannot be detected early enough or cannot be acted on does not create useful value.

    Audit five evidence groups

    • Asset context: - hierarchy, criticality, manufacturer, configuration and operating duty
    • Maintenance history: - work orders, failure codes, findings, parts and completion notes
    • Condition evidence: - vibration, current, temperature, pressure, flow, oil or other relevant signals
    • Operating regime: - load, speed, product, recipe, ambient conditions, starts and stops
    • Outcome labels: - confirmed failure mode, false alarm, inspection result and intervention outcome

    Timestamps, units, tag meaning and equipment identifiers must align across sources. A large historian export is not useful if it cannot be tied to a specific asset state and maintenance outcome.

    Choose the learning approach from the evidence

    Supervised failure prediction needs representative examples of the target failure and comparable non-failure operation. If those labels are sparse or inconsistent, anomaly detection, condition thresholds or expert-designed features may be more appropriate. A hybrid can be better than claiming a universal failure forecast.

    Build the evaluation around operations

    Measure whether the system surfaces the right event with enough lead time for inspection or intervention. Track missed events, false alerts, alert clusters, review time and maintenance outcomes by asset and operating regime. Calibrate thresholds to the team's capacity and risk.

    Integrate carefully

    Start with read-only historian and maintenance data. During a pilot, route recommendations to a review queue before creating work. Production write-back to a CMMS or ERP should have an approved schema, ownership, duplicate handling and rollback. Product names describe possible contexts, not guaranteed connectors.

    Include the operating cost

    The business case includes sensing, data engineering, edge or cloud infrastructure, model evaluation, integration, user review, maintenance and updates. Compare that cost with the failure modes the system can plausibly detect not with total plant downtime.

    Define stop conditions

    Stop or redesign when the target failures are absent, labels cannot be trusted, operating regimes are unstable, interventions are not possible, or false alerts exceed the team's capacity. A disciplined stop protects the next use case.

    Decision table

    Choose from evidence, not labels.

    OptionUse whenEvidence neededWatch for
    Supervised failure modelRepresentative labeled failures and operating context exist.Confirmed failure modes, comparable non-failure periods and held-out cases.Learning maintenance-reporting habits instead of failure behaviour.
    Anomaly detectionNormal regimes are represented but failure labels are sparse.Operating-state labels and expert review of anomalies.Alerting on every product or load change.
    Rules plus analyticsKnown engineering thresholds and simple signals cover the need.Approved limits, context and action workflow.Adding machine learning where it creates no decision benefit.
    Data-readiness projectIdentifiers, timestamps, labels or sensing are not usable.Gap plan tied to the selected failure question.Collecting every possible signal without an acceptance test.

    Direct answers

    Frequently asked questions

    How much historical data is needed?+

    There is no universal duration. It depends on the failure frequency, operating regimes, sampling, labels and intended lead time. Audit representative events before promising a data period.

    Do we need new sensors?+

    Not always. Existing maintenance records, historian tags, PLC context and inspections may support a first assessment. Add sensing only when it closes a specific evidence gap with justified value.

    What metric should a pilot use?+

    Use a set: event-level recall, false-alert burden, actionable lead time, performance by operating regime and the proportion of alerts that lead to accepted maintenance action.

    About NeoBram

    AI expertise for teams that know industry

    NeoBram works as an AI engineering and delivery partner for industrial SMEs and customer-facing firms. We help teams choose a useful first workflow, build private production-ready systems and transfer the capability to their people.