Predictive Maintenance
Complex deployments where integration, safety, and operational handoff determine production success.
Inside this journey
-
Pre-Discovery
Align stakeholders, data owners, and decision criteria before deep technical discovery.
-
Stakeholder Alignment
Confirm decision roles, data owners, timeline, and target success signals (e.g., prediction accuracy and acceptable false positive rate).
Alignment Questions
Start: A Quick Plant Snapshot
- Which best describes your role and primary focus at the plant?
- What type of facility and processes are we talking about?
- How many critical assets (rotating machinery, heat exchangers, compressors, large pumps) do you consider in-scope for predictive maintenance today?
- Roughly how often does an unplanned failure in a critical asset cost your site over $100k (choose best fit)?
- Who will be our primary day-to-day contact for this initiative (name / title)?
If a Machine Could Talk, Would You Trust What It Says?
- When your monitoring systems raise an alert today, how confident are you that it indicates a real, actionable degradation?
- Tell us about the last time an automated alert led to either a false alarm or a missed failure—what happened and how did your team react?
- How tolerant would your maintenance planners be of false positives during a pilot (e.g., % of alerts that can be false before trust breaks)?
- What specific diagnostic detail would make an alert believable and actionable for your planners (e.g., likely failure mode, estimated RUL, recommended inspection steps)?
- How long would it take to rebuild trust after a string of false alarms? Please describe past experiences if possible.
Where It Actually Hurts — A Few Stories About Real Failures
- Describe a high-impact failure that still bothers you—what failed, what was the root cause, and why does it stick in your memory?
- How often do failures like that occur for similar assets at your sites?
- What are the typical business consequences when a critical asset fails (select all that apply)?
- When those failures occur, who bears the cost or explains it to leadership—and how does that conversation usually go?
- If you could prevent just one recurrent failure across the plant, which would it be and why?
What’s Working With Your Data — And What’s Not
- You told us you have historians and sensors—how confident are you that the right signals exist to detect the failures you care about?
- Which of the following signals are available and consistently recorded for the assets in scope?
- How complete and labeled is your incident history (i.e., records of failures with timestamps and root cause)?
- What data quality issues have you repeatedly experienced (missing tags, timestamp drift, sampling inconsistency, sensor calibration, etc.)?
- Who owns the data access and where does it live (on-prem historian, cloud lake, hybrid)?
- If we asked for a sample dataset for a quick modeling exercise, how long would it take to provide it and who would we coordinate with?
Who Actually Decides — And Who Gets the 2AM Call?
- When it comes to adopting predictive maintenance, who are the decision-makers and what are their top concerns?
- Which teams must be engaged/approve for a pilot to proceed (select all that apply)?
- Who will be the operational owner responsible for triaging and acting on alerts during the pilot?
- How do you prefer to define success for the pilot — technical thresholds, business KPIs, or both?
- What timeline are your stakeholders expecting for a pilot decision (weeks, months)?
If We Could Prove Value in Weeks, What Would That Look Like?
- What measurable outcomes would make you say a pilot was unquestionably successful?
- Which performance targets matter most to you for models (pick up to three)?
- For RUL or advance warnings, what minimum lead time would allow planning and spare parts staging (choose all that apply)?
- What operational acceptance tests would you run to validate the predictions in a live environment (examples: controlled inspections, non-disruptive tests, staged shutdown)?
- What KPIs will you track with leadership to justify moving from pilot to production (select up to three)?
Integration & Workflow Reality Check — The Work-Order Moment
- You may have CMMS integration plans—how many manual steps are still required today from detection to scheduled work-order?
- Which CMMS and IIoT/SCADA platforms do we need to integrate with for automatic work-order creation or alerts?
- Describe the ideal work-order payload and handoff from analytics to planners—what fields and context must be included for someone to act?
- What approvals or human checkpoints must exist before a generated work-order becomes scheduled or dispatched?
- How would you like diagnostics presented to maintenance (e.g., prioritized root-cause likely, confidence band, suggested inspection steps, visual trend)?
Training Models — Data Access, Security, and Speed
- How comfortable are you with an external team training models on your production data under an agreed security posture?
- Which deployment model do you prefer for training and inference?
- What security or compliance requirements must we satisfy before accessing data (e.g., network zoning, VPN, IOT gateway, SOC2, legal approvals)?
- Do you have labeled failure examples we can use for supervised training, and if so, how many incidents per failure mode are available?
- Who will be the owner responsible for model validation and approving model promotion to production?
- How quickly do you expect an initial proof-of-value model (non-production) to be available for review?
What Could Stop This From Succeeding (Honest Risks)
- If this pilot failed, what do you think the real reason would be—technology, people, process, budget, or something else?
- Which internal resources are likely to be the bottleneck during the pilot (e.g., data owners, OT engineers, reliability team, operators)?
- What internal objections or concerns have you heard about predictive solutions in the past, and how were they voiced?
- What would help you mitigate those risks—specific governance, assurances, sprint cadence, or pilot guardrails?
- Who needs to be visibly successful internally to keep funding and support for a production rollout?
Commitment & Next Steps — Small Bets, Clear Signals
- What pilot duration feels reasonable to demonstrate meaningful value (and why)?
- Which assets and failure modes would you want included in an initial pilot (list names or asset types)?
- What minimal SLAs or acceptance thresholds must be met to consider the pilot successful (choose up to three)?
- Who will sign off on pilot completion and who will approve moving to a commercial engagement?
- What practical next step would make it easy for your team to say yes to a pilot (e.g., NDA, proof-of-concept agreement, single-asset trial)?
- Is there anything else we should know before proposing a pilot scope or a readiness checklist?
-
Current State Mapping
Document instrumentation, historian coverage, maintenance workflows, recent failure modes, and integration constraints (CMMS/SCADA).
Current State
Start: Help Us See Your Plant
- Which site, plant area, and asset groups should we focus on for this discovery (pick the best fit)?
- What is the primary point of contact for reliability and who will coordinate data access?
- What timeframe would you ideally like to see results or a working pilot (business expectation)?
- Who are the stakeholders we should assume will be involved (names or roles: reliability, ops, IT, procurement)?
- Is there a compliance, audit, or corporate standard we must align to during discovery (e.g., ISA, NERC, company policy)?
Why do failures still blindside you?
- When unplanned failures happen, what consequences do you feel most acutely (beyond repair cost)?
- How often in the past 12 months did a failure occur with little or no warning?
- Tell us about one recent failure that felt avoidable—what happened and why do you think it wasn't predicted?
- How does the maintenance team usually discover and escalate an impending failure today (e.g., alarms, operator rounds, condition monitoring, customer complaint)?
- How confident are you that earlier detection could have reduced impact on that example incident?
Where's the data hiding (and what it's not telling us)?
- If your historians could speak, which gaps would they complain about first?
- Which historian(s) and data stores are in use at the site?
- Estimate the percent of your critical assets that have continuous time-series coverage (vibration/temperature/pressure/current etc.).
- What is your typical data retention window for raw sensor data?
- Do you have incident-labeled datasets or failure logs that can be matched to time-series signals?
- If partially or fully labeled, roughly how many failure events do you have per failure mode for a representative asset class?
Is your instrumentation telling the full story?
- Which sensor families are installed on the assets we're discussing?
- How healthy are those sensors—do you have automated sensor health or calibration records?
- What percent of telemetry is typically missing or flagged as bad on a daily basis for these assets?
- When a sensor fails or drifts, what is the maintenance workflow to repair or replace it?
- Are there any sensors you’ve intentionally avoided using for analytics because of noise, sampling, or access issues? Which and why?
How do work orders really get created—and do they ever complete the feedback loop?
- Who is responsible for converting a condition alert into a work order and is that person empowered to act?
- Which CMMS (if any) do you use and how are new work orders typically created?
- Are work orders created manually, via scripted integrations (API/DB), email triggers, or automatically from existing analytics?
- How long does it usually take from identifying an issue to scheduling and completing the work (typical SLA/lead time)?
- Do completed work orders get linked back to timestamps/events in the historian so we can label outcomes?
- What would increase your teams' willingness to act on a predictive alert (e.g., diagnostic confidence, estimated RUL, cost savings projection)?
If a pilot had to win your trust, what would it have to prove?
- What minimum prediction performance would make you consider changing workflows (choose the most important metric)?
- What false-positive tolerance would erode trust for your maintenance team?
- Which failure modes or asset classes should be in scope for the pilot to be meaningful?
- How many assets or units would you consider a representative pilot (to show statistically meaningful results)?
- What duration do you think is necessary to validate performance (lead time, seasonality, failure arrival)?
- What operational acceptance tests would convince you the solution is ready to deploy (examples: live alert accuracy, correct work-order creation, operator usefulness)?
What integrations, security, or policies could stop this before it starts?
- Which deployment model is preferred or required at your site?
- Do you have network policies that restrict outbound connections, require jump boxes, or mandate air-gapped segments?
- What authentication and identity controls are required for integrations (SSO/SAML, client certs, API keys)?
- Are there procurement, legal, or data residency constraints we should know about (e.g., no cloud storage of raw sensor data)?
- Who in your IT/OT organization will own firewall and integration approvals?
- What formats or interfaces will we need to support for data access (PI connectors, OPC-UA, REST APIs, CSV exports, direct DB read)?
Who signs, who operates, and who will actually change behavior?
- If predictions become reliable, which role will own the final decision to act on a predictive work order?
- Which roles will need training and what level of detail do they prefer (high-level dashboards, diagnostic runbooks, hands-on workshops)?
- Who will be responsible for verifying alerts and closing the loop back into our data (labeling true/false positives)?
- Is there an internal champion or sponsor who will help prioritize integration work and remove roadblocks? If so, who?
- How do you prefer ongoing collaboration during a pilot—weekly checkpoints, bi-weekly demos, or on-demand support?
-
-
Outcome Discovery
Define measurable outcomes, pilot success criteria (accuracy, false positive tolerance, RUL targets), and operational acceptance tests.
Discovery Questions
Quick Intro: Your Big Bet
- Which asset family would you most want to pilot on?
- Who will be our primary technical contact for the pilot? (name, role, best contact method)
- How would you describe your instrumentation and historian coverage for that asset today?
- Roughly, what is the order-of-magnitude cost to your site for one unplanned failure of this asset (equipment + lost production + labor)?
- What timeline would feel urgent for seeing meaningful pilot results?
- Tell us about any previous predictive-maintenance efforts or vendors you've trialed and what happened.
If Predictions Were Wrong, What Would Happen?
- What would break first if the analytics started sending regular false alarms?
- How tolerant would your team be to a false-positive rate at different levels?
- At what false-negative risk (missed failures) would you consider the solution unacceptable?
- How many inaccurate alerts (rough count) would it take before operators start ignoring the system?
- Describe one recent incident where an alert would have helped — what was the sequence and the emotional/operational impact?
- Which consequences matter most if we miss a near-term failure?
How Do You Decide What's Actionable?
- Would your planners schedule a repair based on a prediction alone, or do they need concrete diagnostic evidence?
- Who in your organization formally approves proactive work orders (title or role)?
- How long is the typical lead time between approval and executing a planned corrective action?
- What diagnostic details must accompany an alert to generate a correct work order (select all that apply)?
- How do you currently handle run-to-failure policies or temporary mitigations while awaiting parts?
- Share an example of a prediction or diagnostic that would have made a planner feel confident to schedule work immediately.
Show Me the Money — and the Risk
- If analytics cut unplanned failures by 50% on the piloted assets, what would that mean for your site (in plain terms)?
- Which executive KPIs are most influenced by equipment reliability at your site?
- What percentage reduction in downtime or failures would be viewed as a clear win?
- What pilot budget range could be approved without escalating to finance?
- How do you value non-monetary benefits like planner trust, better spare allocation, or fewer emergency permits?
- Who at your company will own the business case approval for reliability initiatives?
What Does 'Success' Actually Look Like?
- Would you accept a technically accurate model that still fails to change day-to-day operations?
- Which measurable pilot metrics should we include in the acceptance criteria? (pick all that matter)
- What are minimum acceptable thresholds for model performance to consider the pilot successful?
- How many labeled incidents (historical failures with timestamps and root cause) do you have for the chosen asset class?
- Would you accept a phased acceptance (shadow mode → advisor mode → automated work-order generation)?
- How will you measure operator trust and adoption during the pilot (surveys, action rates, override rates)?
Who's Going to Own This When It Works?
- If a prediction in production led to an incorrect action, who would be accountable?
- Which teams should receive alerts and dashboards during the pilot?
- Who owns the data pipelines, access approvals, and historian extracts in your org?
- Do you have an identified operations champion who will drive adoption and training?
- How should knowledge transfer look after pilot: handover documents, runbooks, on-site training, or a blended model?
Can We Prove It Safely? — Pilot Design and Acceptance Tests
- Are you willing to test predictions on live assets with staged safeguards (shadow mode → advisor → live), or do you need historical-only validation first?
- Would you be open to blocking a controlled machine-day or scheduled window to validate an intervention recommended by a prediction?
- Preferred pilot duration and incident sample size to feel statistically confident?
- Which acceptance tests must pass before we consider the pilot successful? (select all required)
- What security, compliance, or change-control approvals must be in place before we access historian or push work orders to CMMS?
- Which deployment mode do you prefer for the pilot (cloud inference, edge inference, hybrid)?
What Would Make You Say Yes Today?
- What's the single non-negotiable outcome or guarantee that would get your leadership to greenlight a pilot now?
- How soon could you commit the people and data access needed to start?
- Which contractual terms would block you from proceeding without negotiation (SLA on accuracy, false-positive liability, data ownership, IP)?
- What support model would make your team most confident during the pilot and early production (on-site daily, weekly remote, shared ops, fully managed)?
- Are there any regulatory or operational constraints we should know about that could prevent predictive-driven maintenance actions?
- Any other concerns, unknowns, or questions you'd like us to address before we draft a pilot proposal?
-
Solution Experience
Use the customer’s asset contexts and failure scenarios to show how predictions, diagnostics, and work-order integration produce the desired outcomes.
Experience Meetings
- Pre-Experience Alignment: Current State, Consequence, Future State
- Data & Scenario Preparation Workshop
- Live Solution Experience: Predictions, Diagnostics, and Work-order Flow
- Operational Integration & Runbook Workshop
- Validation & Go/No-Go Decision Review
- Define acceptance test cases and measurement methods for the pilot.
- Objective & Success Signals Recap
- Demonstrate that predictions occur early enough and with acceptable accuracy to materially enable the defined future state.
- Show that diagnostics map to actionable maintenance scopes and spare parts so planners can make informed decisions.
- Validate that generated work-orders contain the fields and workflow steps required by the customer's CMMS and planners.
- Capture tuning requests and acceptance-test items for the pilot.
- Seller to provide recorded session artifacts: prediction timelines, diagnostic reports, and example work-orders from the demo.
- Customer to confirm any required CMMS field mappings or process changes needed to accept automated work-orders.
- Seller to produce a prioritized list of model tuning and alert-threshold changes requested during validation.
- Customer to approve the acceptance test cases derived from the demo scenarios.
- Recap Demo Findings Relevant to Ops/IT
- Agree on CMMS work-order templates and required fields to be pushed from the platform.
- Document the runbook and decision flow operators will follow on an alert.
- Introductions & Meeting Objective
- Confirm integration and security prerequisites to enable automated work-order flow during the pilot.
- Seller to produce CMMS work-order template JSON and runbook draft for customer review.
- Customer to identify the approver groups, spare-parts lists, and planner owners for the runbook steps.
- IT to validate API endpoints, credentials, and security controls and provide any required change requests.
- Both parties to sign off on the acceptance test plan and scheduling of test windows.
- Summary of Demonstrated Outcomes
- Agree whether the Solution Experience satisfied the success signals and accept criteria.
- If approved, finalize pilot scope, duration, SLAs, and responsibilities required to begin the pilot.
- If not approved, produce a clear, time-bound remediation plan to reach acceptance.
- Assign owners and dates for pilot kickoff or remediation next steps.
- Decision recorded in writing (go/no-go) with agreed pilot scope or remediation plan.
- Seller to prepare pilot Statement of Work (assets, metrics, duration, SLAs) within agreed timeline if go decision made.
- Customer to approve resource allocations (IT, planners, operations) and sign off on pilot start date.
- Both parties to schedule a pilot kickoff meeting and confirm technical onboarding tasks.
- Produce a single agreed one-sentence current state.
- Agree on quantified consequences (dollars, hours, safety risk) to motivate urgency.
- Define the one-sentence future state that the Solution Experience must prove.
- Document concrete success signals and acceptance criteria for the experience.
- Assign pre-work owners and deadlines to prepare for the live Experience.
- Customer to provide a 1-page incident cost summary and examples of 2–3 recent failures selected for the experience.
- Seller to draft three candidate one-sentence current-state and future-state phrasings for customer to approve.
- Agree and record the numerical success signals and thresholds to validate during the Solution Experience.
- Schedule next meetings and confirm attendee list with SME names and CMMS/ops contacts.
- Recap Preconditions
- Finalize the set of assets and 2–4 concrete failure scenarios to be used in the live experience.
- Confirm data extracts, labeling conventions, and address any instrumentation gaps that would invalidate the demo.
- Establish delivery deadlines and responsible owners for the demo data.
- Agree on any synthetic augmentation or alignment steps if historical data is incomplete.
- Customer to deliver agreed data extracts (historian windows, sensor mapping, maintenance logs) for selected incidents by the agreed date.
- Seller to perform data validation and return a data health report with remediation steps if issues found.
- Customer to confirm labeling rules and annotate incident ground-truth timelines for at least two scenarios.
- Seller to prepare a pre-demo dataset and a short runbook describing how the incidents will be replayed during the experience.
- One-sentence Current State
- Scenario 1: Live Prediction Replay
- Confirm Asset Contexts & Failure Modes
- Work-order Template Design
- Gap Analysis vs Acceptance Criteria
- Remediation & Tuning Plan (if needed)
- Diagnostics & Root-cause Mapping
- Select Representative Incidents
- Runbook / Planner Decision Flow
- Quantify the Consequence
- Define One-sentence Future State
- Work-order Generation & CMMS Flow
- Decision: Proceed to Pilot / Iterate Solution Experience
- False Positive Handling & Escalation
-
Solution Scope
Define assets, failure modes, models, integrations (CMMS/edge/cloud/SCADA), data requirements, and acceptance criteria for the engagement.
Scope Configuration
- Sensor Data Ingestion and Normalization
- Historian Backfill and Time-Series Indexing
- Vibration Signal Processing and Feature Extraction
- Automated Asset-Specific Model Training
- Physics-Informed Failure Mode Classification
- Remaining Useful Life (RUL) Estimation Module
- Anomaly Detection with Alert Prioritization
- Diagnostic Context Packaging for Alerts
- CMMS Integration and Automated Work Order Creation
- Edge Inference Deployment for Industrial Gateways
- Cloud API and Webhook Delivery of Predictions
- Asset Health Dashboards and Fleet Views
- Scheduled Model Retraining and Drift Handling
Scope Questions
Sensor Data Ingestion and Normalization
- Which sensor types are present on the target assets (select all that apply)?
- What protocols and connectors are available for ingesting live sensor data?
- What are the typical sample rates / frequencies for the sensors you want to ingest (give ranges for each sensor type)?
- Do sensor timestamps require normalization (timezones, clock skew) or resampling?
- Is raw waveform data (high-frequency vibration) stored centrally or only at the edge?
- What pre-processing or unit conversions are required (e.g., g to mm/s, Fahrenheit to Celsius)?
- Are there constraints on data volume, upload windows, or compression we should account for?
Historian Backfill and Time-Series Indexing
- Which historian(s) or time-series stores hold the historical data for scoped assets?
- What historical time window is required for model training and validation (e.g., 6 months, 2 years)?
- Do you have a recommended backfill scope (asset tags, timestamps, event logs) and an owner for historian access?
- Are tag naming conventions consistent across assets/sites, or is mapping required?
- What is the expected data quality profile (missing values, duplicate timestamps, irregular sampling)?
- Do regulatory or retention policies limit our ability to backfill or export historical data?
- What indexing/granularity is required for time-series queries (e.g., per-second, per-minute, per-route)?
Vibration Signal Processing and Feature Extraction
- Are vibration sensors configured for waveform capture, or only envelope/summary metrics?
- What sampling rates and buffer lengths are available for waveform captures (Hz and seconds)?
- Which signal processing features are priorities (select all that apply)?
- Do you require domain-specific analyses (e.g., shaft speed order tracking, bearing fault frequencies) for certain assets?
- Are there existing vibration routes and balancing metadata (RPM, component geometry) to support physics-based features?
- How should we handle legacy processed signals vs raw signals when extracting features?
- Are there compute or storage limits that constrain storing full waveforms vs summaries?
Automated Asset-Specific Model Training
- How many distinct asset-types or model groups should be trained in the pilot?
- Do you have labeled failure/incidents for these assets and how many examples per failure mode?
- Should models be trained per-asset, per-asset-family, or as cross-site/generalized models?
- What compute environment should training use?
- What minimal performance thresholds define acceptable model training results (e.g., precision, recall, AUC)?
- Who will validate model outputs from a domain perspective (name/role)?
- Are there preferred model types or restrictions (no black-box models, explainable models required)?
Physics-Informed Failure Mode Classification
- Which failure modes should be covered by physics-informed classifiers (select all that apply)?
- Do you have engineering rules or thresholds (e.g., vibration at bearing frequencies) we must encode or validate against?
- Is explainability required for each classification (feature attribution, physical indicator mapping)?
- How should classification outputs map to maintenance actions or parts lists?
- Are there site-specific physics parameters we must ingest (RPM ranges, geometry, bearing spec sheets)?
- What false-classification tolerance is acceptable before additional human review is required?
Remaining Useful Life (RUL) Estimation Module
- What prediction horizon is required for RUL outputs (select one)?
- Do you have labeled end-of-life events or degradation timelines for training RUL models?
- What level of uncertainty is operationally acceptable in RUL estimates (e.g., +/- X days/weeks)?
- How will RUL thresholds translate to operational actions (schedule maintenance, order parts, reduce load)?
- How often should RUL be re-computed (real-time, hourly, daily)?
- Is there a preference for deterministic physics-based RUL vs learned statistical RUL or a hybrid approach?
Anomaly Detection with Alert Prioritization
- What are acceptable alert performance targets (precision / false positive rate) for the pilot?
- Should alerts be prioritized by predicted severity, criticality of asset, or business cost?
- Do you require adaptive thresholds per-asset or global alert thresholds?
- How should alert deduplication and suppression windows be handled?
- Who should receive and own alerts at different priority levels (roles/teams)?
- What business cost or SLA should drive alert escalation rules (e.g., response time targets)?
Diagnostic Context Packaging for Alerts
- Which diagnostic fields must accompany each alert (select all that apply)?
- Do you require automatic mapping from diagnostics to existing troubleshooting runbooks?
- What visualization attachments are required in an alert (time-series slices, spectrograms, trend plots)?
- What minimum confidence threshold should be displayed before automated actions are taken (e.g., work-order creation)?
- Should diagnostics include suggested priority and estimated labor/parts impact?
- What format should diagnostic payloads use for integrations (JSON schema, PDF attachment, link to dashboard)?
CMMS Integration and Automated Work Order Creation
- Which CMMS system(s) should be integrated for work-order creation?
- What core work-order fields must be populated automatically (asset ID, priority, failure code, estimated labor)?
- Do work orders require approvals or multi-step workflows before release to planners/technicians?
- Is a test/sandbox CMMS instance available for integration testing?
- Should CMMS integration be bi-directional (status updates from CMMS back into the analytics platform)?
- How should failed integration attempts or duplicate orders be handled and reported?
Edge Inference Deployment for Industrial Gateways
- Is edge hardware already available on-site (specify model/specs), and how many gateways are in scope?
- Which runtimes are supported on-site for edge inference?
-
Mutual Commit
Finalize commercial terms, pilot duration, SLAs (accuracy/FP), responsibilities, and criteria to move from pilot to production.
Agreement Modules
- Statement of Work (SOW)
- Master Services Agreement (MSA)
- Pilot Agreement
- Service Level Agreement (SLA)
- Pricing & Payment Schedule
- Data Processing & Security Agreement (DPA)
- Roles & Responsibilities (RACI)
- Acceptance Criteria & Production Handover
- Integration & CMMS Work-Order Agreement
- Change Order & Scope Management
- Liability, Indemnity & Insurance
- Renewal & Commercial Transition Plan
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Confirm data access, security, environment (edge/cloud), labeled incident history, and owners are in place for model training and testing.
Readiness Questions
Quick intro — who’s joining the mission?
- Which roles from your team will be directly involved in getting models ready for pilot (select all that apply)?
- Who is the single technical owner we should coordinate with for data access and test environments?
- Who has final approval authority to run a pilot and push a model into production?
- How much weekly availability can the core team commit to for rollout coordination and troubleshooting in the next 60 days?
- Is there an existing internal or external vendor we must coordinate with for access, and who are they?
If the data could talk, what story would it start with?
- If your sensor and historian data had to prove one thing about asset health, what would you want it to show first?
- Which data sources are available and how are they accessed (select all that apply)?
- What is the typical sampling frequency for your key signals (vibration, temp, pressure, current)?
- Do you have a single canonical timestamp and asset identifier across systems, or will we need to map multiple naming conventions?
- Describe any known data quality issues (gaps, clock drift, sensor noise, duplicated tags) and how often they occur.
Where might the project unexpectedly hit a wall?
- Which of these security or network constraints are likely to slow or block model training and testing?
- How do you currently separate OT and IT environments, and who owns cross-domain approvals?
- Are service accounts, certificates, or credentials required for read/export access — and are they already provisioned?
- Have you previously blocked third-party analytics on security grounds? Tell us about that incident and resolution.
- What change-control or maintenance windows will restrict when we can extract data or run live acceptance tests?
The truth about labeled incidents (and near-misses) — how real is it?
- Roughly how many confirmed failure events for the target asset types do you have in your records over the last 3 years?
- Do failure records include clear root-cause labels, timestamps, and attachments (repairs, photos, operator notes)?
- How consistent is sensor coverage during historical incidents (were the key signals recording throughout the failure progression)?
- Are near-misses or preventive actions logged in the same system as failures, and can we access them for model training?
- Who on your team currently owns labeling and root-cause confirmation, and how long does a typical label review take?
Edge, cloud, or hybrid — where does your future live?
- Which deployment target do you prefer for pilot inference and why (edge device, local on-prem, cloud)?
- What bandwidth or latency constraints exist between plant OT networks and your corporate/cloud environment?
- Is there an approved edge hardware or gateway standard at the site (vendor/model), or will we propose one?
- Do you have on-prem compute resources (VMs / GPU) available for model training or will training run in the cloud?
- Are there corporate policies restricting data leaves (e.g., PII/PII-like, export controls) that would affect where we train or store models?
What will actually make operators act — metrics that matter beyond accuracy
- What minimum prediction performance would your team accept to act on an alert (select all that apply)?
- Which of these operational KPIs will determine pilot success for you?
- How much lead time (e.g., days/weeks) do you need from a prediction to reasonably plan a corrective action?
- Would you require diagnostic context with each alert (probable failure mode, affected component, recommended actions)?
- How should alerts be delivered and actioned (select all that apply)?
What could make this stall — and who will stop it?
- If you had to name one single blocker that would most likely kill the pilot, what would it be?
- Which stakeholders must sign off before we can begin data extraction and training?
- What is your target timeline for having a model-ready dataset and the first training run?
- Are there planned plant changes (equipment upgrades, sensor rollouts, process changes) that could impact the pilot during the next 3 months?
- Who will be the internal champion ensuring cross-team follow-through, and how will they be empowered?
Let’s put a date on readiness — quick commitments
- If we asked for read-only access to a representative dataset within 30 days, how confident are you that can be provided?
- Which of these artifacts can you provide within two weeks to accelerate readiness (select all that apply)?
- Who will create the ticket or approval we need to begin extracting data (name and role)?
- What is the preferred method for sharing credentials or secure access information with our onboarding team?
- Is a non-disclosure agreement or site visit approval required before we can proceed, and is it in place?
-
Deployment Enablement
Execute integration tasks, schedule model training, map CMMS work-order flows, and train operators with runbooks and diagnostics workflows.
-
Validation Checklist
Run acceptance tests against live data, verify prediction performance and diagnostic usefulness, and confirm correct work-order generation.
Validation Questions
Quick intro — who are we teaming up with?
- Please tell us your role and the team you represent (e.g., Reliability Engineer — Rotating Equipment, Maintenance Director — Refining, OT Lead).
- Which types of assets are you most focused on for predictive capability right now?
- Roughly how many instrumented critical assets (the ones where an unplanned failure costs >$100k) are in scope at your site or region?
- What would success look like for you in a single sentence (free response)?
- Who will be our day-to-day contact for technical data questions and who is the final decision-maker for pilots?
What keeps you up at 2 AM about equipment reliability?
- If your current approach to asset failures had to defend itself in front of your leadership, what would be the hardest criticism to answer?
- How often do unplanned critical failures occur that meaningfully disrupt operations?
- Tell us about a recent failure you wish you'd seen coming — what happened, and what consequences did it cause (cost, safety, downtime)?
- How does your team currently decide which failures or assets 'deserve' predictive focus — by cost, frequency, safety, or other criteria?
- When a prediction or alert has been wrong in the past, how did that affect trust and the subsequent workflow?
Where the data lives — and the real barriers to using it
- How would you describe the top three systems where relevant signals and records live (e.g., PI/OSI, Azure Data Lake, local historian, CMMS, PLC/edge)?
- Which of the following best describes your historian/SCADA coverage for the assets in scope?
- What percent of incidents have labeled failure events / maintenance outcomes in your records (useful for supervised training)?
- Are there consistent data quality issues we should know about (gaps, clock drift, unit mislabeling, frequency mismatch)? Please list the top two.
- Who currently controls access to the raw historian and CMMS data, and how long does it take to get read access for a vendor project?
When alarms become background noise — how alerts actually behave
- Why do most current alerts or thresholds fail to create confident maintenance actions in your organization?
- What false positive rate would destroy trust on your team (i.e., how many incorrect alerts per month is unacceptable)?
- When an alert is raised today, what is the typical workflow from receipt to action (who evaluates, what steps, how long until a work order is created)?
- Do your current alerts include diagnostic guidance (likely root cause, affected components, confidence level)?
- How tightly does your CMMS link to OT workflows today: automatic work-order creation, manual entry, or no integration?
If predictions were trusted — what would change for your operation?
- Imagine predictions arrive with enough lead time and accuracy — which outcome matters most to you?
- What quantitative targets would you set for a pilot to consider it successful (choose all that apply and provide numbers in the next question)?
- Please provide the numeric targets you’d like to see for the items you selected (e.g., 30% downtime reduction; FP <10% monthly; lead time ≥14 days).
- How will you validate that a diagnostic is 'useful' operationally — who signs off and what evidence do they need?
- Beyond technical metrics, what behavioral change would signal success (e.g., planners act earlier, techs schedule inspections differently)?
Who's on the team and who will stand behind the results?
- Which stakeholders must be convinced before a pilot can move to production (pick all that apply)?
- What are the top three questions each stakeholder group will ask before approving production deployment?
- How much calendar time can your core team commit to a pilot (data access, weekly reviews, acceptance testing)?
- Who will own model performance in production—Reliability, OT, or a joint team—and who will own CMMS change management?
- Are there procurement or legal constraints (e.g., data residency, vendor onboarding timelines) that typically add time to projects?
Pilot to production — what would make the handoff painless?
- What scope do you see as realistic for an initial pilot (number of assets, failure modes, lines/units)?
- Which integrations are required during pilot to prove end-to-end value (select all that apply)?
- What acceptance tests would you require before concluding the pilot (examples: live-data accuracy, diagnostic triage trials, successful auto work-orders)?
- What SLA expectations do you have for an initial production rollout (accuracy targets, FP caps, latency for alerts)?
- What budget range and approval path exists for converting a successful pilot to production?
Your worries, the smallest convincing win, and next steps
- What is your single biggest objection or fear about adopting predictive models in your environment?
- What would be the smallest practical outcome that would convince your team this approach is worth scaling (a micro-proof)?
- How do you prefer to experience a pilot: hands-off demo, collaborative co-development, or embedded support with onsite/remote training?
- Are there any regulatory, safety, or union rules that would affect how we run tests or schedule inspections prompted by our predictions?
- If we propose a clear first step within the next two weeks (data access checklist or a short discovery call), are you ready to commit to it?
-
-
Success
Review outcomes against agreed success signals, capture learnings, and maintain a shared backlog for issues and enhancements.
Success Reviews
- Success Metrics Review
- Incident & Diagnostic Learnings
- Backlog Prioritization & Enhancement Planning
- Operational Handoff & SLA Alignment
- Executive Review & Scaling Decision
Issues & Enhancements
- Define support and escalation procedures to minimize downtime on model or integration issues.
- Review Current Backlog
- Produce a prioritized backlog with owners, estimated effort, and business impact.
- Establish clear acceptance criteria for highest priority enhancements.
- Agree an initial delivery timeline and resource commitments.
- Publish the prioritized backlog with owners, effort estimates, dependencies, and target dates.
- Create sprint/iteration plans for the top-priority items and schedule kickoff meetings.
- Document acceptance tests and sample datasets required for validation of each enhancement.
- Ownership & Handoff Plan
- Establish clear ownership and documented SLAs for production operation of the solution.
- Confirm CMMS payloads and runbooks are accepted by maintenance teams and ready for live use.
- Opening & Objectives
- Finalize and sign-off an SLA and ownership matrix; publish to stakeholders.
- Deliver operator training sessions and update runbooks; confirm attendance records.
- Create a support contact list and escalation playbook with response time commitments.
- Executive Summary of Outcomes
- Obtain executive alignment and decision on whether to scale, extend, or close the engagement.
- Secure necessary budget or approvals to execute the chosen path forward.
- Ensure executives understand the concrete KPIs and commitments tied to scaling or production.
- Prepare a formal expansion proposal or production plan with costs, timeline, and expected KPIs.
- Obtain executive sign-off and budget allocation or document reasons for deferral/closure.
- If approved, schedule a pilot-to-production transition kickoff with owners and timeline.
- Validate that metrics are calculated against the agreed definitions and datasets.
- Decide whether pilot outcomes meet the success signals or require remediation/extension.
- Assign owners and timelines for any remediation or production steps required.
- Publish a validated performance report (metrics, datasets, calculation methods) to the shared workspace.
- If required, open remediation tickets for model tuning, data quality, or instrumentation gaps with owners and target dates.
- Schedule follow-up decision meeting (if decision deferred) with required stakeholders.
- Incident Summary
- Create a prioritized list of model and process fixes informed by root cause findings.
- Ensure diagnostic outputs map correctly to actionable CMMS work-orders and repair scopes.
- Update labeled incident dataset and taxonomy to improve future training and validation.
- Log all reviewed incidents into the shared learning repository with root-cause notes and attachments.
- Create dataset labeling tasks for incidents requiring corrected labels or richer annotations.
- Issue CMMS workflow change requests for any diagnostic → work-order mismatches.
- ROI & Business Impact
- SLA Definitions & Measurement
- Pre-work & Data Sanity Check
- Root Cause Analysis
- Impact Mapping
- Metrics Walk-through
- Recommended Path Forward
- Prioritization Workshop
- CMMS & Workflow Confirmation
- Diagnostic Utility Review
- Operational Impact Review
- Process & Runbook Gaps
- Budget & Approval Discussion
- Training & Runbooks
- Timeline & Resource Alignment
- Summary of Decisions & Next Steps
- Stakeholder Validation
- Define Acceptance Criteria
- Learning Log & Label Updates
- Support & Escalation Paths
- Decision & Next Steps