Auto Claims
Complex multi-party engagements where risk, regulation, and claim resolution require coordinated action.
Inside this journey
-
Pre-Discovery
Align the room on outcomes, decision process, and constraints before deeper discovery.
-
Stakeholder Alignment
Confirm decision roles, timeline, success metrics, and key constraints for claims, IT, and transformation sponsors.
Alignment Questions
Quick Introductions: Who's in the Room?
- Who are the people we should consider part of the core decision team for this claims initiative?
- Which single role will have ultimate sign-off authority for a pilot and contract?
- Tell us who will be the operational day-to-day point of contact for discovery and what their title is.
- Are there informal influencers (committees, regional leads, union reps, audit teams) who typically shape claims decisions? If so, who are they?
- How do you prefer we coordinate communications with the team (weekly steering, biweekly working sessions, Slack, email)?
Who Really Decides — and How Fast Can They Move?
- If everything aligned politically and technically, how quickly could your organization approve a pilot start date?
- Describe the approval path from pilot approval to production—who signs, who advises, and which committees meet along the way?
- Which calendar constraints are non-negotiable for approvals (budget cycle, regulatory filings, board windows, fiscal year cutoffs)?
- When prior projects ran late, what were the top two root causes (e.g., data access, security review, executive reprioritization)?
- What single action from a vendor or partner has historically accelerated internal approvals the most?
What Would Move the Needle for Leadership?
- Which single metric—if improved—would change the conversation from ‘maybe’ to ‘go’ at the executive level?
- Please share current baseline values for the top 3 metrics you care about (e.g., cycle time = X days; supplement rate = Y%).
- Which of these metrics require auditable trails or regulatory reporting in your jurisdiction?
- How confident are you in the accuracy and consistency of your current metric measurements?
- If a pilot improves your primary metric but causes a secondary KPI to worsen, which trade-offs would be acceptable and which are unacceptable?
Where the Pain Really Hides in Your Workflow
- Which stage of FNOL-to-settlement creates the most rework, cost, or delay for you today?
- Walk us through a recent claim that required multiple supplements or escalations—what caused the divergence from the initial estimate?
- How frequently do initial estimates lead to at least one supplement, and what are the top 2 causes of those supplements?
- Describe the current touchpoints and handoffs with body shops—where do most approvals or disputes occur?
- How do your adjusters describe the emotional toll of rework and bad estimates (frustration, overtime, reduced morale)?
Assumptions We Should Put on the Table
- What’s one assumption about AI-based estimation or photo-first claims you’d be willing to challenge if given credible evidence otherwise?
- Do you assume AI cannot meet adjuster-level accuracy on complex repairs—how have you tested that belief so far?
- Which integrations or data weaknesses have you labeled ‘too hard’ in previous projects?
- Are there regulatory or audit assumptions you’ve made that might be more flexible than you think (e.g., scope of photo evidence, virtual appraisal acceptance)?
- If we presented evidence that contradicted a key assumption, what internal barriers might still stop you from changing course?
The Practical Limits: Tech, Data, and Security
- Which single system or data gap would be a showstopper for integration (i.e., without it a pilot cannot proceed)?
- Please list the claims, billing, shop, and parts systems (with versions) we must integrate with and any access constraints.
- Which data fields are available in real-time versus batched exports (photos, VIN, labor hours, estimates, parts lists)?
- Do you have security or privacy certifications and controls we must meet before receiving test or production data (SOC2, ISO27001, local privacy regs)?
- Have you tried similar integrations previously—what specific blockers or surprises came up during those projects?
What Would Success Feel Like to Your Team (Beyond the Numbers)?
- Beyond hard metrics, what cultural or operational changes would make leadership feel the project was worth it?
- If adjusters regained X minutes per claim or saw fewer escalations, how should that manifest in their daily work and morale?
- How should body shops signal acceptance—faster scheduling, fewer disputes, or explicit partnership metrics? Which do you trust most?
- What non-quantitative signals (e.g., fewer complaint escalations, improved internal narratives) would you include in a success report?
- Which stakeholder groups will need visible, quick wins to stay engaged, and what would those wins look like for each group?
Risk, Governance, and the Red Lines
- What single operational, financial, or regulatory risk would cause you to halt the project immediately?
- What governance structure and cadence do you require during pilot (steering committee, weekly ops, monthly exec review)?
- What contractual protections or KPIs (caps on overpayment, SLA penalties, indemnities) are essential before you sign?
- What rollback or pause criteria must be defined for the pilot to protect your operations and customers?
- Who in legal/procurement/compliance should pre-review draft SOWs to avoid late surprises?
Pilot Scope: Small Enough to Win, Big Enough to Prove
- What minimum claim volume and composition (e.g., low-severity photo claims vs. complex desk-reviews) do you believe are required to demonstrate statistical validity?
- Which lines, geographies, or repair types should we include or explicitly exclude from the first pilot?
- What acceptance criteria do you require at pilot close (accuracy thresholds, supplement rate cap, cycle time target, user satisfaction)?
- Who will be responsible for daily pilot operations, and who signs the formal pilot completion approval?
- What timeline (weeks/months) and sample size would you consider sufficient for a credible go/no-go decision?
Next Steps and How We'll Keep Momentum
- If leadership said yes today, what is the earliest realistic start date for technical onboarding and data sharing?
- What specific internal approvals must we help you prepare (security sign-off, data-sharing agreement, budget request)?
- What materials would make internal approvals easier (pilot SOW template, ROI model with your baselines, technical integration checklist)?
- Who should attend the next working session from your side, and what should they bring (data extracts, system access, decision authority)?
- Are there any unstated concerns or political dynamics we should anticipate so we can address them proactively?
-
Current State Mapping
Document existing FNOL-to-settlement workflows, system integrations, adjuster load, supplement patterns, and body-shop touchpoints.
Current State
Start: How Claims Usually Begin (Quick, real-world snapshot)
- Walk me through the very first hour after FNOL on a recent claim that went well—what happened, who touched it, and how did it move?
- Which channels do customers use to report FNOL most often?
- How many first-notice claims does your team typically handle on an average business day?
- How are photos and VIN data collected today (select all that apply)?
- Tell us about one recent FNOL that surprised you—what made it stand out?
Where Bottlenecks Hide (Which step quietly eats your time and margin?)
- Which single step in your FNOL→settlement flow costs you the most time or money right now, and why do you think it's being tolerated?
- What is your median end-to-end cycle time today for non-total-loss, repairable claims (FNOL → payment/repair start)?
- Where do claims most often stall—triage, appraisal, parts, shop scheduling, rental, or payment?
- How often do you have a claims backlog or surge that requires overtime, temp adjusters, or vendor appraisers?
- Describe a recent bottleneck in enough detail that we could replicate the root cause—what systems, people, and data were involved?
Who's Doing the Heavy Lifting? (Are your adjusters set up to scale?)
- Are your adjusters primarily field, desk, or a mix—and which group is currently most over-capacity?
- On average, how many closed estimate-capable claims does an adjuster close per day?
- Which tasks consume the bulk of adjuster time today (pick top three)?
- How do adjusters feel about automated estimates—skeptical, cautiously optimistic, or eager? Any recent reactions or quotes?
- What training or QA processes support adjuster estimation accuracy today (mentoring, calibration sessions, spot audits)?
Systems and Integration Reality (If the tech layer falters, what breaks first?)
- If your core claims system became unavailable for 24 hours, which downstream capability would you lose first and why?
- Which systems currently integrate with claims workflows (select all that apply)?
- What is the nature of those integrations—real-time APIs, nightly batches, manual CSVs, or spreadsheet handoffs?
- Do we have read/write access to claims records, images, and notes for a pilot? If not, what approvals or contracts stand in the way?
- What data fields or feeds are most fragile or incomplete today (parts list, labor times, VIN decode, prior loss history)?
Body Shops and Repair Partners: What's Their Truth?
- Do your repair partners see your processes as helpful, neutral, or obstructive—and what is the most common shop complaint?
- What percentage of repairs are handled by your preferred network versus arbitrary local shops?
- Which shop workflows are most error-prone: estimate acceptance, scheduling, parts ordering, supplement submission, or final invoicing?
- Do your shops use a BMS—and if so, which vendor(s)? Are they connected to your CMS or are handoffs manual?
- Share a concrete example of a shop-related delay that impacted cycle time or cost—what happened and how was it resolved?
Supplements, Surprises and Escalations (Why do estimates get reopened?)
- When a supplement occurs, what do you blame most: initial estimate error, unseen damage at repair, or shop behavior?
- What proportion of repairable claims generate at least one supplement?
- Average additional days caused by supplements (from repair start to completion)?
- Which types of damage or vehicle classes drive the highest supplement rates (e.g., EVs, heavy trucks, late-model cars, structural damage)?
- Describe a memorable supplement dispute—how did it start, who escalated it, and what was the outcome?
Data Quality: If the Input Is Flawed, the Output Lies
- What percentage of claim photo sets would you classify as high-quality (clear angles, good lighting, required views present)?
- Do you provide photo guidance or templates to customers or shops today? If so, what channels and adoption rates?
- Which data elements are consistently missing or inaccurate that would impede automated estimating (VIN, mileage, prior damage, options package)?
- Do you have labeled historical data (photos mapped to true repairs/invoice) available to share for model validation or training?
- How do you currently verify estimate accuracy—post-repair audits, desk reviews, shop invoices comparison, or another method?
Regulatory, Audit, and Risk Appetite (Could a regulator pause this?)
- Are there regulatory or state-specific restrictions that constrain virtual/photo-only appraisals in your book of business?
- What audit trail and reporting requirements would a new estimation tool need to satisfy for your compliance and audit teams?
- What is your acceptable overpayment tolerance on pilot claims (e.g., $ per claim or % of claims)?
- Have you had regulatory inquiries or litigation related to photo-based claims in the last 3 years? If yes, summarize.
- How important is a fully auditable decision log (images, model scores, adjuster overrides) for rollout approval?
What Success Actually Looks Like (Numbers, leadership expectations, and blind spots)
- If we returned to your executive team in 6 months, which three KPIs would convince them this project is successful?
- What target reduction in cycle time or LAE would be considered a win for a pilot (give percentage or absolute numbers)?
- What accuracy threshold for AI estimates would you require to let them be used for straight-through payment on low-complexity claims?
- Who must sign-off to move from pilot to production (roles, not names)?
- What hidden political or operational risks could sink a pilot even if the numbers look good?
A Tiny, Low-Risk First Step (What would make leadership comfortable to try this?)
- What would a low-friction pilot look like to you—volume, vehicle classes included, geographies, and timeline?
- Which sample size feels reasonable for a pilot to be statistically meaningful but operationally contained?
- What data and system access would you be comfortable granting for a 90-day pilot (images, writeback rights, only read access)?
- Who on your side would we need in the room weekly during a pilot (roles and their primary decision/approvals)?
- What would be an acceptable go / no-go decision gate at pilot end (single KPI or composite), and what thresholds matter?
-
-
Outcome Discovery
Define target reductions in cycle time and LAE, acceptable accuracy thresholds, pilot scope, and regulatory constraints.
Discovery Questions
Quick Snapshot — One‑Minute Baseline
- Who are you and which claims domain do you own or represent?
- Roughly how many vehicle damage claims does your organization handle annually?
- What is your current average end‑to‑end FNOL→settlement cycle time (desk review or photo-first claims)?
- Please provide your current baseline metrics (LAE per claim, supplement rate, current estimator accuracy vs. human) — list numbers or sources.
- Which claims types do you prioritize for straight‑through or photo‑first workflows today?
Are We Being Too Modest About Targets?
- When you hear vendors promise 20–40% faster cycle times or 10–25% LAE reduction, what’s your immediate reaction?
- What reduction in cycle time would meaningfully change business outcomes for you (pick the best fit)?
- What percent reduction in LAE (loss adjustment expense) would justify a technology-led pilot in your view?
- What minimum estimation accuracy vs. your experienced adjusters would you require to run a production‑level straight‑through workflow (choose one)?
- How tolerant are you of occasional overpayments from AI estimates if overall cycle time and customer satisfaction improve?
- Describe any recent internal targets or board expectations tied to claims efficiency or LAE savings.
What Would Winning Feel Like for Your Team?
- Imagine it's 12 months after a successful pilot — what would you see that tells you this was worth doing?
- Which stakeholder outcomes matter most when you think of 'winning' (select up to three)?
- How important is adjuster experience (reduced cognitive load, time per file) compared to hard dollar savings?
- What would an acceptable lift in CSAT or NPS look like for this program to count as a success?
- Which internal audiences must feel wins early for broader adoption (and why)?
What's Standing Between Us and That Outcome?
- Which barrier worries you most about deploying photo-based AI estimation at scale?
- Tell the story of the last time a claims automation project hit a wall — what went wrong and how did it feel?
- How would you rate the current quality and completeness of the photo submission experience from customers and repair partners?
- Which integrations do you anticipate being the hardest (select all that apply)?
- How much internal capacity and executive patience do you have for iterative pilot cycles (weeks/months of tuning, re‑measuring)?
Pilot Reality Check — What Would Convince You?
- What single data point or experiment result would cause you to greenlight production rollout?
- For a pilot, which claim scopes are highest priority to test first?
- What pilot size would feel statistically persuasive to you (select one)?
- Which success metrics must the pilot meet to be considered a win (choose up to three)?
- What acceptance thresholds would you set for estimation accuracy, supplement rate, and cycle time to pass the pilot? Please specify numbers or ranges.
- Who needs to sign the pilot off internally (list roles), and who will be the day‑to‑day owners?
Regulators, Audit Trails and the Red Lines
- If a regulator reviewed your photo‑first playbook, what would they ask for first?
- Are there states, lines, or claim types where photo-only handling is forbidden or heavily restricted in your book of business?
- What documentation, explainability or human‑review controls does your compliance team expect for AI‑based estimates?
- How would you like regulatory risk to be managed between carrier and vendor (options)?
- Have you had any regulatory findings or fines related to claims automation in the past 3 years?
Data & Integration Truths — The Unvarnished Picture
- List the core systems we would need to connect to for a pilot (CMS, BMS examples) and any known integration blockers.
- What is the typical latency and availability of the data feeds needed (claims images, policy data, parts pricing)?
- How complete are your historical labeled datasets (photos + settled estimate) for model validation?
- Are there privacy, vendor access, or firewall requirements that typically add weeks to integration work?
- What team will own data verification and labeling during the pilot (roles & FTE estimate)?
Decision Rules, Governance & Commercial Boundaries
- What is your preferred commercial model for pilots and production (select all that apply)?
- Which governance cadence would give you confidence in an iterative pilot (choose one)?
- What decision gate criteria would trigger a stop, pause, or go‑to‑production decision?
- How quickly do you expect contractual and commercial terms to be agreed once a pilot proves successful?
- What financial guardrails do you require (e.g., caps on overpayments, refund/credit mechanics, SLA credits)?
Emotions, Resistance, and the Hidden Opponents
- Who inside the organization is most likely to resist photo‑first automation and why?
- How do adjusters tend to feel about automation pilots — curiosity, threat, indifference, or something else?
- What communication or change levers have worked best in your org to convert skeptics into adopters?
- Have you had any cultural or political blockers in past automation projects (briefly describe)?
- What would help you sleep better at night about people risk during the pilot?
Next Steps — Practical Commitments to Move Forward
- If we could draft a minimally viable pilot plan right now, which of these start dates would be realistic for your team?
- Which immediate resources can you commit to a pilot (select all that apply)?
- What would be a reasonable first milestone we should aim for (choose one)?
- Who should be the single point of contact (name & role) for day‑to‑day coordination if we proceed?
- What outstanding concerns or questions must be resolved before you can greenlight a pilot?
-
Solution Experience
Walk through how the platform delivers agreed outcomes using the customer’s claims scenarios, focusing on estimation accuracy, integrations, and shop workflows.
Experience Meetings
- Solution Experience Kickoff — Current State & Consequence Confirmation
- Claims Scenario Walkthrough — Proof of Estimation Accuracy
- Integrations & Data Flow Workshop — Proving Operational Continuity
- Shop Workflow Simulation & Body-Shop Acceptance
- Validation & Pilot Success Criteria Alignment — Decision and Next Steps
- Capture required shop onboarding and training items to ensure high initial acceptance.
- One‑Sentence Integration Future State
- Confirm the minimal data model and API interactions required to prove a closed-loop claim flow in the pilot.
- Demonstrate a successful sample ingest/writeback using customer payloads to prove elimination of manual rekey.
- Agree on SLAs, error-handling expectations, and integration responsibilities for pilot execution.
- Customer to provide sandbox API credentials or a test payload schema and a dedicated integration contact.
- Seller to produce an integration checklist with field mappings and test cases for sign-off.
- Schedule an engineering pairing session to complete end-to-end test within agreed timeline.
- Current Shop Process One-Sentence & Pain Points
- Validate that the platform's shop workflows and BMS integrations meet pilot shop operational needs.
- Agree measurable shop-level success signals to include in pilot acceptance criteria.
- Introductions & Meeting Objectives
- Customer to provide contacts and test credentials for 3 pilot shops and BMS vendors.
- Seller to deliver a shop-training checklist and a 30-minute shop onboarding script.
- Agree on shop KPIs for pilot (e.g., >80% acceptance within 24 hrs) and document them in the pilot charter.
- Synthesis of Proof Findings
- Obtain mutual agreement on pilot scope, sample size, duration, and measurable success criteria.
- Secure commitments for required access, resourcing, and governance cadence to run the pilot.
- Create a clear go/no-go decision process with owners and timelines.
- Both parties to sign the pilot charter documenting scope, KPIs, and decision gates within 5 business days.
- Seller to deliver a pilot project plan with milestones, owners, and required deliverables for the first 30 days.
- Customer to allocate a single pilot owner and provide dedicated integration and shop operations points-of-contact.
- A single agreed one-sentence current state describing where the process breaks and who is impacted.
- A quantified consequence statement showing cost/time/risk of the current state.
- A single agreed one-sentence future-state outcome the experience will prove.
- A prioritized list of 3–5 customer claim scenarios to use for live proof.
- Customer to deliver 10 representative claims (photos, adjuster estimates, final settlements) and 90‑day KPI baseline within 3 business days.
- Seller to prepare one-page consequence calculation using provided KPIs and return within 48 hours.
- Schedule the live scenario walkthrough and ensure sandbox and access are provisioned.
- Recap Agreed Problem & Future State
- Prove the platform produces estimates within the agreed accuracy thresholds on representative scenarios.
- Identify and classify the root causes for any estimate variance and decide remediation (model tuning, rules, or process change).
- Obtain SME validation or specific objections that must be addressed prior to pilot sign-off.
- Seller to deliver side-by-side estimate comparisons and a variance report for all walked scenarios within 48 hours.
- Customer to tag and return 20 additional claims of each failure-mode type to be used for model tuning and rules creation.
- Agree numeric acceptance thresholds (e.g., average cost delta %, supplement rate ceiling) and record them for pilot criteria.
- Facilitated One‑Sentence Current State
- Finalize Pilot Scope, Duration & Sample Size
- Live Simulation: Dispatch & Scheduling
- Integration Topology Review
- Live Estimate: Simple Repair Scenario(s)
- Live Payload Simulation
- Live Simulation: Supplement Discovery & Approval
- Set Explicit Success Metrics & Decision Gates
- Live Estimate: Complex / Edge Scenario(s)
- Consequence Quantification
- Governance, Reporting & Roles
- Define Future State (One Sentence)
- Error, Exception & SLA Handling
- Discrepancy Analysis & Root Cause Mapping
- Shop Acceptance Criteria & Training Needs
- Validation & Agreement
- Select & Prioritize Customer Scenarios for Proof
- Capture Operational Changes & Communications Plan
- Integration Rollout Plan & Responsibilities
- Next Steps and Commitments
- Pre-work & Logistics for Live Experience
-
Solution Scope
Define modules, integrations, data requirements, acceptance criteria (e.g., accuracy, supplement rate), and responsibilities for pilot and production.
Scope Configuration
- Automated Photo Damage Estimation
- Triage and Severity Scoring
- Total Loss Valuation (real-time market pricing)
- Line-item Parts Identification and Labor Pricing
- Alternative Parts Recommendation Engine
- Supplement Identification and Lifecycle Tracking
- Virtual Appraisal via Adjuster Portal
- Mobile Photo Capture SDK with Guidance
- Body Shop Management System Integration
- Claims Management System Integration
- Parts Sourcing and Procurement Fulfillment
- Fraud and Anomaly Detection for Photo Claims
- Adjuster Review Workspace with Editable Estimates
- Repair Handoff Package for Repair Facilities
Scope Questions
Automated Photo Damage Estimation
- Do you want automated photo-based damage estimation included in scope?
- What percent of inbound FNOL currently include claimant photos?
- What accuracy threshold vs. current human adjuster benchmarks do you require for automation to be acceptable (e.g., 90% parity)?
- Which vehicle types must the estimator support initially?
- What fallback workflow should trigger when automated estimate confidence is low (e.g., desk review, virtual appraisal, onsite inspection)?
- Are there regulatory or audit acceptance requirements for photo-based estimates we should design to meet (e.g., documented photo retention, timestamping)?
Triage and Severity Scoring
- Do you want automated triage to route claims into straight-through, desk review, or field inspection cohorts?
- What triage categories or severity bands do you currently use or want to use?
- What business rules or thresholds should influence triage decisions (e.g., repair cost estimate, presence of injuries, reserve amount)?
- What acceptable false-positive rate (claims escalated unnecessarily) can you tolerate for triage?
- Which systems must be notified or updated when triage outcome is determined?
- Who owns tuning triage models and updating severity rules post-deployment?
Total Loss Valuation (real-time market pricing)
- Do you want real-time market pricing integrated for total loss valuations?
- Which valuation inputs are required by your teams/regulators (e.g., VIN, mileage, condition factors, market comps)?
- Do you require support for salvage valuation and salvage disposition workflows?
- What tolerance bands or acceptance criteria should be used for market-based valuations (e.g., within +/- X% of accepted comps)?
- Which external data sources or partners must be used or are preferred for market pricing (e.g., VIN desks, auction feeds)?
- Who should sign off on initial total loss rules and appeals (e.g., claims VP, salvage manager)?
Line-item Parts Identification and Labor Pricing
- Do you require automated line-item parts identification and standardized labor pricing?
- Which parts catalogs or labor guides do you use/require (e.g., OEM parts catalog, Mitchell, Audatex, CCC)?
- Do you need differential pricing by region, shop network tier, or contract rates?
- What acceptance criteria for part-match accuracy and labor-time accuracy do you require for go/no-go?
- Are parts substitution rules (e.g., aftermarket vs OEM, remanufactured) governed by policy and should be enforced?
- Who will maintain mapping between platform SKUs and your preferred parts/labor schedules?
Alternative Parts Recommendation Engine
- Should the engine recommend alternative parts (aftermarket, reman, used) vs OEM automatically?
- What substitution rules/policies must be enforced (e.g., safety-critical parts must be OEM)?
- Do you require ROI/cost-savings reporting on alternative parts usage?
- Which suppliers or parts channels must be included for sourcing alternatives?
- Should shops be able to accept or override recommended alternative parts within the platform?
- Do you require provenance and warranty metadata for recommended alternative parts?
Supplement Identification and Lifecycle Tracking
- Do you want automated supplement identification from photos and shop inputs?
- Which supplement lifecycle stages must be tracked (identification, approval, parts order, repair update, settlement)?
- What approval workflows and SLAs apply to supplements?
- What metrics should be captured for supplements (e.g., supplement rate, time-to-approval, cost impact)?
- Should the platform push supplement notifications into your CMS or email/workflow tools?
- Who is responsible for supplement adjudication during pilot and production (vendor vs carrier adjusters)?
Virtual Appraisal via Adjuster Portal
- Do you require a web-based adjuster portal for virtual appraisal and collaboration?
- What user roles and permissions should the portal support (e.g., desk adjuster, supervisor, appraisal manager)?
- Which features are required in the portal: editable estimates, photo annotation, chat, video conferencing, audit trail?
- Do you need integration of portal actions back into your CMS with specific field mappings?
- What performance or SLA expectations exist for adjuster response times in virtual appraisal?
- Will adjuster training or change management be required prior to portal go-live?
Mobile Photo Capture SDK with Guidance
- Do you plan to embed a mobile SDK in your apps/portals to guide claimants or shops when capturing photos?
- What capture guidance features are required (e.g., framing overlays, lighting checks, step-by-step workflow, VIN capture)?
- Which mobile platforms must be supported initially (iOS, Android, web)?
- Do you require secure photo transmission, PII redaction, or encrypted storage per compliance requirements?
- Are there branding or UX requirements that the SDK must conform to?
- What performance metrics will determine SDK acceptance (e.g., % usable photos, capture completion rate)?
Body Shop Management System Integration
- Which Body Shop Management Systems (BMS) must be integrated for dispatching and repair updates?
- What integration patterns are required (real-time API, batch CSV, EDI, webhooks)?
- What data elements must flow to/from the BMS (e.g., estimates, repair status, parts orders, RO numbers)?
- Do shops need the ability to edit estimates, accept assignments, or submit supplements via the integration?
- Are there existing EDI or contractor gateways we must use or replace?
- Who will own troubleshooting and escalation for BMS integration issues?
Claims Management System Integration
- Which Claims Management System(s) must be integrated (vendor and version)?
- What integration scope is required: create/update claim, push notes/attachments, update reserves, close claim?
- What authentication and security models does your CMS require for API integrations (e.g., OAuth2, mutual TLS, API keys)?
- Is real-time sync required or is a scheduled batch acceptable for your workflows?
- Are there field mapping or data governance constraints (PII handling, field length limits) we should know about?
- Who is the primary owner for CMS integration sign-off and testing on the carrier side?
-
Mutual Commit
Finalize commercial terms, SLAs, pilot success metrics, decision gates, and governance cadence.
Agreement Modules
- Statement of Work (SOW)
- Order Form & Commercial Terms
- Service Level Agreement (SLA)
- Pilot Success & Acceptance Criteria
- Governance & Decision Gates
- Data Processing Agreement (DPA) & Privacy
- Security & Compliance Addendum
- Integration & API Access Agreement
- Implementation & Onboarding Plan
- Change Order & Scope Management
- IP License & Usage Rights
- Termination, Exit & Data Return Plan
- Insurance, Indemnity & Liability Schedule
- Shop Adoption & Field Enablement Agreement
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Confirm data feeds, claims system access, shop/BMS integrations, test environments, and compliance controls are in place.
Readiness Questions
Quick Orientation: Who's In the Room?
- Who will be our primary day-to-day deployment contacts from your team (name, role, email)?
- Which executive or committee has final sign‑off authority for pilot go/no-go and production roll‑out?
- What is your target window for pilot start and for first production cutover?
- What business outcomes will justify moving from pilot to production for you (select all that apply)?
- Are there non‑negotiable constraints or blackout dates we should plan around (e.g., blackout for seasonality, regulatory reporting windows)? Please list.
If Deployment Fails, What's the Real Cost?
- What single outcome would make you escalate the program immediately if it occurred during pilot?
- Tell us about one past claims technology deployment that didn’t meet expectations—what went wrong and why?
- How often have integrations with vendors or shops caused schedule slippage in previous projects?
- What is the maximum tolerable outage or data loss window during deployment before leadership requires a stop? (hours/days)
- If the pilot delivered expected accuracy but shops pushed back, which consequence would hurt you most (operational cost, claimant satisfaction, reputational risk, regulatory exposure)?
Where Does Your Data Live—and Is It Ready?
- How confident are you that your claims records, images, and VIN/parts data are production‑quality for automated estimation without major cleansing?
- Which data feeds will we need to ingest for pilot (select all that apply)?
- What formats and transport methods do those feeds use today (e.g., REST JSON, SOAP XML, SFTP CSV, flat files, Kafka)?
- What is the expected daily volume of claims and images in the pilot scope, and how many sample claims can you provide for pre‑integration testing?
- Are there common data quality issues we should expect (missing VIN, low‑res images, incorrect loss codes)? Please provide examples and frequency.
- Do you have a canonical mapping for parts and labor codes that must be preserved, or will mapping be required?
Who Owns the Systems We'll Need to Touch?
- Which internal teams or vendor partners are absolute gatekeepers for integrations and credentials (name teams/contacts)?
- Which claims management systems and versions does your organization use in the pilot population?
- Which body shop management systems (BMS) and shop portals will we need to integrate with for the pilot?
- What integration authentication methods are acceptable for your security team (select all that apply)?
- Who will own change control and approvals for schema or endpoint changes during the pilot?
- Are there third‑party middleware or ESBs that requests must route through (and do they add transformation rules we need to know)?
Can You Imagine a Smooth Test Run? Tell Me About It.
- What would a credible pilot test plan catch before go‑live that current plans might miss?
- Which test environments are available and how closely do they mirror production?
- How many real claims (and images) should we run through the pilot to feel statistically comfortable with accuracy and supplement rate signals?
- Which acceptance criteria will you apply at pilot closure (choose up to three and specify thresholds in the next question)?
- Please specify the numeric thresholds for the acceptance criteria you selected (e.g., accuracy ≥ 90%, supplement rate ≤ 5%).
- Who from claims operations and shops will participate in UAT and sign off on functional acceptance?
What Keeps Your Security & Compliance Team Up at Night?
- Which compliance or regulatory regimes must we satisfy for data handling and AI estimation in your jurisdiction(s)?
- Do you require evidence of third‑party certifications (SOC2 Type II, ISO27001) or penetration test results prior to production access?
- Are there data residency or localization constraints for images, PII, or valuation data?
- What are your encryption requirements for data at rest and in transit?
- What is your breach notification SLA and escalation path we must accept contractually?
- Are there mandatory privacy controls (PII redaction, consent logging, data retention windows) we must implement for the pilot?
Plan B and Post‑Launch: Who's Ready to Act?
- If week one of production shows an unacceptably high supplement rate, what immediate action would you expect us to take?
- What monitoring and reporting would you like to see daily during pilot (select all that matter)?
- What SLA do you require from us for response and resolution during the pilot?
- Who will run daily governance—triage calls, backlog prioritization, and incident reviews—during pilot operations?
- What training and enablement do your adjusters and shops need before go‑live (e.g., role‑based sessions, quick reference guides, co‑pilot support)?
- Describe your rollback/runbook expectations—who initiates rollback, what triggers it, and how do we validate recovery?
-
Deployment Enablement
Schedule tasks, assign owners, coordinate integrations, and train adjusters and pilot shops for go-live.
-
Pilot Validation
Execute pilot, measure estimation accuracy, supplement rates, cycle times, and claimant/shop acceptance against acceptance criteria.
Validation Checklist
Getting Comfortable — a quick share
- Which of the following best describes your primary role in the claims organization?
- Tell us briefly about the parts of your book you oversee (personal vs commercial, vehicle types, annual claim volumes, regions).
- Approximately how many vehicle damage claims does your organization handle per year?
- Who normally attends vendor or pilot decision meetings at your company (select all that apply)?
Are We Missing Millions in Plain Sight?
- When was the last time your team tried to quantify leakage from estimates, supplements, cycle time or shop rework—and what surprised you most?
- Which of these do you believe creates the largest hidden cost today?
- Can you describe a recent claim where an estimate went materially wrong—what happened and what downstream impact did it cause?
- If you had to pick one cost you can’t currently measure but suspect is large, what would you choose and why?
- How does missing that visibility make you feel when you brief your leadership or Board?
Show Me the Hard Numbers
- If someone asked you to prove your estimation process is efficient, which three metrics would you hand them—and why might those still be misleading?
- What is your current baseline for average estimation accuracy (estimate vs final paid) today?
- What is your typical supplement rate (supplements per 100 repairable claims)?
- What is your average cycle time from FNOL to settlement (days)?
- How confident are you in the integrity and completeness of the data that produces these metrics?
- How often do you reconcile estimates against final paid amounts and root-cause the differences?
Who’s Driving — and Who’s Nervous?
- Which stakeholder in your org would be most likely to block photo-based straight-through processing—and what’s the core fear behind that stance?
- Which stakeholders should be considered essential decision-makers for a pilot (pick up to three)?
- How does compliance or internal audit typically evaluate new claims automation (biggest red lines)?
- How do your partner body shops typically react to new digital workflows or remote estimates?
- Who would own day-to-day pilot success (name/role) and who controls the budget for scaling?
When Tech Breaks Trust
- Tell me about the last time a technology pilot eroded trust—what triggered the loss of confidence and how quickly did it spread?
- Which potential failure modes keep you up at night with AI estimation?
- How do you currently resolve disputes between shop repair estimates and carrier estimates?
- What acceptance controls (audit sampling, human-in-loop thresholds, financial recourse) would you require before allowing STH on a segment of claims?
- If a high-profile claimant complaint arose during a pilot, who would be pulled into the response and what outcomes would be unacceptable?
What Would 10% Better Actually Feel Like?
- If estimation accuracy improved by 10% and cycle time fell by 20%, what would be different in your daily operations, team morale, and P&L?
- Which KPIs would you celebrate first as proof the solution is working?
- What are realistic numeric targets you’d accept in a pilot for: estimation accuracy improvement, supplement reduction, and cycle time improvement?
- What hard constraints (regulatory limits, SLAs, audit windows) would prevent you from acting on those gains immediately?
- If the pilot met targets, which rollout path would you prefer?
Trial Without Theater — Designing a Pilot That Actually Proves Value
- What would a pilot need to look like to survive executive scrutiny and a regulator audit—be specific about controls and artifacts?
- Which claim segments would make the most defensible pilot (select all that apply)?
- What minimum sample size and duration would your leadership accept as credible evidence?
- Which system integrations are non-negotiable for the pilot to be believable?
- What concrete acceptance criteria (numeric thresholds, audit rules, escalation paths) would end the pilot as a success?
- Who must sign the pilot off (name/role) and what governance cadence would you require during the pilot?
People, Training, and Shop Adoption
- What would have to be true for your adjusters and partner shops to welcome — rather than resist — this change?
- Which training formats produce the fastest and most durable behavior change for your adjusters?
- How do you typically incentivize shops to adopt new workflows or systems?
- Which adoption signals from shops and claimants would prove behavior change (pick top 3)?
- What ramp timeline feels realistic for training and shop adoption to reach meaningful usage?
Data & Security — the Quiet Gatekeepers
- If your data feeds were evaluated tomorrow for a pilot, what single gap would disqualify you?
- Which of these data feeds can you realistically provide within 30 days?
- Are any of your feeds subject to special consent or regulatory restrictions we need to plan for?
- Which security or privacy certifications do you require for vendors?
- What is your preferred approach to test environments and synthetic data during pilot validation?
Deciding Together — Next Steps & Hidden Risks
- What’s the single question your CFO or legal will ask after this conversation that we should answer first?
- What remaining objections—internal or external—could realistically derail a pilot in the next 30 days?
- Which artifacts would make the decision easy for you (pick all that apply)?
- Who should be included in the next meeting to clear those objections (name/role) and what is their availability in the next 2 weeks?
- What would make you feel confident committing to a pilot within 30 days (concrete must-haves)?
-
-
Success
Confirm outcomes vs. success signals, capture learnings, and maintain a shared backlog for issues and enhancements.
Success Reviews
- Pilot Success Review & Validation
- Lessons Learned & Retrospective
- Shared Backlog Grooming & Prioritization
- Executive Outcomes & ROI Review
- Governance Rhythm & Continuous Improvement Cadence
Issues & Enhancements
- Confirm executive sponsor and formalize the steering committee membership.
- Ensure each backlog item maps to a clear business consequence and expected benefit when resolved.
- Define the release plan and SLAs for addressing high-severity items.
- Create epics/tickets in the delivery tool for all prioritized items, including evidence and acceptance criteria.
- Assign delivery owners and draft timelines for the next two sprint/releases.
- Set up an automated dashboard feed for backlog health and SLA adherence.
- Schedule targeted validation sessions for each major fix with sample claims and metric checks.
- One-sentence Current State & Consequence
- Secure executive-level decision to proceed with production rollout, extend pilot, or halt.
- Obtain commitment for required funding, resources, and governance support.
- Align on high-level rollout timeline, success metrics, and executive sponsor responsibilities.
- Deliver a board-ready ROI and risk summary deck with recommended decision and ask.
- Introductions & Objectives
- Finalize commercial amendments or SLAs required for production contract.
- Schedule the production kickoff date contingent on executive approval.
- Proposed Governance Model & RACI
- Establish clear governance, reporting, and escalation paths to sustain and improve outcomes.
- Agree a repeatable continuous-improvement process tied to measurable KPIs and backlog management.
- Lock in meeting cadence and owners so decisions and actions move forward without delay.
- Publish governance RACI and distribute to all stakeholders.
- Implement the production KPI dashboard with automated feeds and alerts.
- Create the CI process documentation (SOP) and integrate it with the backlog tool.
- Schedule recurring governance meetings and invite confirmed owners.
- Determine whether the pilot met each agreed success signal and acceptance criterion.
- Validate platform outputs against real claims samples and secure stakeholder confirmation.
- Agree on clear next steps (remediate, extend pilot, or move to production) with owners and deadlines.
- Publish final pilot results report with variance analysis and distribute to stakeholders.
- Create remediation tickets for any failing acceptance criteria and assign owners with target dates.
- Schedule a follow-up validation run (date and scope) if pilot extension is required.
- Prepare executive summary for decision-makers (one-page ROI + risks) ahead of the executive review.
- Purpose & Timeline Review
- Create a prioritized list of root causes with clear corrective actions and owners.
- Quantify the consequence of failures so remediation can be prioritized by business impact.
- Agree a validation plan to confirm corrective actions resolve the underlying issues.
- Publish a formal Lessons Learned document with root causes, actions, owners and target completion dates.
- Update operational runbooks and adjuster/shop training materials to reflect agreed process changes.
- Create measurement tests to validate fixes (sample claims, metric thresholds) and schedule validation sessions.
- Log all lessons as backlog items with severity, expected ROI, and test acceptance criteria.
- Backlog Intake & Triage Criteria
- Produce a prioritized backlog with owners, effort estimates, and agreed acceptance criteria for top items.
- Review New Items from Pilot
- Recap of Agreed Success Signals
- What Worked / What Didn't (Data-driven)
- Pilot Outcome Summary vs Business Case
- KPIs & Dashboard Cadence
- Prioritization & Costing
- CI Process: Backlog → Release → Validation
- Pilot Metrics Presentation
- Risk, Compliance & Shop Adoption Status
- Consequence Assessment
- Define Acceptance Criteria & Test Plans
- Gap Analysis & Root-Cause Highlights
- Escalation Paths & SLA Targets
- Root Cause Analysis (5 Whys / Fishbone)
- Scale Recommendation & Investment Ask
- Release Planning & SLAs
- Meeting Cadence & Action Owner Scheduling
- Define Preventive & Corrective Actions
- Decision Gates & Governance
- Live Sample Validation (Diagnosis → Proof → Validation)