Benefits Administration
Multi-agency, multi-stakeholder programs where procurement, compliance, and mission alignment determine success.
Inside this journey
-
Pre-Discovery
Align the room on outcomes, decision process, and constraints before deeper discovery.
-
Stakeholder Alignment
Confirm decision roles, federal/state accountability, timeline, and acceptable risk thresholds before deeper discovery.
Alignment Questions
Start With Your One-Line: What’s the real urgency?
- In one sentence, why are you exploring a new eligibility and enrollment solution right now?
- How fast does leadership expect measurable improvement (e.g., weeks, months)?
- Who is ultimately accountable to the governor for meeting these goals?
- Which trigger best describes your situation right now?
- What outcome would make you say, in three months, 'this decision was the right call'?
Are You Comfortable Leaving Payments to Chance?
- If you had to name the single biggest risk to uninterrupted benefit payments during transition, what would it be?
- How often in the past 12 months have timeliness or accuracy failures resulted in corrective action or formal findings?
- Describe a recent incident where a system or process change nearly caused payment disruption—what happened and who felt the impact?
- What level of short-term risk is acceptable during transition, if it accelerates long-term compliance? (Select one.)
- Which stakeholders would elevate any sign of payment disruption immediately? (Select all that apply.)
- How would missed payments or audit findings feel politically and operationally for your team?
What’s Hidden in the COBOL Black Box?
- Which legacy behaviors or business rules do you suspect exist only in COBOL code and nowhere in documentation?
- Which of these legacy artifacts currently drive decisions in your day-to-day operations?
- How frequently do caseworkers apply manual overrides or exceptions because the system doesn’t match policy?
- List two edge-case scenarios you worry a new rules engine might not replicate correctly.
- Have data conversions or feeds failed in past modernizations? If yes, what patterns repeated?
- How would you prioritize undocumented rules, data cleanup, and infrastructure stabilization (rank short answer)?
Who Really Pulls the Levers and Signs Off?
- Who will say 'go' or 'stop' for each of these areas: policy interpretation, technical acceptance, federal reporting, and public communications?
- Which groups must be included in approval gates for design or cutover? (Select all that apply.)
- How do you currently document who is accountable for an eligibility decision when multiple parties are involved?
- Describe political or federal sensitivities we should know about up front (e.g., upcoming audits, elections, new federal guidance).
- Who in your team would be the most resistant to outsourcing parts of eligibility operations, and why?
If Washington Said 'Fixed', What Would That Actually Be?
- What specific accuracy and timeliness thresholds would satisfy federal reviewers in your view?
- Which citizen experience signals matter most to you—what should improve for people calling or applying?
- What audit artifacts or outputs must be produced end-to-end to satisfy the federal team?
- If the governor asked you to point to one metric in 6 months to prove success, which metric would you choose and why?
- What trade-offs would you accept between speed, accuracy, and scope during transition?
How Will Your People Live Through This Change?
- If we asked your front-line staff how they feel about modernization, what three words would they use?
- What is your current caseworker-to-workload ratio and how flexible is it during surge?
- How do new policies, exceptions, or system quirks get taught to staff today?
- What would make your staff trust a vendor’s contact center or BPO agents to handle sensitive eligibility conversations?
- How high is turnover among experienced eligibility staff, and what typically causes departures?
- What training cadence and competency checks would you require before we route live cases to external agents?
Can a New Rules Engine Recreate Your Worst Edge Cases?
- Which three legacy scenarios keep you awake because they’re hard to model in a rules engine?
- How important is transparency into decision logic (explainability) for auditors and supervisors?
- What data sources must the new system ingest and reconcile on day one?
- Have you previously tested rule parity between legacy and modern systems? What were the failure modes?
- What level of manual review do you expect to keep after cutover for high-risk cases?
What Would a Safe Cutover Plan Have to Include?
- What concrete rollback triggers would immediately stop a cutover and revert to legacy processing?
- Which of the following must remain uninterrupted during cutover?
- What surge scenarios should we rehearse in parallel runs (select all that apply)?
- Who will own daily cutover coordination across agencies and vendors (name/role)?
- What communications cadence and audience segmentation would you require during cutover?
Money, Contracts, and Guarantees — What Really Matters?
- Which contract levers are non-negotiable for you (select all that apply)?
- Do you prefer penalties for missing SLAs, incentives for exceeding them, or a blend?
- How important is vendor staffing continuity (same supervisors/SMEs) during the first 12 months?
- Are there procurement or state law constraints we must design around (e.g., pay structure, background checks, residency)?
- What would constitute an unambiguous mutual commit from your side (e.g., funding authorization, data access, program approval)?
What Evidence Would Let You Say ‘Go’ Next Week?
- If we provided three artifacts next week, which would matter most: parity test run, staffed surge plan, or a draft SLA—rank your top pick?
- Who must be at the table for a 60–90 minute decision workshop to move forward (roles/emails if possible)?
- What calendar windows are off-limits due to audits, elections, or fiscal deadlines in the next 6 months?
- What blockers would prevent quick engagement (e.g., pending RFP, budget hold, legal review)?
- How would you like us to demonstrate respect for your constraints while rapidly validating feasibility—what’s a reasonable first milestone?
-
Current State Mapping
Document legacy COBOL behaviors, edge cases, caseworker capacity, infrastructure limits, and failure modes affecting payments and timeliness.
Current State
Tell Us About the World You're Running Today
- In one or two sentences, how would you describe today’s eligibility platform and operations?
- Which public assistance programs does this system currently serve? (select all that apply)
- How long has your COBOL-based system been the authoritative source for eligibility?
- Which operational outcomes are causing the most immediate pain right now? (select up to three)
- Who is the single point owner for payment timeliness and system uptime inside your agency?
- When you picture this environment succeeding for the governor and citizens, what three signals would you expect to see?
What Legacy Rules Keep Breaking Assumptions?
- Which legacy rule behaviors are you quietly relying on that no one can fully explain?
- Can you name specific legacy rules or hard-coded exceptions that regularly produce unexpected outcomes?
- How often do these legacy behaviors create exceptions that require manual overrides?
- Do you have up-to-date documentation (decision tables, flow diagrams, business rules) for those behaviors?
- When legacy logic diverges from written policy, which wins today—system behavior or policy guidance?
- If we had to reproduce every legacy exception exactly, which three would you rank highest priority and why?
Where Do Edge Cases Hide and How Often Do They Bite?
- Which rare scenarios take disproportionate staff time or trigger most escalations?
- Which of these edge-case categories apply in your caseload? (select all that apply)
- Approximately what percent of your active cases fall into those edge-case buckets?
- Tell a recent story of a single edge case that escalated to leadership or the governor’s office—what happened and why?
- How does the current system surface or flag these cases for specialized handling?
- What workarounds do staff use today to resolve these exceptions, and how fragile are those workarounds?
Who's Holding the Work — People, Shifts, and Burnout
- Are you unintentionally relying on heroic staff to keep payments on time?
- How many full-time equivalent caseworkers are processing eligibility actions today (give best estimate)?
- What is your annual frontline turnover rate for eligibility staff?
- How do you currently onboard and certify staff on complex policy and system navigation?
- When staffing gaps appear, what short-term fixes are used and how do those affect accuracy or timeliness?
- How do your caseworkers describe their day—overwhelmed, empowered, or something else?
If the System Stutters, Who Pays the Price?
- How close has a system slowdown or outage come to triggering a missed federal timeliness standard in the last 24 months?
- List recent incidents that impacted payments or reporting in the last two years—what failed and for how long?
- What are your recovery time (RTO) and recovery point (RPO) targets for eligibility services?
- How do you handle peak-volume events today (e.g., disasters, mass layoffs)?
- Which monitoring and alerting tools are in place to detect failures that affect payments?
- Who is notified when a payment-impacting failure occurs and what is the escalation path?
Paper Trails, Data Gaps, and the Secrets They Hide
- Which data elements do you not trust, and what happens operationally when they’re incorrect?
- Rate the reliability of these core data domains in your system
- How are external interfaces and batch feeds (TANF, unemployment, federal sources) managed and reconciled?
- Have you attempted a data conversion or migration before? What failed or surprised you about that effort?
- How frequently do you reconcile operational case outcomes to federal reporting extracts?
- What percentage of cases require manual data correction before being reportable?
What Would Put Federal Auditors and the Governor at Ease?
- If federal auditors came tomorrow, what single evidence item would you struggle to produce?
- Which federal reporting outputs give you the most anxiety (select all that apply)?
- What controls and attestations are currently in place to prove accuracy and timeliness?
- How would missing a key federal metric affect your political leadership or corrective action status?
- What evidence or capability would make you comfortable committing to a modernization timeline?
- Which audit trails or artifacts are easiest for you to produce today, and which are the hardest?
What Would Break This Project in the First 12 Months?
- If you had to name one early failure that would be politically catastrophic, what would it be?
- Which of these risks feel most likely to occur during transition? (select top three)
- What explicit rollback triggers or acceptance criteria would you insist on for a full cutover?
- Who are the internal and external stakeholders who must be engaged during month-by-month progress (list roles)?
- What three mitigations would make you say 'go' on an aggressive 12-month improvement mandate?
- Which early wins could we deliver in the first 90 days to reduce political and operational risk?
-
-
Outcome Discovery
Define required accuracy, timeliness, citizen satisfaction, audit acceptance criteria, and what ‘good’ looks like for the governor’s office.
Discovery Questions
Start With the Governor's 'North Star'
- Who on your leadership team is the primary decision owner for this modernization (who signs the final acceptance)?
- Which of the following outcomes would the governor describe as top priority (select all that apply)?
- Write a single-sentence ‘success statement’ you believe the governor would use to describe a successful transition.
- How tolerant is the governor's office for short-term errors or exceptions during cutover?
- What program or political deadlines are immovable (legislative sessions, federal reporting dates, elections) that we must build around?
- List the people or roles who must receive daily status vs weekly briefings vs only exception-based updates.
If Payments Slip, Who Gets Blamed First?
- Imagine payments are delayed for two weeks during cutover—what is the worst-case political or operational fallout you can foresee?
- Which external parties are likely to escalate fastest if problems appear (select all that apply)?
- How quickly do you expect public inquiries, press, or elected officials to react after a noticeable program failure?
- Recall a past incident where public pressure forced a rapid course correction—what made that event unavoidable and what would you want done differently now?
- Which mitigations would you find acceptable if a problem reached the public (select all that apply)?
- How would you like escalation triggers and notification channels structured so your team feels in control during an incident?
What If 98% Isn’t Good Enough?
- If an auditor or the governor's office concluded that a 98% first‑pass accuracy still caused systemic harm, what would that imply about acceptable performance for you?
- What minimum first-pass accuracy range would be politically and operationally acceptable for your program?
- Which kinds of errors cause the most damage for your population (select all that apply)?
- How would you like errors to be triaged and reported during parallel run (what fields must each error record include)?
- Provide three representative case examples (IDs or short descriptions) that must be correct from day one and explain why each matters.
- What statistical confidence levels or sample sizes do your auditors or QA teams expect when validating reported accuracy?
When Is 'Late' a Crisis, Not an Inconvenience?
- If timeliness slipped by one week, who would suffer most and why—beneficiaries, counties, federal partners, or the governor's credibility?
- Which federal timeliness standards are non-negotiable for your programs (select all that apply)?
- What backlog threshold (by case count or average days overdue) should automatically trigger a formal incident response?
- Describe the last time timeliness standards were missed—what operational failures caused the miss and how were they resolved?
- During an emergency surge (natural disaster, pandemic), what timeliness compromises, if any, are you willing to accept and under what governance?
- Who on your side can authorize a formal waiver or exception to timeliness SLAs, and what documentation will they require?
Would an Auditor Smile or Raise a Red Flag?
- If a federal auditor walked into the operations room today, what specific weaknesses would likely draw criticism?
- Which audit artifacts must be producible on demand (select all that apply)?
- How have prior audit findings reshaped your required controls—are there mandatory checkpoints or approvals we must replicate?
- Historically, what tolerance for missing or late audit evidence has been accepted (percent of cases or days)?
- Who will be our official point of contact for audit responses and federal inquiries?
- What remediation timeline do auditors expect for critical findings (30/60/90 days or other)?
What Will Citizens Say About the New System?
- If a long‑time beneficiary called angry after being incorrectly denied, what would an ideal agent interaction look like—tone, steps, and resolution?
- Which citizen experience metrics matter most to your leadership (select all that apply)?
- What CSAT or complaint levels would satisfy political leadership—do you have numerical targets?
- Describe the plain-language and cultural expectations you have for contact center interactions (tone, complexity of explanations, escalation style).
- What languages, accessibility supports, or specialized competencies must the contact center cover at launch (select all that apply)?
- How should case-level escalations from citizens be routed between contractor and agency to balance speed and oversight?
Which Legacy Quirks Will Break Us?
- Which COBOL-era edge cases or local conventions do you believe a modern rules engine will struggle to reproduce?
- Roughly how many undocumented or locally customized rules and overrides do you estimate exist today?
- Describe a decision or exception that only a human currently understands—how is it detected and applied?
- Which data quality problems force manual workarounds most often (select all that apply)?
- Would you accept a staged approach where certain edge cases are handled manually while automation ramps up?
- Which local or county partners have bespoke processes we must mirror or coordinate with during transition?
If We Pass Metrics but the Governor Is Unhappy, What Then?
- What non-metric outcomes (political optics, equity impacts, community trust) would lead leadership to call the project a failure even if SLAs are met?
- Who must sign final acceptance after parallel run completes (select one)?
- Which dashboards, reports, or alerts will give you day‑to‑day confidence after cutover (select all that apply)?
- How long do you expect to monitor parallel operations (and by what criteria will you approve full cutover)?
- If we need an emergency rollback, what immediate actions should be taken (select all that apply)?
- Who must approve an emergency rollback and what documentation or evidence will they require to make that decision?
-
Solution Experience
Walk through how modernization, the rules engine, BPO, and contact center operations deliver the agreed outcomes using the customer’s real surge and edge-case scenarios.
Experience Meetings
- Solution Experience Kickoff — Current State & Consequence Alignment
- Scenario Validation Workshop — Live Surge & Edge-Case Walkthroughs
- Rules Engine Proof Session — Traceability & Parity
- End-to-End Operations Rehearsal — BPO, Contact Center & Reporting
- Acceptance Criteria & Mutual Validation — Consolidation and Sign-off
- Seller to finalize surge playbook with staffing rosters and escalation contacts.
- Seller to deliver a rule-mapping workbook showing legacy-to-modern logic, test results, and remediation notes.
- Customer to sign or mark as pending the rule outcomes for tested cases with commentary.
- Agree deadlines for rule updates and schedule a re-test session.
- Document remaining high-risk rule gaps that require parallel-run monitoring.
- Runbook & Surge Playbook Review
- Validate that operational playbooks and staffing meet surge response and timeliness requirements.
- Confirm contact center agents and BPO processes correctly apply policy and reduce manual caseworker rework.
- Demonstrate federal reporting outputs meet format and timeliness expectations.
- Identify operational improvements and assign owners for implementation prior to parallel run.
- Introductions & Objectives
- Customer to validate federal reporting samples and confirm acceptance criteria.
- Operational leads to implement dashboard metrics for timeliness and accuracy and share access.
- Schedule a follow-up readiness checkpoint after operational changes are applied.
- Consolidated Evidence Review
- Agree a concrete set of measurable acceptance criteria and SLA thresholds for parallel run and cutover.
- Consolidate and archive proof artifacts demonstrating readiness against the future-state definition.
- Document all remaining gaps with owners and deadlines and secure mutual commitments to remediation.
- Establish the validation gate schedule and responsibilities for entering parallel processing.
- Produce and distribute the Acceptance Pack containing test logs, rule-workbooks, runbook, and agreed SLAs.
- Customer and Seller to sign an agreed acceptance checklist or record objections with remediation dates.
- Schedule the parallel-run start date and intermediate checkpoints with clear success gates.
- Assign monitoring dashboard owners and ensure access for customer stakeholders.
- Lock a single clear current-state sentence that everyone concurs is accurate.
- Quantify the consequences of the current state with 2–3 measurable metrics.
- Agree one operational future-state sentence that defines success for the governor/commissioner.
- Produce an agreed list of prioritized scenarios and required data extracts for simulations.
- Assign owners and deadlines for pre-work to enable the first live simulation.
- Customer to deliver anonymized sample cases and data extracts for the prioritized scenarios (deadline: X)
- Seller to produce the confirmed one-sentence current and future state wording and distribute for sign-off.
- Create a scenario test matrix mapping each scenario to expected success signals and deliver to attendees.
- Schedule the Scenario Validation Workshop and reserve simulation environment.
- Recap Preconditions & Success Signals
- Observe and record how the full solution handles prioritized surge scenarios end-to-end.
- Validate whether outcomes meet the customer-defined future state and where they fall short.
- Identify and prioritize failure modes with measurable impact on consequence metrics.
- Capture explicit customer validation or corrections for each scenario run.
- Assign remediation owners and schedule the rule-proofing cadence.
- Seller to provide simulation logs and an exception report for each executed scenario.
- Customer to annotate any scenario outcomes that do not match expectations with specifics and regulatory concerns.
- Create prioritized remediation backlog with owners and target dates for rule fixes or operational changes.
- Confirm next Rules Engine Proof Session date to validate remediations.
- One-line Rule Parity Statement
- Demonstrate rule-level parity or operational equivalence for prioritized edge cases.
- Provide traceable evidence linking rule logic to observed decisions.
- Enumerate and prioritize rule mismatches with quantified consequence and remediation plan.
- Obtain explicit customer validation or documented non-acceptance for each tested rule outcome.
- One-sentence Current State
- Live Contact Center & BPO Surge Rehearsal
- Measure Outcomes vs Success Signals
- Rule Traceability Walkthrough
- Surge Scenario Walkthroughs (live/runbook)
- Live Execution on Customer Cases
- Define Measurable Acceptance Criteria & SLAs
- QA, Sampling, and Exception Handling
- Consequence Quantification
- Edge-case Storyboards & Live Executions
- Remediation Plan & Owner Commitments
- Federal Reporting & Timeliness Proof
- Tie Outcomes to Consequences
-
Solution Scope
Specify modules (rules engine, BPO, contact center, QA, reporting), responsibilities, parallel run approach, and measurable acceptance criteria.
Scope Configuration
- Migrate COBOL Eligibility Rules to Rules Engine
- Deploy Cloud-Based Benefits Application Platform
- Integrate Identity Proofing and Document Upload
- Operate 24/7 Program-Trained Contact Center
- Process Automated First-Pass Eligibility Determinations
- Handle Manual Complex Eligibility Casework
- Generate Federal-Compliant Notices and Letters
- Run Parallel Processing with Legacy System
- Execute Bulk Backlog Clearance Operations
- Submit Federal Timeliness and Accuracy Reports
- Operate Scaled Surge Capacity for Emergencies
- Deliver Plain-Language Agent Eligibility Scripts
Scope Questions
Migrate COBOL Eligibility Rules to Rules Engine
- Do you require a full-line-by-line parity migration of COBOL rules or prioritized/phase-based migration?
- How many unique rules, decision tables, or COBOL programs must be analyzed and migrated?
- Are there documented legacy edge cases, handwritten policy notes, or ad-hoc fixes that must be captured?
- What rule parity acceptance threshold do you require during parallel validation (e.g., percentage of identical outcomes)?
- Do you need traceability that links each rules-engine decision back to original COBOL source lines or policy references?
- Who will own final sign-off for migrated rules (state policy team, vendor, third-party auditor, combined)?
- Do you require training and handover materials for state staff to maintain rules post-cutover?
Deploy Cloud-Based Benefits Application Platform
- Which cloud deployment model do you require for the platform?
- What data residency or state-hosting requirements must be met?
- What uptime and SLA targets do you require (monthly availability percentage)?
- Which existing systems must integrate in deployment (legacy eligibility, MMIS, payment engine, case management)?
- Are there specific security or compliance standards required (FedRAMP, HIPAA, CJIS, FISMA)?
- Do you require a dedicated sandbox and data-masked test environments for verification prior to parallel run?
- What performance benchmarks must the platform meet (transactions per hour, response time under load)?
Integrate Identity Proofing and Document Upload
- Do you require identity proofing to specific assurance levels (e.g., IAL2, IAL3)?
- What document types and formats must be supported for upload (IDs, income, residency, PDFs, images)?
- Is automated OCR and classification required, or will uploads be manually reviewed by staff?
- Are there state-specific accessibility or multilingual requirements for the upload/user flow?
- Do you require integration with third-party identity verification vendors or use the vendor's built-in solution?
- What retention and legal-hold policies apply to uploaded documents?
- What fraud-detection thresholds or manual review triggers should be configured for identity transactions?
Operate 24/7 Program-Trained Contact Center
- Do you require 24/7 coverage from day one or phased scaling to 24/7?
- What program areas must agents be trained on (SNAP, TANF, Medicaid, UI, child care)?
- Which channels must be supported (phone, chat, email, SMS, video)?
- What SLA for average speed-to-answer and abandonment rates do you require?
- Do agents need the ability to view eligibility decision traces and reconciled case history while assisting callers?
- Are background checks, certifications, or state-specific clearances required for contact center staff?
- Do you require workforce management reporting and SLA dashboards accessible to state owners?
Process Automated First-Pass Eligibility Determinations
- What target first-pass accuracy rate is required for automated determinations?
- Which programs and benefit types should be included in automated first-pass?
- Do automated determinations require human-in-the-loop review for specific trigger conditions?
- What data quality thresholds (completeness, verification flags) must be met to allow auto-decisioning?
- Do you require audit logs and explainability for every automated decision?
- How should exceptions be routed (contact center, specialized team, queue)?
- Are there federal reporting or certification gates required before automated determinations can be used operationally?
Handle Manual Complex Eligibility Casework
- What categories of cases are considered 'complex' and require manual handling (e.g., inter-state, appeals, fraud investigations)?
- What target SLA do you require for resolution of complex cases?
- Who will perform manual complex work: vendor BPO staff, state caseworkers, or a hybrid model?
- Do manual caseworkers need access to the rules engine debug/tracing tools and decision audit logs?
- What training level and certification are required for manual caseworkers handling complex cases?
- How should workload be prioritized during backlogs or surge (oldest-first, severity, risk-based)?
- Do you require separate QA sampling rules for manual complex casework vs automated decisions?
Generate Federal-Compliant Notices and Letters
- Which notice types must be generated (eligibility determinations, denials, renewals, adverse actions)?
- Do notices need to meet specific federal templates and language requirements?
- Which delivery channels are required (mail, email, SMS, portal inbox)?
- Do you require multilingual notice generation and certified translations?
- What acceptance criteria (format, legal language, timestamps) must notices pass before being sent?
- Should notices be version-controlled and auditable for federal review?
- Who approves final notice templates: state legal, policy, or vendor content team?
Run Parallel Processing with Legacy System
- What parallel run duration do you expect (months)?
- What reconciliation frequency and tolerance do you require between legacy and new system outputs?
- What acceptance thresholds determine when cutover can proceed (e.g., parity rate, error volume)?
- Who will own reconciliation exceptions and remediation (state, vendor, joint team)?
- Do you require automated reconciliation dashboards and daily exception exports?
- Will legacy system data be continuously synced, or will extracts be used for parallel processing?
- Are there federal audit checkpoints during parallel that must be documented and reported?
Execute Bulk Backlog Clearance Operations
- What is the estimated backlog volume to be cleared (cases per week/month)?
- Do backlog cases require special handling (aging priority, eligibility re-determination, fraud review)?
- What target throughput should vendor teams meet during backlog operations?
- Will backlog clearance run in parallel with normal operations or be a dedicated surge effort?
-
Mutual Commit
Finalize contract modules, SLAs for accuracy and timeliness, staffing guarantees, federal reporting obligations, and escalation paths.
Agreement Modules
- Statement of Work (SOW)
- Master Services Agreement (MSA)
- Service Level Agreement (SLA) - Accuracy & Timeliness
- Staffing & Resourcing Guarantee
- Federal Reporting & Audit Obligations
- Escalation & Governance Plan
- Pricing, Payment Schedule & Invoicing
- Performance Remedies & Liquidated Damages
- Data Security & Privacy Addendum (DPA)
- Transition & Parallel-Run Acceptance Criteria
- Acceptance Test Plan & Reporting
- Change Control & Scope Modification Agreement
- Subcontracting & BPO Staffing Plan
- Training & Knowledge Transfer Commitment
- Termination, Exit & Data Return Plan
- Insurance, Indemnity & Liability
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Confirm data conversions, access, knowledge transfer, parallel-processing plans, surge playbooks, and rollback triggers are in place.
Readiness Questions
Quick Check — Who’s in the Room?
- Which role best describes your participation in this readiness planning?
- Which stakeholders must explicitly approve go/no-go for deployment readiness?
- What firm dates or windows constrain your cutover planning (e.g., federal deadlines, fiscal milestones)?
- Who will serve as the day-to-day readiness lead we coordinate with during parallel operations?
- What is your single biggest fear about the deployment that you’d want us to address first?
If We Cutover Tomorrow, What Would Break?
- What hidden dependency — a system, report, or manual step — would most likely interrupt benefit payments if it failed at cutover?
- Which legacy COBOL behaviors or business rules do you currently rely on that are hard to find in documentation?
- Which edge-case categories cause the most variance in decisions today?
- How often do these edge cases occur and what percent of throughput do they represent?
- Can you share a recent example where a failure mode led to a missed federal timeliness or accuracy target? What happened?
How Confident Are You in Your Data?
- What proportion of your case and eligibility data do you expect will require cleansing or transformation before the cutover?
- Which of these data issues are present today that could derail conversions?
- What sample datasets can you provide for mapping and validation (scope, formats, frequency)?
- Who owns the authoritative source for each critical data domain (eligibility, payments, case notes, audit logs)?
- How would you prioritize data correctness vs. expediency if we had to choose during conversion (e.g., delay cutover to fix data or proceed and remediate post-cutover)?
If Your SMEs Were Gone Tomorrow, Could You Survive?
- If your three most experienced policy SMEs were unavailable during launch, how would you expect complex adjudications to be handled?
- Which knowledge-transfer assets currently exist and which are missing (e.g., runbooks, decision trees, recorded shadow sessions)?
- What proportion of your frontline caseworkers regularly handle edge cases versus scripted routinized work?
- How do you currently measure caseworker competency and how often are performance assessments performed?
- What retention or staffing risks should we plan for during training and the parallel period (e.g., seasonal turnover, collective bargaining restrictions)?
What Would a Surge Really Look Like — and Who Breaks First?
- At what multiplier of baseline volume (e.g., 2x, 3x) have you historically seen critical failures or missed timeliness?
- Which components do you believe are most fragile under surge: intake, rules processing, payments, QA, or contact center?
- What surge triggers are realistic for your program (natural disaster, policy change, eligibility expansion, corrective action deadline)?
- Do you have existing surge playbooks and have they been exercised in the last 24 months?
- What maximum acceptable response times and SLA targets must hold during a 3x surge to avoid federal penalties?
Parallel Run — Will Two Systems Create Reconciliation Chaos?
- What reconciliation cadence would you prefer during parallel operations: daily, weekly, or event-driven?
- Which acceptance gates should determine when a case moves from legacy to new platform (e.g., accuracy threshold, audit signoff, user competency)?
- What reconciliation methods do you currently use or prefer (automated diff tools, manual audits, sampling)?
- How many parallel run iterations do you expect before full cutover, and over what timeframe?
- What team or role will own day-to-day reconciliation and exception resolution during parallel?
If We Ever Had to Roll Back, How Fast Must We Be?
- What is the maximum acceptable exposure window (hours/days) before federal timeliness or payment integrity consequences occur?
- What concrete rollback triggers would you require (e.g., payment errors above X%, outage affecting Y% of users)?
- Who has final authority to approve an emergency rollback and what communication chain should be triggered?
- How many rollback rehearsals would you expect before go-live (none, 1, multiple) and in what environments should they run?
- What data synchronization or reprocessing steps worry you most during a rollback (payments, appeals, audit logs)?
What Metric Will Make the Governor Sleep at Night?
- Which single outcome would you use to declare deployment success publicly (e.g., 98% accuracy, 95% on-time payments, zero material audit findings)?
- Which federal reporting outputs must exactly match legacy reports, and are there any tolerances for format or timing differences?
- What level of evidence (test results, sample audits, federal pre-acceptance) do you require before signing full cutover acceptance?
- How should we handle continuous improvement post-cutover—regular retrospective cadence, shared issue tracker, or an ongoing governance board?
- Who will be accountable for documenting lessons learned and maintaining the shared enhancement backlog after deployment?
-
Deployment Enablement
Schedule cutover tasks, run parallel operations, validate surge capacity, and coordinate owners with integrated Gantt timelines.
-
Validation Checklist
Verify accuracy benchmarks, timeliness metrics, caseworker competency, and federal reporting outputs before full cutover.
Validation Questions
Start With the Big Picture — Who You Serve and Why It Matters
- Which benefit programs are you most urgently focused on modernizing right now?
- How would you describe, in one sentence, the specific problem that keeps you up at night about this program?
- Who in your agency is ultimately accountable to the governor for program performance and federal timeliness?
- What recent trigger prompted you to consider a modernization partner now (select all that apply)?
- When you think about stakeholders—Governor’s office, federal partners, caseworkers—what single concern do you hear most often from them?
- How soon does leadership expect measurable improvements (e.g., accuracy, timeliness) after a partner is selected?
Are You Comfortable Letting 'Good Enough' Keep You Vulnerable?
- If you had to name one assumption your team keeps making about current performance that might be wrong, what would it be?
- How frequently have you experienced federal findings or corrective actions related to eligibility accuracy or timeliness in the last three years?
- What’s the emotional climate when corrective action is discussed—defensive, resigned, urgent, crisis-driven, or something else?
- How does a missed timeliness target actually impact real people in your state—describe a recent example if available.
- What accuracy and timeliness thresholds would make federal auditors pause or withdraw an escalation?
Where Do Your Legacy Systems Secretly Break Trust?
- How often do legacy COBOL rules produce incorrect determinations that only show up after federal reporting—daily, weekly, monthly, or less?
- Which failure modes from the legacy stack have the biggest downstream impact (select up to three)?
- Tell us about an edge case that the current system gets wrong or that your team still treats as a manual workaround.
- Do you have historical logs, test cases, and known edge-case datasets available for vendor validation, and where do they live?
- How do current infrastructure limits (CPU, batch windows, network) shape when and how determinations run?
Who Really Calls the Shots When Decisions Matter?
- If we had to deliver a change that affects eligibility rules, who signs off at the state level—and who needs to be informed at the federal level?
- Where do decision bottlenecks usually occur—policy interpretation, legal review, procurement, IT change control, or stakeholder alignment?
- What is your internal decision timeline for contracting and implementation approval (weeks/months)?
- How comfortable are your subject-matter experts explaining complex policy decisions to non-technical stakeholders (e.g., governor’s office or auditors)?
- Who would be our primary day-to-day contacts for rules, QA, reporting, and escalation during transition?
When the System Is Overwhelmed, Who Suffers—and How Fast?
- When a sudden surge occurs (e.g., disaster, economic shock), how many times normal volume have you experienced?
- What are the first three operational signs you see that indicate you are hitting capacity limits?
- How does backlog manifest—longer call wait times, increased manual reviews, missed payments, or other failures?
- Describe the last time you executed an emergency surge play—what worked, what failed, and how long did recovery take?
- Which surge mitigations are available today (select all that apply)?
If the Governor Asked You What 'Good' Looks Like, What Would You Say?
- What three measurable outcomes would satisfy the governor’s office (rank or list in order of importance)?
- Which federal metrics are non-negotiable for you—accuracy, timeliness, audit acceptance, or something else?
- What’s an acceptable tradeoff, if any, between reaching perfect accuracy immediately versus guaranteeing uninterrupted payments during transition?
- How would you like citizens’ experience to change—faster decisions, clearer communications, fewer manual calls, or other improvements?
- What sample success signal would you want to see within the first 90 days of a parallel run?
What Would a Vendor Absolutely Have to Promise to Make You Sleep at Night?
- Which contractual guarantees matter most to you—accuracy SLAs, staffing levels, reporting fidelity, or financial penalties?
- What minimum accuracy and timeliness SLA thresholds would you require in a contract?
- How important is vendor transparency—daily dashboards, audit logs, and open-book QA—to your decision?
- If a vendor proposed a financial penalty for missed SLA, what type of remedy would feel proportionate to you?
- Which federal reporting obligations must be explicitly covered in the vendor SOW (select all that apply)?
Can We Recreate The Weirdest, Most Painful Cases Before Cutover?
- What are the top five edge-case scenarios that, if missed, would trigger federal scrutiny or a public outcry?
- Do you have anonymized case files or synthetic datasets for each edge case, and can those be used by a vendor in testing?
- How do you currently validate rule changes—peer review, SME sign-off, parallel-processing comparison, or other?
- What acceptance criteria would you require before a vendor’s rules engine is allowed to handle live cases (examples: match rate, false positive rate)?
- Who in your organization would be responsible for certifying that edge cases are handled correctly during transition?
What Would a Safe Transition Actually Look Like Day-to-Day?
- How do you feel about a year-long parallel run—comforting safeguard or unacceptable delay?
- Which day-one operational items must be in place before you allow any vendor-handled determinations to touch live payments?
- What rollback triggers would force you to revert to legacy processing during or after cutover?
- How would you prefer escalation to work during cutover—daily war room, weekly steering meetings, or automated alerting with named contacts?
- What training, shadowing, or certification would you require for vendor staff who will touch complex eligibility decisions?
What Would Make You Confident To Move Forward — Right Now?
- What are the top three deal-breakers that would stop you from selecting a vendor today?
- Which evidence would most convince you—live throughput demos, audited performance reports, references from similar states, or a short pilot?
- If we proposed a 90-day pilot with defined acceptance criteria, what would you require to feel that pilot was meaningful?
- Realistically, who needs to be on the approval chain for a contracting decision, and what would make them say yes?
- Finally, what immediate next step would you prefer—detailed SOW draft, technical deep dive with your SMEs, or a small-scale pilot design?
-
-
Success
Review outcomes against success signals, capture lessons learned, and maintain a shared channel for issues and enhancements.
Success Reviews
- Success Signals Review
- Lessons Learned & Continuous Improvement Workshop
- Federal Reporting & Audit Readiness Review
- Operational Handover & Sustained Support Planning
- Open Issues & Enhancements Triage (Recurring)
Issues & Enhancements
- Establish the sustained support cadence and shared channel governance.
- Schedule the first Continuous Improvement sprint kickoff and the monthly retrospective cadence.
- Recap Federal Obligations & Acceptable Artifacts
- Confirm which federal reporting items are complete and which require remediation.
- Agree a concrete, timebound remediation plan to close audit gaps.
- Establish a clear handoff and communication path for federal auditors.
- Assemble and deliver the audit evidence packet for agreed items by the committed date.
- Assign a single federal-audit liaison with contact details and escalation authority.
- Log remaining audit gaps in the CAP tracker with owners, actions, and verification steps.
- Handover Status Summary
- Ensure the state has access to all runbooks, knowledge artifacts, and trained staff needed to operate.
- Confirm surge and rollback plans are understood and actionable by named owners.
- Introductions & Objectives
- Provide final runbook repository access and ensure all key personnel have credentials.
- Conduct a cross-check training session for identified critical caseworker and contact center roles within 30 days.
- Create the shared channel, populate participant list, and post initial triage rules and SLAs.
- Review of Critical Open Incidents
- Reduce the open critical-incident list and ensure no item threatens payments or federal compliance.
- Maintain a prioritized enhancement backlog with clear owners and delivery SLAs.
- Keep executive stakeholders informed of any high-risk items and planned mitigations.
- Update the issue tracker with new priorities, owners, and SLA dates within 24 hours.
- Notify executive sponsors of any items that require contractual changes or additional funding.
- Prepare a brief status memo for the governor's office and federal liaison for any item with potential audit impact.
- Confirm whether the deployment meets the contract and governor-level success signals.
- Surface and quantify any remaining gaps that threaten payments or federal acceptance.
- Agree remediation owners, timelines, and a re-check cadence for conditional acceptance.
- Create a single, auditable record of acceptance decisions and evidence references.
- Produce and distribute the final KPI evidence packet (metrics, QA samples, federal extracts) with annotated pass/fail markers.
- Document each gap with owner, root cause summary, remediation plan, and due date in the shared tracker.
- Schedule the conditional-acceptance re-check meeting (if required) and invite federal liaison and governor's office rep as appropriate.
- Pre-work Review & Framing
- Document a comprehensive list of lessons with evidence and root causes.
- Create a prioritized improvement backlog with owners and target dates.
- Establish governance and cadence for implementing and validating fixes.
- Publish the lessons-learned report and prioritized backlog to the shared channel and issue tracker.
- Assign owners and target completion dates for all top-tier improvements (top 5).
- Recap of Agreed Success Signals
- Enhancement Backlog Prioritization
- Staffing & Competency Validation
- Review Submitted Reports & Discrepancies
- Timeline Review (What happened when)
- Audit Evidence Package Checklist
- Surge & Rollback Playbook Review
- Owner Assignment & SLA Commitments
- What Worked / What Didn't (Breakouts)
- Evidence Walkthrough: Metrics & Artifacts
- Risks & Dependencies Review
- Gap Analysis & Root Cause Summary
- Remediation Plan for Open Audit Items
- Root Cause Synthesis & Quick Wins
- SLA Operations & Escalation Paths
- Acceptance Determination & Next Steps
- Prioritization & Backlog Formation
- Sign-off Path & Communication to Federal Stakeholders
- Confirm Next Steps & Communication
- Shared Channel & Governance for Issues/Enhancements
- Governance for Continuous Improvement
- Close & Action Confirmation