Consumer Research
New business and client engagements where creative vision, strategy alignment, and multi-stakeholder approval determine outcomes.
Inside this journey
-
Pre-Discovery
Align stakeholders on objectives, decision roles, and timelines before scoping research.
-
Stakeholder Alignment
Confirm decision roles, timeline, success signals, and political risks before scoping research.
Alignment Questions
Quick hello: the setup that saves us both time
- To get us started, please tell us your role and the primary team you'll be representing in this research conversation
- Which industry best describes your business unit for this project?
- What triggered you to engage research right now? (pick the closest match)
- Roughly what budget band are you planning to allocate for the pilot research (estimate is fine)?
- When would you need pilot findings in hand to influence the next business decision or gate?
Who's got the veto? Let’s map the real power dynamics
- If someone walked into the room tomorrow and said 'stop this study', who would that person be?
- Who are the three people whose buy-in matters most for this project to be adopted and acted upon?
- How do those stakeholders typically evaluate external research (what convinces them)?
- What internal politics or past decisions might push this study off the rails if the findings are inconvenient?
- Who will be the formal sign-off owner for accepting the pilot and greenlighting a full study?
Which assumptions are we about to challenge (and who might resist)?
- Name one widely held assumption about your customers or market that you suspect might be wrong
- Which internal narratives would be most threatened if the research showed a different truth?
- How have your teams reacted the last time research contradicted a preferred plan?
- Who on your team is best positioned to champion uncomfortable findings and make them actionable?
What’s hiding in your existing evidence — and why hasn’t it helped?
- Which sources of customer evidence do you currently rely on most?
- How recent and relevant are those sources for the question we're about to answer?
- Tell us about a time those sources led you to a wrong or incomplete decision—what happened and why did it stick out?
- What failure modes have you seen in past research that we must avoid (sampling skew, leading questions, low response quality, executive discomfort with results, other)?
- If we could only fix one thing about your current evidence ecosystem, what would you prioritize?
If one question could change the roadmap, what would it be?
- What is the single business question you need this pilot to answer to move money or headcount?
- Which customer segments matter most to that question?
- What would success look like numerically or behaviorally for this question (e.g., conversion lift %, willingness-to-pay $ amount, share shift)?
- Are there hypotheses you want us to test explicitly (priority list)?
- Which competitor moves or market signals should we hold constant versus treat as variables?
How will the evidence make someone do something different (and who)?
- What are the concrete decisions that will be made from the pilot findings (pick all that apply)?
- For each decision you selected, what acceptance criteria would convince you to act (specific numbers, segments, or behavioral signals)?
- How will recommendations need to be packaged for cross-functional adoption (e.g., 1-page brief, workshop, executive memo)?
- If the pilot delivers clear directional evidence but not definitive numbers, would you move to a larger study or pause?
What would make you mistrust the sample, right away?
- Which sampling sources do you prefer or require (pick all that apply)?
- Are there hard quotas or demographic/behavioral filters we must hit for findings to be credible?
- What minimum sample size or statistical confidence would you accept for the pilot?
- Do you have any geographic, language, or platform constraints we must honor?
- What contingency would you expect if recruitment slows or quotas aren't met?
Design choices that separate noise from action—let's get specific
- Which mixed-method balance do you prefer for this pilot (quantitative scale vs. qualitative depth)?
- What instruments are you most comfortable with us using (pick all that apply)?
- How prescriptive do you want our acceptance criteria to be in the pilot scope (e.g., flat thresholds vs. directional recommendations)?
- What are the non-negotiables in deliverables (e.g., topline, methodology appendix, raw data)?
Timeline, commitments and what breaks the schedule
- What is the absolute latest date when findings must be delivered to avoid missing your business gate?
- Which milestone, if missed, would most likely kill the project (kickoff, recruitment, pilot completion, stakeholder review)?
- Who needs to be present at the final readout to ensure the recommended actions stick?
- What commercial or procurement steps must happen before we can start fieldwork?
How risky is it to surface honest answers here — and where do you stand?
- If the data points strongly against a preferred internal idea, what is the likely reaction?
- How comfortable is leadership with making decisions based on pilot-level evidence versus waiting for larger studies?
- What safeguards would increase your confidence that controversial findings will be accepted (e.g., replication plan, stakeholder workshop, joint analysis review)?
- What would a successful collaborative process look like to you during the study (communication cadence, checkpoints, stakeholders involved)?
Final check: the first three practical next steps we should lock in
- Of these, which one action must we complete in the next 48 hours to keep momentum?
- Which two people should be on the core project team for rapid decisions (name + role)?
- Is there anything we haven’t asked that would materially affect scope, timeline, or credibility?
- How would you prefer we follow up after you submit this discovery—synchronous call, short draft scope, or a workshop to align stakeholders?
-
Current State Mapping
Document existing evidence sources, recent findings, and failure modes that the research must address.
Current State
Quick tour: What evidence do you already have?
- How recently has a formal research effort (survey, qual study, analytics deep-dive) been completed that influenced a product or marketing decision?
- Which of these evidence sources are actively used today?
- Who on your team typically consumes those findings and turns them into action?
- Briefly describe the single most recent study or data point you leaned on for a decision and the decision it informed.
- Which parts of your current evidence feel worth preserving versus what you believe must change?
Why isn’t what you know actually changing decisions?
- When research falls flat in your org, what usually explains why leaders ignore it?
- Tell us about one time a study's results were dismissed—what specifically was challenged and by whom?
- Which of these descriptions matches the tone of pushback you most often hear?
- How does it feel internally when evidence is sidelined—frustration, relief, defensiveness, or something else? Give a brief example.
- If we could remove one common reason studies are ignored in your organization, which would move the needle most?
Where the data quietly fails us
- Which failure mode causes the most harm in past studies (pick the top two)?
- How often have you discovered after fieldwork that the recruited profile didn’t match the brief?
- Describe a concrete consequence of a failed sample or bad instrument (e.g., wasted launch budget, delayed gate, internal dispute).
- Which quantitative checks would make you relax about representativeness before analysis (choose all that apply)?
- On a scale from 1–5, how risky is an underpowered or biased study for your next decision?
Who’s listening — and who’s quietly blocking?
- If this study had to land a cross-functional decision, who would be the hardest person to convince?
- Who has previously championed research outcomes in your org—and what did they do differently?
- Are there political dynamics or incentives that typically bias how results are interpreted (e.g., attribution to prior programs, budget protection)?
- Which stakeholder groups must be engaged before fieldwork starts to prevent post-study disputes?
- What format of delivery convinces your toughest skeptics (one-pager with next steps, raw tables, workshop walk-through, interactive dashboard)?
What would actually convince you—no spin, just evidence
- Which of the following outcomes would make you say 'this research changed our decision'?
- What quantitative thresholds do you need to see to consider a finding reliable (minimum n, confidence interval, effect size)?
- How much methodological transparency do you require in the final deliverable (detailed appendix, summary only, raw data access)?
- If a pilot and a full study were proposed, which pilot outcomes would be non-negotiable to proceed to full scale?
- What timeline boundary must we respect to hit your internal gate or budget decision?
Hidden assumptions we must test (so you don’t get surprised)
- What are the top three assumptions your team is making about the target consumer or market that, if wrong, break the plan?
- Which one of those assumptions would you call 'mission-critical'—the single hypothesis we should try to falsify first?
- Have prior studies ever overturned a core assumption? Tell us what happened and how the team reacted.
- Which behavioral measures (actual purchase, intent, simulated choice) are essential to test those assumptions?
- What would be an acceptable early-warning signal in the pilot that says 'we’re on the wrong track'?
Locking down practicalities so fieldwork won’t fail
- Which recruitment sources are acceptable to you (panel vendors, customer database, intercept, social ads)?
- Are there privacy, legal, or compliance constraints we must design around (e.g., no third‑party data, GDPR, internal consent requirements)?
- What quota logic or subgroups are essential to include to make results defensible at the decision moment?
- What incentive structure has worked or failed before for your targets (cash, gift, sweepstakes, charitable donation)?
- What contingency would you want in place if initial recruitment lags or a key subgroup under-recruits?
- Are there technical or platform requirements for surveys/interviews (mobile-first, language support, integrations with analytics tools)?
Agreeing next steps: what sign-offs will make this study unstoppable?
- Who needs to sign off on the final scope before we launch (names or roles)?
- What budget or procurement constraints should we build into the proposal right away?
- Which success signal at the end of the engagement will trigger budget approval for follow-on work?
- How do you prefer to stay updated during fieldwork to avoid surprises (weekly snapshots, live dashboard, ad‑hoc alerts)?
- Is there anything else we should know now to prevent the common failure modes we discussed?
-
-
Research Objectives & Success Signals
Define the specific business question(s), target segments, and measurable indicators that will prove actionability.
Discovery Questions
Quick Snapshot: What Brought You Here?
- What single event or decision triggered you to seek research right now?
- Which decision or gate will this research feed directly into?
- Roughly where are you in the decision timeline?
- Who will actively use the findings day-to-day (names/roles)?
- Do you have recent internal or external research we should read before designing?
Why This Question Matters Right Now
- If you had to bet the business on one insight from this study, what would it be—and why would it change the course?
- Which business metric would signal our work succeeded?
- What's the current baseline for that metric (number or estimate)?
- What happens to the project or budget if findings are inconclusive or contradictory?
- Who is the ultimate decision owner, and who needs to be persuaded along the way?
Are We Measuring the Right Thing?
- What would we need to see in the results that would force you to change strategy—even if it contradicts current beliefs?
- Which of these success signals would you treat as primary evidence?
- What's your minimum acceptable effect size or practical benchmark (e.g., X% lift, Y pt difference)?
- What confidence level or statistical rigor do you expect (if quantitative)?
- How quickly do you need to observe an impact after implementation to consider it valid?
Who Exactly Counts as 'Customer'?
- Who do you currently define as the target consumer or cohort—and why might that definition be wrong?
- Which segmentation dimensions matter most for this question?
- How many distinct segments would you want confidently profiled in the final deliverable?
- What minimum sample size per priority segment feels defensible to your stakeholders?
- Do we need to recruit from specific panels, partner lists, or do custom recruitment?
What Would Make Findings Unquestionable?
- What methodological shortcomings would cause you to disregard the study outright?
- Which fieldwork modes do you consider acceptable for credibility?
- Which QA or fraud-detection checks are non-negotiable (pick all that apply)?
- Do you require an independent audit or third-party replication before acting?
- Share an example of a past research you or your team rejected — what specifically failed?
What’s Getting in the Way — Political & Organizational Risks
- Which teams or leaders would most likely push back on findings, and why?
- How entrenched are current assumptions you might challenge (mild, strong, core belief)?
- What mitigation do you prefer if findings threaten an internal position (pre-briefs, phased release, anonymized quotes)?
- Are there legal, compliance, or competitor constraints we must avoid mentioning or measuring?
- If leadership rejects evidence, what escalation path would salvage decision integrity?
Timing, Gates & Decision Mechanics
- If we miss the next gate, who pays the largest price and what is that price?
- What is the non-negotiable date for having actionable findings in hand?
- Which internal milestones should our deliverables map to (e.g., product review, pricing committee)?
- What acceptance criteria will the decision board use to say 'this is good enough'?
- Do you prefer a staged pilot-first approach or a one-shot full study?
Budget, Commercials & Commitment Signals
- Would you trade depth for speed or speed for depth on this project?
- What is the budget range you have in mind for a pilot that would convince you of vendor competency?
- Are there procurement or contractual constraints we should plan for?
- What commercial terms would speed a yes from procurement (payment terms, pilot pricing, cancellation terms)?
- What would you personally need to feel comfortable authorizing a pilot today?
From Results to Action: How Will You Use This?
- What format and level of synthesis will drive decisions (e.g., 2-page brief, full slide deck, workshop facilitation)?
- Which stakeholders need to attend the findings session to avoid later pushback?
- Do you want us to provide prioritized recommendations tied to cost and implementation complexity?
- Would you value a hands-on workshop to translate findings into a concrete go-to-market plan?
- How will success be measured after actions are taken (who tracks and how)?
Operational Readiness & Integration Details
- Do you have internal data sources we should integrate (CRM, sales, usage analytics)?
- Are there IT, security, or privacy processes that could delay our fieldwork or data transfer?
- Who will be our day-to-day contact for scheduling, approvals, and clarifications?
- Do you expect to require raw data deliverables, or only synthesized outputs?
- How would you like progress communicated (weekly emails, standups, dashboards)?
Final Check: Anything We’re Missing?
- What's the one thing you're worried we'd fail to ask that would later undermine the research?
- Are there sensitive topics or language we should avoid in recruitment or reporting?
- Would you like a short internal pre-brief with key stakeholders before fielding?
- Is there anything else (documents, contacts, constraints) we should have before we scope the pilot?
-
Solution Experience
Walk through how our mixed-method design (pilot + full approach) will deliver the precise evidence and decisions you need.
Experience Meetings
- Solution Experience: Current State & Consequence Alignment
- Pilot Design Walkthrough — Diagnosis & Proof
- Full Study Blueprint — Scaling from Pilot to Action
- Decision Readout Rehearsal & Validation Workshop
- Seller & Customer: Agree on the acceptance checklist that will determine whether recommendations are actionable.
- Establish timeline and immediate next steps to start pilot fielding.
- Seller: Finalize pilot instruments (screener, guide, survey) incorporating validation feedback and circulate for sign-off.
- Customer: Confirm quota specs, recruitment sources, and any blacklists/brand sensitivities.
- Seller: Produce a one-page Decision Gate checklist that maps pilot evidence to go/no-go criteria.
- Pilot Learnings & Implications (short)
- Agree the full-study scope and the concrete linkage between each deliverable and an explicit business decision.
- Confirm the analysis approach that will reduce outputs to two-to-three actionable insights.
- Lock acceptance criteria and risk mitigations that protect sample quality and timeline.
- Align milestone dates to the customer's product/board decision gates.
- Seller: Draft full-study SOW that maps deliverables to decision gates and include accepted acceptance criteria.
- Customer: Share downstream decision calendar and stakeholder reviewers for final alignment.
- Seller: Prepare a contingency plan for recruitment shortfalls and propose alternate panels or boosted sampling.
- Objective & Audience Check
- Ensure the readout narrative proves the future state and directly ties to the stated consequence reduction.
- Receive explicit validation from key stakeholders on the interpretation of evidence and proposed decisions.
- Confirm owners, timelines, and materials for the executive decision readout.
- Identify any final data or QA needs before the formal readout.
- Seller: Produce a tight four-slide readout template mapped to problem → evidence → decision → owner.
- Customer: Confirm decision-maker attendance and provide any required pre-reads or contextual slides.
- Introductions & Objectives
- Produce a single accepted sentence describing the current state.
- Document the explicit consequence(s) of the current state with a business-oriented estimate (cost/time/risk).
- Agree a one-sentence future-state outcome that the research must prove enables.
- Identify any missing evidence or stakeholders required before the Solution Experience demo can proceed.
- Customer: Finalize and circulate the one-sentence current state and consequence estimate (owner: insight director).
- Seller: Capture finalized future-state sentence and add to the Solution Experience brief.
- Seller: List outstanding evidence gaps and owners to provide missing data before the pilot walkthrough.
- Recap Preconditions
- Agree the pilot hypothesis and the explicit decisions the pilot will enable.
- Confirm the mixed-method components and what exact evidence each will produce (no feature wandering).
- Lock sampling and acceptance criteria to ensure pilot outputs will be defensible to stakeholders.
- Full Study Design Overview
- Mock Readout: Evidence → Decision Narrative
- One-sentence Current State (Customer Read)
- Pilot Objectives & Decision Gate
- Analysis Plan: Triangulation & Insight Reduction
- Facilitated Clarification of Current State
- Probe & Force Validation
- Mixed-method Plan: What each method proves
- Acceptance Criteria & Risk Controls
- Action Mapping & Owner Commitments
- Quantify the Consequence
- Instruments & Key Measures
- Readout Logistics & Final QA
- Define the Future State (One Sentence)
- Mapping Findings to Business Actions
- Sampling, Quotas & Representativeness
- Validation & Sign-off
- Pilot Deliverables, Timelines & Decision Criteria
- Timeline, Commercials & Decision Gates
- Force Validation Q&A
-
Solution Scope
Define deliverables, sampling strategy, instruments, timelines, and acceptance criteria to ensure representative, action-ready findings.
Scope Configuration
- Field online quantitative survey (up to 1,000 respondents)
- Conduct 8–12 in-depth qualitative interviews
- Run 6 live moderated focus groups
- Execute remote ethnographic observation sessions
- Deliver discrete-choice conjoint analysis
- Perform price-sensitivity (PSM) and willingness-to-pay analysis
- Develop behavioral segmentation and persona profiles
- Deliver stimulus testing for product and creative concepts
- Run A/B or field experiment (behavioral test)
- Conduct usability testing with think-aloud protocol
- Produce executive slide deck with top recommendations
- Provide raw dataset, codebook, and weighting specifications
Scope Questions
Field online quantitative survey (up to 1,000 respondents)
- What is the primary target population for the online survey?
- What sample size do you expect within the up-to-1,000 cap?
- Are there hard quotas or nested quotas required (e.g., by region, ethnicity, usage)?
- Which metrics must be captured in the survey (select all that apply)?
- Do you require panel-only respondents or are customer lists/CRM invites acceptable?
- What is the desired timeline from design to final dataset?
- Are there any mandatory questions, regulatory wording, or translations required?
Conduct 8–12 in-depth qualitative interviews
- Which respondent profile(s) should be interviewed (e.g., heavy users, defectors)?
- What interview length do you prefer?
- Do interviews need to be recorded and transcribed verbatim?
- Should interviews be remote, in-person, or client-observed?
- Are there sensitive topics or consent/privacy constraints interviewers must follow?
- What deliverables do you expect from the qual interviews (e.g., clips, transcripts, highlight reel)?
- When should interviews be completed relative to other workstreams?
Run 6 live moderated focus groups
- Do you prefer online focus groups, in-person facility groups, or mobile ethnography-style groups?
- How should participants be grouped (e.g., by segment, attitudinal cluster, demographic)?
- What is the desired duration per group session?
- Do you require live streaming or client observation with chat-enabled moderation?
- What moderator role and materials are required (e.g., discussion guide, stimuli, exercises)?
- Are incentives and screening complexity expected to be high (hard-to-reach respondents)?
- What outcomes will determine whether focus groups are successful for your team?
Execute remote ethnographic observation sessions
- What contexts should be observed (home, in-store, on-device, workplace)?
- How many observation sessions do you expect (typical session length)?
- Do you require participant-run video diaries or moderated live observation?
- Are there privacy/permission constraints or sensitive environments to consider?
- Should observations include follow-up interviews or contextual probing?
- What outputs do you need (video highlights, annotated field notes, opportunity map)?
- Is there a preferred recruitment source or screening criteria for observational participants?
Deliver discrete-choice conjoint analysis
- Do you have a pre-defined set of attributes and levels or need help building them?
- What is the target sample for the conjoint (estimate size)?
- Is pricing an attribute in the design or should it be modeled post-hoc?
- Do you require hierarchical/Bayesian utilities, simulated market share, or segmentation-ready outputs?
- Which experimental design do you prefer (full-profile, CBC, menu-based, adaptive)?
- What business decisions will rely on the conjoint results (pricing, feature trade-offs, product lineup)?
- Are there constraints on attribute combinations we must enforce (e.g., infeasible pairs)?
Perform price-sensitivity (PSM) and willingness-to-pay analysis
- Which pricing methods are you interested in (van Westendorp/PSM, Gabor-Granger, auction-based)?
- What price range or competitive price points should be tested?
- Is the objective revenue optimization, share maximization, or willingness-to-pay estimation?
- Do you need segmentation of price sensitivity (e.g., personas that differ by WTP)?
- Will pricing tests be run in isolation or combined with concept/stimulus testing?
- Should we model promotional/discount scenarios and elasticity?
- Are there legal/regulatory constraints on price claims or required disclaimers?
Develop behavioral segmentation and persona profiles
- What inputs are available for segmentation (survey items, behavioral logs, purchase history)?
- What is the intended number of segments (if any) or do you want an algorithmic recommendation?
- Do you require persona narratives, marketing playbooks, and segment sizing estimates?
- Should segmentation be validated against holdout or behavioral data?
- Do you need predictive scoring to assign new customers to segments?
- What deliverable format do you prefer for personas (one-page profiles, slide deck, raw segment assignments)?
Deliver stimulus testing for product and creative concepts
- What types of stimuli will be tested (images, videos, package mockups, ad copy, landing pages)?
- How many distinct concepts/stimuli do you plan to test in one study?
- Which response metrics are required (awareness, believability, purchase intent, emotional resonance)?
- Do you prefer monadic, sequential monadic, or paired-comparison test designs?
- Are attention and manipulation checks required for each stimulus exposure?
- Will creative optimization require margin-of-error targets for subgroup comparisons?
- Do you need qualitative follow-up (open-ends or micro-interviews) to explain quantitative scores?
Run A/B or field experiment (behavioral test)
- What is the primary behavioral KPI for the experiment (click-through, conversion, retention)?
- What is the intended experimental unit for randomization?
- Do you have the technical capability to implement randomization/treatment (e.g., website tag, app variant)?
- What minimum detectable effect or power targets do you require?
- How long can the experiment run to achieve required sample sizes?
-
Mutual Commit
Confirm pilot scope, commercial terms, decision gates, and responsibilities to lock the project timeline and review process.
Agreement Modules
- Statement of Work (SOW)
- Commercial Proposal & Payment Schedule
- Master Services Agreement (MSA)
- Non-Disclosure Agreement (NDA)
- Data Processing & Privacy Addendum (DPA)
- Pilot Scope Addendum
- Decision Gate & Acceptance Criteria
- Roles & Responsibilities (RACI) Agreement
- Change Order & Scope Management
- Timeline & Milestone Commitment
- Recruitment & Panel Access Agreement
- Intellectual Property & Deliverable Rights
- Termination & Cancellation Terms
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Recruitment Readiness
Validate screener logic, quotas, panels, and contingency plans to prevent non-representative samples and schedule slips.
Readiness Questions
Quick roll call — who should show up?
- Describe the single most important audience we must recruit for this study (title, behavior, purchase role, and why they matter).
- Which of the following attributes are absolute musts for respondents?
- How confident are you that existing labels (e.g., 'heavy user', 'occasional buyer') accurately map to the customer behavior we need to study?
- Who in your organization will be the single point of truth for resolving conflicting recruitment trade-offs?
What if your 'target' isn't actually the group making the call?
- If the people we recruit can't actually move the decision you're trying to inform, how would that change the value of this research?
- Who influences the decision you care about (e.g., final approver, budget owner, procurement), and how long have they been excluded from your assumptions?
- Are there secondary segments we should include as comparison cells because their behavior often contradicts your primary target?
- How much would you tolerate broadened criteria to preserve representativeness (e.g., relax recency from 3 months to 6 months)?
Are your screener questions quietly shrinking the audience?
- Please paste or summarize the current screener logic you plan to use (key inclusion/exclusion rules and critical branches).
- Which screening criteria do you consider negotiable if a cell is underperforming?
- How long should the screener take on average (seconds or minutes) to avoid drop-off and satisficing?
- Are there sensitive or legally constrained questions (health, financial, identity) that require special wording or consent?
Quotas: real guardrails or a feel-good checklist?
- Which quota types must be enforced to consider the sample representative?
- What is the minimum acceptable n per quota cell before you’d consider combining or relaxing quotas?
- If a lower-priority quota is blocking recruitment, which should be deprioritized first?
- Are there weighting rules you'd accept post-fielding to correct imbalances, or must raw quotas be met?
Where will we actually find them — panels, partners, or your CRM?
- Which sourcing channels are acceptable for recruitment in this study?
- Have you had prior experiences (good or bad) with any suppliers we should avoid or prefer?
- Do we need signed data-sharing agreements or vendor approvals before fielding begins?
- What panel metadata do you require to validate quality (e.g., recruitment source, geo IP, time to complete, device)?
Screener fatigue, bots, and speeders — are we prepared?
- What minimum attention-check strategy would make you confident responses are genuine?
- Which automated quality filters are mandatory to reject respondents (e.g., <50% median time, duplicate IPs, straightlining)?
- How quickly should we escalate suspected panel or bot issues to your team?
- Tell us about a past quality failure — what happened and how long did it take to recover?
What if recruitment stalls — do we have a contingency playbook?
- At what point do you want us to trigger contingency actions (e.g., % of target unmet by day X)?
- Which contingency tactics are you willing to approve if cells underperform?
- Are there substitution rules we must follow (e.g., replace non-qualifying by adjacent quota only)?
- Who must sign off on contingency changes outside the original SOW?
Timing is the hidden risk — can your timeline tolerate slips?
- What is the immovable deadline (decision gate, launch, board review) that the research must feed?
- What is the latest acceptable date for full data delivery before the decision becomes compromised?
- Which fielding windows are off-limits (holidays, major industry events, fiscal close)?
- Would you prefer a faster, smaller pilot for proof-of-method before committing to full fielding?
How will we prove the sample is believable to skeptics?
- Which QC evidences would settle internal skeptics (e.g., raw panelist lists, paradata, device/IP logs, screener summary)?
- What benchmarks or external data sources should our sample align to (e.g., national census, category purchase incidence)?
- If representativeness falls short in one cell, do you prefer refielding that cell, weighting, or transparent caveats in reporting?
- Who in your stakeholder group will require demonstrated QC before accepting findings?
Money talks — are incentives realistic for the audience?
- What is the total incentive budget per completed respondent you’ve allocated (or target incentive range)?
- Are incentives distributed as cash, e-gift, points, or charitable donations? Any restrictions?
- Would you approve higher incentives for hard-to-reach quotas (e.g., niche professionals, low-prevalence groups)?
- Do your procurement or compliance rules limit incentive types or require vendor receipts?
Who owns final verdicts — and how will disagreements be resolved?
- Who will sign off on the final sample and acceptance criteria before analysis begins?
- If the vendor recommends deviating from the original plan to protect representativeness, who has authority to approve that change?
- What format of recruitment updates would help you feel in control (daily dashboard, mid-field check, weekly calls)?
- If late-breaking evidence suggests the sample won't support the decision, what escalation steps do you want us to take?
Pilot test — are we ready to run a smaller dress rehearsal?
- Would you like a pilot focused on recruitment validation (screener efficacy, time-to-complete, quota flow) before full fielding?
- What minimum pilot size would convince you the approach is sound (per cell)?
- How quickly do you expect pilot findings and recommended adjustments to be delivered?
- If the pilot uncovers fundamental recruitment issues, are you open to revisiting the research question or target definition?
-
Fieldwork Execution
Manage fielding cadence, monitor sample quality, and run the pilot and main fieldwork with live QA checkpoints.
-
Analysis & Validation
Triangulate quantitative and qualitative findings, validate sample representativeness, and surface the two-to-three actionable insights.
Validation Questions
Start Here — Who’s in the room and why this matters
- Briefly, what is your role and the team you represent?
- What business trigger brought you to consider primary research right now?
- What is the decision deadline or gate this research must meet?
- Who must be in the final decision loop (names or roles)?
- Thinking about the people you just listed—who do you expect will be the strongest supporter and who is most likely to push back? Tell us why.
Before We Assume — what evidence are we building on?
- What if the evidence you currently trust is missing the consumers who actually make the decision—what would that mean for your plan?
- Which existing data sources have you used or referenced so far?
- What were the most important findings from those sources and how recent are they?
- How confident are you that those findings reflect the target segment’s current behavior?
- Where do you feel the evidence is weakest—what specific question or assumption keeps you up at night?
Where the Plan Usually Breaks
- What would it look like if this research failed to change the decision—and why might that happen here?
- Which of these risks worry you most for this project?
- Have you run a similar study before that didn’t land—what specifically went wrong and how long ago was it?
- If stakeholders push back on findings, what arguments have historically worked to change minds in your org?
- If we had to be conservative on sample quality, what’s the minimum representativeness threshold you’d accept?
If This Worked, What Would Be Different?
- Imagine two months after delivery—what are the three concrete decisions that should change if the research is persuasive?
- Which metrics or signals would make you say, ‘This is worth acting on’?
- Which internal teams must be convinced for the recommendation to stick, and what proof does each team need?
- What would an ‘actionable insight’ look like to you—describe the format, granularity, or threshold you’d require.
- If the study produces ambiguous results, which fallback decision-making approach would you prefer?
The Right Study for Your Question
- What if the chosen method gives you statistically significant answers but no story you can act on—how would that feel for your team?
- Which research methods are you most open to using here?
- Would you prefer a pilot to de-risk design, or go straight to the full study?
- Who precisely is the sample we must reach (demographics, behaviors, purchase frequency, loyalty tiers)—list the most critical qualifiers.
- Which measures are non-negotiable to include in the instruments?
Recruitment — who exactly must be in the room?
- Are we recruiting the people who actually decide—or just the easiest to find?
- Which segments must be quota‑controlled to ensure defensible findings?
- What are acceptable panel sources or recruitment approaches for you?
- What red flags in screening responses would immediately disqualify a respondent?
- How should we handle likely non-response or quota shortfalls—what contingency do you prefer?
Agreeing How We’ll Know It Worked
- If you could only take two findings from this study to the exec team, which would you choose?
- What are the explicit acceptance criteria for the study (sample size, margin of error, QA checks)?
- Which deliverables will be required to make a fast decision after delivery?
- How often would you like checkpoints and what decisions will be made at each (design, pilot review, go/no-go)?
- Who has final sign‑off authority to accept the findings and move to the next business step?
-
-
Success
Review outcomes against success signals, prioritize recommended actions, and maintain a shared channel for issues and follow-ups.
Success Reviews
- Success Signals Review
- Prioritization & Recommendation Workshop
- Executive Briefing: Decisions & Endorsements
- Operational Handover & Follow-up Channel Setup
Issues & Enhancements
- Welcome & Objectives
- Tag each success signal with status and attach the supporting evidence snippets.
- Document any evidence gaps and recommend whether follow-up fieldwork or reweighting is required.
- Schedule the prioritization workshop (or exec briefing) based on agreed next step.
- Re-state Problem & Desired Future State
- Produce a ranked list of recommended actions tied to specific findings.
- Assign owners, timelines, and decision gates for each top-priority action.
- Validate that each recommended action directly addresses the problem and success signals.
- Publish the prioritized action list with owners and due dates to the shared project workspace.
- Prepare short decision memos for any actions requiring executive approval.
- Identify any quick wins to execute within 2–4 weeks and start implementation.
- Opening: One-sentence Current State & Consequence
- Secure executive endorsement or clearly document outstanding decisions and timelines.
- Obtain any required budget or resource approvals to proceed with prioritized actions.
- Ensure executives understand consequences of both action and inaction.
- Record executive decisions and circulate an approvals log to the project team.
- If approval withheld, capture requested additional evidence and owner to produce it.
- Schedule the formal kickoff for implementation once approvals are confirmed.
- Handover Overview
- Establish a single shared channel and clear governance for issues and follow-ups.
- Set a monitoring cadence and KPI dashboard to track progress against success signals during implementation.
- Agree SLAs and an issue triage workflow to minimize response lag and ambiguity.
- Create the shared channel, invite stakeholders, and post the handover package.
- Publish the issue triage playbook and assign triage owner(s).
- Build the initial KPI dashboard and populate with baseline values from the research.
- Confirm a clear status (met/partial/unmet) for each predefined success signal.
- Surface any evidence gaps, sample concerns, or interpretation risks that could block decisions.
- Agree immediate next step: prioritize actions, commission follow-up work, or escalate to execs.
- Headline Insights (2-3)
- Headline Findings & Success Signal Status
- One-sentence Current State
- Shared Channel & Governance
- Issue Triage Workflow
- Success Signals Recap
- Top 3 Recommended Actions (with owners & impact)
- Action Idea Generation
- Monitoring & KPI Dashboard
- Impact vs Effort Prioritization
- Findings Summary by Signal
- Specific Executive Asks
- Regular Review Cadence
- Evidence Gaps & Risks
- Concise Q&A and Vote
- Validation Checkpoints
- Decision Implications
- Agree Owners, Timelines & Decision Gates
- Confirm Next Steps & Communication
- Contingency & Rapid Response Plan
- Agree Next Steps
- Close & Immediate Action Items
- Communications & Risks
- Close & Commitments