Health, Education & Government K-12 Education Student & Learning Systems

Assessment & Analytics

Technology and operations decisions where district leadership, IT, and stakeholders must align.

Renaissance Learning Illuminate Education PowerSchool Amplify
Inside this journey
  1. Customer Discovery

    Align on desired student-outcome signals, current assessment cadence, data gaps, stakeholders, and success criteria for early intervention.

    Discovery Questions

    Start with Who You Are — Quick Context

    • Which role best describes you right now? Options: Chief Academic Officer, Assessment Director, Building Principal, Curriculum Coordinator, Director of Technology, Other
    • Which grades and student populations are you most focused on improving this year? Options: K–2, 3–5, 6–8, 9–12, All grades, Specific subgroup (ELL, SPED, FRL)
    • How many students and schools are in your district (approx.)? Options: <1,000 students, 1,000–5,000, 5,001–20,000, >20,000, Prefer not to say
    • What state or states do you operate in (list or type N/A)?
    • Who else on your team typically influences assessment or adoption decisions? (list titles)
    • What would you most like us to understand about your district before we go deeper?

    Are You Comfortable Waiting Until Summer for Answers?

    • If your state test is the only definitive measure you have, what part of instruction is being left to chance?
    • Right now, which of these best describes your primary interim assessment approach? Options: No district-wide interim program, School-by-school ad hoc assessments, Commercial interim assessments used inconsistently, A consistent district interim program
    • How long after administration does assessment data typically reach teachers? Options: Same day, 1–3 days, 1–2 weeks, More than 2 weeks, We don’t get item-level data
    • Tell us about a recent moment when late or missing data cost a student an intervention opportunity—what happened?
    • How much confidence do you have that current assessments actually identify which standards individual students have not mastered? Options: High confidence, Some confidence, Low confidence, No confidence
    • Which assessment outcomes do leaders most ask you for after each administration? Options: Proficiency by standard, Growth measures, Item-level misconceptions, Roster-level intervention lists, Equity-disaggregated outcomes

    Where Students Slip Through the Cracks — Tell Us the Stories

    • When gaps appear in your data, whose students are most often missing timely support? Options: Early grades (K–3), Middle grades, High school, EL/MLL students, Students with IEPs, Students from low-income families
    • How visible are intervention histories, accommodations, and demographics when you view assessment results today? Options: Fully visible and linked, Partially visible, Mostly disconnected, Not visible at all
    • Can you share an example of an equity gap that surprised you when it finally surfaced? What did you wish you had known earlier?
    • Which student groups do you need to disaggregate by as a non-negotiable for decision-making? Options: Race/ethnicity, ELL/MLL status, IEP/504, FRL, Gender, Other
    • How often do equity-disaggregated reports inform resource allocation (interventions, coaching, materials) in your district? Options: After every assessment, Monthly, Quarterly, Rarely, Never
    • What emotional reactions do you see from teachers or families when gaps finally appear in year-end results?

    If You Could See Tomorrow, What Would You Fix?

    • Imagine having clear, next-day signals on who’s falling behind—what would you do differently this week?
    • Which of these signals would most change classroom practice for you? Options: Standards mastery by student, Item-level misconceptions, Predictive proficiency for state tests, Recent growth velocity, Intervention response history
    • What measurable success criteria would make you feel confident to scale a new interim assessment approach? Options: Reduction in students below grade level, Higher teacher use of data for next-day planning, Faster turnaround to actionable analytics, Improved subgroup proficiency, Clear pilot go/no-go metrics
    • What threshold or trigger would you need to see to start an intervention (e.g., percent wrong on a standard, consecutive low scores)? Options: 1 assessment below threshold, Consecutive 2 assessments below threshold, Percent incorrect on a standard (specify), Teacher referral required, Other (please describe)
    • Who in the building or district would need to feel the impact first for you to commit (e.g., teachers, principals, curriculum team)? Options: Teachers, Principals, Assessment Team, Curriculum Coordinators, Superintendent/CAO, School Board

    Assumptions That Could Be Costing You Months of Impact

    • What current assumption about assessments keeps you from changing your approach (for example, 'teachers won't use it' or 'we can't integrate data')?
    • How do teachers currently perceive district assessments—compliance, helpful, mixed, or something else? Options: Compliance-focused, Instructional tool, Mixed feelings, Undetermined
    • Where do teachers tend to get stuck when using assessment data? And how long has that held back instructional change?
    • Which of these obstacles have you already tried to solve (select all that apply)? Options: Lack of teacher time, Insufficient PD, Data disconnected across systems, Slow scoring/turnaround, Poor item-quality/alignment
    • How quickly do you realistically expect teachers to change practice after receiving better analytics? Options: Within days, Within weeks, One term, By next year, Unsure
    • Which internal decisions or approvals usually slow adoption the most (budget, procurement, union, IT, PD)? Options: Budget, Procurement, Union/Policy, IT/security, Professional Development, Other

    What Would Make Teachers Use Data Before It’s Too Late?

    • If teacher dashboards were actually used every day, how would instruction look different in your schools?
    • Which teacher-facing features matter most to you for daily use? Options: Clear next-step resources, Item-level misconceptions, Rostered intervention lists, Easy grouping suggestions, Printable small-group plans
    • What format of professional learning has shown the best behavior change in your district (coaching, whole-staff training, microlearning, PLCs)? Options: Instructional Coaching, Whole-staff PD, Microlearning modules, PLC-driven coaching, Peer-led workshops
    • Describe a moment when teachers changed instruction because of data. What enabled that shift?
    • What ongoing supports would make teachers more likely to keep using assessment-driven guidance (choose top 2)? Options: On-demand helpdesk, Embedded lesson resources, Weekly coaching check-ins, Auto-generated small-group plans, Administrator progress dashboards
    • How would you know teacher adoption was healthy—what signals would you watch? Options: Daily dashboard logins, Number of interventions started, Improved short-term mastery, Teacher-reported usefulness, Reduced time to intervention

    Data + Systems — Is Everything Actually Connected?

    • If your data systems were a single pane of glass, what questions could you answer in 5 minutes that you currently cannot?
    • Which integrations are essential for any assessment platform you consider? Options: SIS rostering (SFTP/CSV/API), Single Sign-On (SAML/SSO), LMS grade passback, Assessment content import/export, Data privacy/compliance documentation
    • Do you have any existing data-sharing or security constraints we should know about (e.g., vendor approvals, FERPA addenda)?
    • Can you provide sample data or a test roster during a pilot? If not, what would block that? Options: Yes, available, Yes but anonymized only, No, cannot share sample data, Depends on legal approval
    • Which student-level fields must travel with assessment results for your use cases? Options: Student ID, Grade, Demographic tags (race/ELL/IEP), Intervention history, Teacher of record
    • How do you prefer to validate integrations—sandbox, pilot with real classrooms, or technical self-test? Options: Sandbox environment, Small pilot in classrooms, Technical self-test by IT, Hybrid approach

    Deciding Together — What Would Make This a 'Yes'?

    • What would you view as non-negotiable success criteria for a pilot to be considered successful? Options: Teachers using dashboards daily, Actionable item-level reports within 24 hours, Measurable improvement in targeted standards, Seamless SIS integration, Clear ROI evidence
    • Who needs to be at the table to sign off on a pilot outcome (roles and decision authority)?
    • What pilot length feels realistic to demonstrate impact without overcommitting (weeks/months)? Options: 2–4 weeks, 6–8 weeks, One semester, Full academic year
    • What data-sharing responsibilities would your district need from us during a pilot? Options: Anonymized data only, Full student-level data with agreements, Aggregate reports only, Other (please specify)
    • How will you decide go/no-go—what evidence or dashboard will you review? Options: Teacher engagement metrics, Pre/post student mastery, Administrator feedback, Parent/community signals, Combination
    • If the pilot met acceptance criteria, what would a reasonable timeline for district-wide rollout look like? Options: Immediate next term, Next school year, Phase over 1–2 years, Unsure — need to discuss

    Practical Next Steps — What Would You Like Us to Do First?

    • Which of these do you want from us next to move forward? Options: Standards alignment audit, Technical integration scoping, Pilot proposal with timelines, Teacher experience demo, Cost estimate and contract terms
    • If we delivered a 4–8 week pilot proposal today, what constraints would you need us to address to make it viable?
    • Who should we include on the kickoff meeting from your side (names/titles and their decision role)?
    • What concerns would you want addressed in a short pilot agreement (e.g., data privacy, teacher time, cancellation terms)? Options: Data privacy & FERPA, Teacher time commitment, Clear acceptance metrics, Exit/cancellation terms, Cost & invoicing
    • Finally, what would make you feel confident to put a small pilot on the calendar today? Options: Clear low-cost pilot, Executive buy-in confirmed, IT signoff on integrations, Teacher volunteers identified, All of the above
  2. Solution Experience

    Use district scenarios to validate how interim assessments, item-level analytics, and disaggregated reports will reveal struggling students and enable next-day instruction.

    Experience Meetings

    • Solution Experience Kickoff — Current State, Consequence & Future State
    • Scenario Build & Data Mapping
    • Live Scenario Walkthrough — Detection to Next-Day Instruction (Proof)
    • Equity Disaggregation & Reporting Validation
    • Teacher Workflow Pilot Planning & Go/No-Go Criteria
    • Define clear acceptance criteria for equity reporting and export workflows.
    • One-sentence Recap of Preconditions
    • Prove the platform delivers actionable item-level analytics within the agreed turnaround time.
    • Validate that each analytic output directly addresses a named problem from the current state.
    • Obtain explicit customer confirmation that outputs enable next-day instructional actions.
    • Identify and document any configuration changes required before pilot.
    • Seller to produce a short 'proof packet' showing screenshots/exports from each scenario and the mapping to customer problems.
    • Customer to respond with validation answers and any additional acceptance criteria within 3 business days.
    • Seller to implement agreed adjustments to thresholds or report layouts in the sandbox.
    • Restate Equity Questions to Answer
    • Prove that disaggregated views reveal subgroup gaps within the tested scenarios.
    • Confirm that report formats are usable by teachers and leaders for prioritizing interventions.
    • Introductions & Objectives
    • Seller to deliver sample exported reports (PDF/CSV) for each agreed subgroup and scenario.
    • Customer to identify a short list of interventions that would be triggered by each report type.
    • Seller to configure automated report schedules and share technical steps for export/ETL if required.
    • Review Lessons from Walkthroughs
    • Finalize a pilot plan that operationalizes next-day instruction using the platform.
    • Obtain commitments on teacher training, pilot dates, and monitoring cadence.
    • Define measurable go/no-go criteria for pilot acceptance and wider rollout.
    • Customer to confirm pilot teacher roster and schedule and to distribute pre-work to pilot teachers.
    • Seller to prepare teacher-facing quick-start, create pilot assessments in the sandbox, and schedule training sessions.
    • Both parties to agree on a monitoring dashboard and cadence for daily/weekly check-ins during the pilot.
    • Achieve a single, agreed one-sentence current state that all participants recognize.
    • Surface explicit consequences of the current state in operational terms.
    • Define a one-sentence future state (outcome-focused) that the experience must prove.
    • Agree on scenarios, data deliverables, and attendees for the hands-on sessions.
    • Customer to deliver representative roster, one interim export, and one-paragraph current-state by X date.
    • Seller to prepare facilitator one-sentence restatement and a consequences summary slide.
    • Schedule the Scenario Build & Live Walkthrough sessions and confirm attendee list.
    • Review Selected District Scenarios
    • Ensure each scenario is expressed in platform-ready data and covers realistic cohorts.
    • Verify standards alignment for items used in the scenarios.
    • Agree on analytic thresholds and 'struggling' definitions that will be proven in walkthroughs.
    • Capture teacher workflow constraints to validate feasibility of next-day instruction adjustments.
    • Customer to correct or supply missing data fields identified in mapping.
    • Seller to load cleaned data into a sandbox and create scenario-specific assessments and item-tagging.
    • Both parties to finalize the two to three scenarios to be used in the Live Scenario Walkthrough meeting.
    • Run Scenario A: Admin -> Score -> Analytics (Proof)
    • Define Pilot Classroom/School Roster & Timeline
    • One-sentence Current State
    • Live Generation of Disaggregated Reports
    • Data Mapping Walkthrough
    • Teacher-Facing Materials & Training Plan
    • Consequence: Operational & Instructional Impact
    • Tie Outputs Back to Problems
    • Standards & Item Alignment Check
    • Interpretation Workshop — From Report to Instruction
    • Force Validation: Confirm with Attendees
    • Define Detection Rules & Analytics Thresholds
    • One-sentence Future State
    • Success Metrics & Data Collection Plan
    • Export, Automation & Turnaround Check
    • Run Scenario B (Different Cohort/Subgroup)
    • Confirm Teacher Workflow Friction Points
    • Confirm Scenarios, Data & Roles for Workshop
    • Roles, Responsibilities & Go/No-Go Criteria
    • Agree Acceptance Criteria for Equity Reporting
    • Pre-work Review & Logistics for Next Meetings
    • Capture Required Adjustments & Acceptance Gaps
  3. Solution Scope

    Define scope: standards alignment validation, assessment cadence, item banks, delivery modes, analytics configuration, integrations, training, and acceptance criteria.

    Scope Configuration

    • Provision Platform Licenses and User Accounts
    • Configure Role-Based Permissions and Access
    • Integrate Student Information System (SIS) Rostering
    • Enable Single Sign-On (SSO) Authentication
    • Import Item Bank and Apply Standards Tagging
    • Activate Online Delivery Engine
    • Deploy Paper Scanning and OMR Processing
    • Enable Automated Scoring for Constructed Responses
    • Deploy Teacher Dashboards with Item-Level Views
    • Activate Standards Mastery and Growth Reporting
    • Enable Equity-Disaggregated Reporting Filters
    • Configure Data Exports and LMS/API Integrations
    • Deliver On-Platform Teacher Training Sessions

    Scope Questions

    Provision Platform Licenses and User Accounts

    • How many total user accounts will you need provisioned for the initial rollout? Options: Less than 100, 100-500, 501-2,000, 2,001-10,000, More than 10,000
    • Which user types need licenses? (select all that apply) Options: Teachers, School Administrators/Principals, District Administrators/Assessment Directors, Instructional Coaches, Students, IT Staff, Other
    • Do you require seat-based licenses, district/site licenses, or a hybrid model? Options: Seat-based (per user), Site/district license (unlimited at site), Hybrid (mix of seat and site), Unsure — need recommendation
    • What is your desired license activation date or window? Options: Within 2 weeks, 2-6 weeks, 6-12 weeks, Quarterly/Custom start date
    • Will you need bulk account provisioning from a roster file or SIS feed, or manual provisioning? Options: Bulk from SIS/roster, Upload CSV/Spreadsheet, Manual creation only, Combination
    • Are there procurement or PO requirements (e.g., PO number, purchase order timeline) that affect provisioning? Options: Yes, No

    Configure Role-Based Permissions and Access

    • Do you require custom roles beyond standard templates (e.g., differentiated observer, test proctor)? Options: Yes, No, Not sure — need guidance
    • How many distinct permission roles do you expect to implement initially? Options: 1-2, 3-5, 6-10, 10+
    • Which data types should be restricted to specific roles (select all that apply)? Options: Student PII, Item-level responses, Disaggregated subgroup data, Assessment blueprints/keys, None
    • Do you need time-limited or pilot-specific role assignments (e.g., pilot teachers vs. full rollout)? Options: Yes, No
    • Should role mappings align to existing SIS groups or be managed independently? Options: Map to SIS groups, Managed in-platform, Combination
    • Do you require audit logging of role changes and data access for compliance? Options: Yes, No

    Integrate Student Information System (SIS) Rostering

    • Which SIS vendor(s) or rostering format(s) do you use? Options: PowerSchool, Infinite Campus, Skyward, JMC, Aeries, Other, OneRoster/Custom CSV
    • What is your preferred rostering cadence for syncs (frequency)? Options: Daily, Weekly, On-demand/manual, One-time import, Other
    • Which student and class fields must be synchronized (e.g., demographics, IEP/504 flags, program codes)?
    • Do you have special rostering needs (e.g., cross-campus teachers, shared classes, summer programs)? Options: Yes, No
    • Will rostering be handled via vendor-guided setup or does your IT team prefer to configure the integration? Options: Vendor-led, District IT-led, Hybrid
    • If SIS integration is not possible for some users, do you need manual/CSV upload fallback workflows? Options: Yes, No

    Enable Single Sign-On (SSO) Authentication

    • Which SSO method(s) do you plan to use? Options: Google Workspace (OAuth), Microsoft Azure/AD, SAML 2.0, CAS, Other/Proprietary
    • Do all user groups require SSO from day one or will SSO be phased? Options: All users from day one, Phase by role/site, Pilot group only, Unsure
    • Do you require automated user provisioning/deprovisioning via SCIM or group sync? Options: Yes (SCIM/group sync), No — local provisioning only, Unsure
    • Will multi-factor authentication (MFA) or conditional access policies be enforced via your IdP? Options: Yes, No, IdP decides
    • Do you require a test/staging SSO environment before production enablement? Options: Yes, No
    • Are there certificate exchange or security contact requirements we should schedule now? Options: Yes, No

    Import Item Bank and Apply Standards Tagging

    • What is the estimated size and format of your item bank for import (number of items and file types)? Options: Less than 1,000 items, 1,000-5,000, 5,001-20,000, More than 20,000, File formats vary (CSV, QTI, XML)
    • Which standards shall items be tagged to (select all that apply)? Options: State standards (please specify state), Common Core, Custom district standards, NGSS/Other content standards
    • Are items fully tagged today, partially tagged, or untagged? Options: Fully tagged, Partially tagged, Untagged
    • Do you require vendor assistance mapping items to standards or should we ingest your existing tagging? Options: Vendor-assisted mapping, Use existing tagging, Combination
    • Do items include multimedia, stimulus sets, or technology-enhanced item types that need special mapping? Options: Yes — multimedia/TI items, No — text/items only, Unsure
    • Do you need a review workflow for item quality assurance and psychometric flags as part of import? Options: Yes — include QA review, No — import as-is, Prefer recommendation

    Activate Online Delivery Engine

    • Which delivery modes do you plan to use for online administration? Options: Browser-based on managed devices, Chromebook/Tablet optimized, Offline/locked down apps, Bring Your Own Device (BYOD)
    • Do you require a secure lockdown browser or proctoring features? Options: Lockdown browser required, Proctoring tools required, No special security needed, Unsure — need guidance
    • What is your expected concurrent test-taker peak during administration? Options: Less than 250, 250-1,000, 1,001-5,000, 5,001-20,000, More than 20,000
    • Do you need accommodations supported online (text-to-speech, enlarged font, translated interfaces)? Options: Yes — multiple accommodations, Limited accommodations, No
    • Is offline or low-bandwidth delivery required for some sites? Options: Yes — offline needed, No — reliable bandwidth everywhere, Partial — some sites
    • Are there browser or device restrictions we should enforce (list required/unsupported platforms)?

    Deploy Paper Scanning and OMR Processing

    • Do you plan to administer paper-based forms in the pilot or rollout? Options: Yes — significant paper use, Yes — limited paper use, No — fully online
    • What is the estimated monthly volume of pages/OMR sheets to be processed? Options: Less than 1,000 pages, 1,000-5,000, 5,001-20,000, More than 20,000
    • Do you have onsite scanning hardware or prefer a vendor-managed scanning service? Options: District has scanners — local processing, Use vendor scanning service, Hybrid
    • Are barcode or unique form ID requirements already in place on your forms? Options: Yes — barcodes present, No — need template changes, Unsure
    • What is the acceptable turnaround time from receipt of paper to item-level analytics? Options: <24 hours, 24-48 hours, 48-72 hours, More than 72 hours
    • Do you need double-key scoring or manual verification for any scanned responses? Options: Yes — for constructed responses, Yes — for all forms, No

    Enable Automated Scoring for Constructed Responses

    • Which constructed-response item types do you want auto-scored (e.g., short answer, extended response, rubric-based tasks)? Options: Short answer, Extended response/essays, Rubric-scored tasks, None — manual only
    • Do you already have rubrics and training sets of scored responses to train/validate automated scoring models? Options: Yes — large labeled set available, Limited samples available, No — need to create samples
    • What is your acceptable confidence/accuracy threshold for automated scoring before human review is reduced? Options: >95%, 90-95%, 80-90%, Prefer human-in-the-loop
    • Do you require support for multiple languages or bilingual scoring models? Options: Yes — multiple languages, English only, Limited languages
    • Do you want an initial human calibration period where vendor and district scorers align? Options: Yes — required, Optional, No
    • Are there security/compliance constraints around storing student responses for model training? Options: Yes — restrict storage, No

    Deploy Teacher Dashboards with Item-Level Views

    • Which user groups should have access to teacher dashboards (select all that apply)? Options: Classroom Teachers, Principals/Instructional Leaders, District Assessment Staff, Coaches, Parents (limited view)
    • What data aggregation levels do you need visible on dashboards? Options: Student-level, Class-level, Grade-level, School/district-level
    • How frequently should dashboard data refresh (real-time, nightly, weekly)? Options: Near real-time, Nightly, Weekly, Manual refresh
    • Which item-level views are required (e.g., item response, standard alignment, distractor analysis)? Options: Item response by student, Standard alignment, Distractor analysis, Item difficulty/p-value
    • Do teachers need exportable reports (CSV/PDF) or integration into gradebooks/LMS from dashboards? Options: Export CSV/PDF, Push to LMS/gradebook, Both, No exports required
    • Do you require role-based visibility controls on which teachers can view disaggregated or sensitive subgroup data? Options: Yes, No

    Activate Standards Mastery and Growth Reporting

    • How do you define mastery for standards (percent correct threshold, scale score, proficiency level)? Options: Percent correct threshold, Scale score/proficiency band, Custom rubric, Unsure — need recommendation
    • Which growth model do you want to use or evaluate (e.g., value-added, student growth percentiles, raw change)? Options: Student Growth Percentiles (SGP), Value-added model, Simple pre/post growth, Not sure — need guidance
    • What baseline and comparison periods should reports use (e.g., start-of-year, previous year)? Options: Start-of-year baseline, Previous assessment cycle, Custom date range, Multiple baselines
    • Do you need cohort definitions applied (e.g., feeder patterns, intervention groups)? Options: Yes — multiple cohorts, No — single cohort, Unsure
    • What reporting cadence is required (immediate after admin, weekly summaries, monthly analytics)? Options: Immediate/real-time, Nightly, Weekly, Monthly
    • Are visualizations or downloadable scorecards required for principals and district leaders? Options: Yes — scorecards and visualizations, No — raw data only, Both
  4. Mutual Commit

    Agree commercial terms, pilot parameters, data-sharing responsibilities, timelines, and measurable acceptance criteria for go/no-go decisions.

    Agreement Modules

    • Non-Disclosure Agreement (NDA)
    • Master Services Agreement (MSA)
    • Statement of Work (SOW)
    • Commercial Terms & Pricing
    • Pilot Agreement & Go/No-Go Criteria
    • Data Sharing & Student Privacy Agreement (FERPA/DPA)
    • Integration & API Access Agreement
    • Implementation Timeline & Milestones
    • Roles & Responsibilities Matrix
    • Acceptance & Validation Checklist
    • Training & Support Agreement
    • Service Level Agreement (SLA)
    • Security Assessment & Compliance Attestation
    • Change Order & Scope Management
    • Termination & Renewal Terms
    • Data Return & Deletion Procedure
    • Execution & Signature Record
  5. Deployment

    Operationalize rollout with readiness checks, enablement, and outcome validation.

    1. Pre-Deployment Readiness

      Confirm technical and operational prerequisites: SIS/LMS integration, rostering, SSO, security review, and sample data availability.

      Readiness Questions

      Start Small: Your Current Assessment Snapshot

      • Which of these best describes your current district-wide assessment practice? Options: Only annual state tests, Occasional teacher-created checks, Regular interim assessments in some grades, Regular district-wide interim/benchmark program, Mixed and inconsistent across schools
      • How often do you run district-level assessments that are intended to inform instruction (select one)? Options: Weekly, Monthly, Quarterly, Twice per year, Once per year, Ad-hoc
      • Which grades and subjects are your highest priority for earlier signals of risk? Options: K, 1, 2, 3, 4, 5, 6, 7, 8, 9-12, ELA/Reading, Math
      • Who currently owns the operational process for administering and reviewing interim assessment results? Options: Chief Academic Officer, Assessment Director, Building Principals, Curriculum Coordinator, IT/Systems Admin, Teachers, Other
      • Tell us about one recent time assessment data changed what happened in a classroom — what happened and why it mattered?

      Are We Waiting Until It’s Too Late?

      • If your next state test is the only signal you get about who’s behind, what are the real costs for students and teachers in your district?
      • How long, on average, does it take from giving an assessment to teachers having something they can act on? Options: Same day, Next day, 3–7 days, 2–4 weeks, Longer than a month
      • Which student groups in your district most often surface as 'surprises' only after state score release? Options: Students with disabilities, English learners, Students experiencing homelessness, Economically disadvantaged, Racial/ethnic subgroups, Gifted/Talented, Other
      • When data arrives late, how does it affect leadership decisions and teacher morale?
      • What have you already tried to speed insight-to-action, and why did those efforts not deliver at scale?

      Who’s Really in the Room When Decisions Are Made?

      • Who has the decisive vote on curriculum/assessment changes in your district — and what assumptions do they typically bring?
      • Which stakeholder groups must be onboard for a successful interim assessment program? Options: District leadership (CAO/ED), Assessment team, Principals, Teachers, IT/SIS team, Families, School board, Union reps, Other
      • How would you describe teachers’ current attitude toward assessments—do they see them as useful, compliance, or something else? Options: Instructional and useful, Mostly compliance, Mixed by school/teacher, Resistant/avoidant, Unsure
      • Who do you expect will be the day-to-day champion for adoption at the school level? Options: Principal, Instructional Coach, Grade-level Lead, Assessment Coordinator, Teacher leader, Other
      • Share an example when stakeholder misalignment blocked an instructional initiative—what was the break-point?

      Where Does Your Data Drop Off?

      • If you can’t reliably join assessment results to student demographics and intervention history, how confident are your equity-focused decisions? Options: Very confident, Somewhat confident, Not very confident, Not confident at all
      • Which SIS/LMS systems and third-party tools currently hold the data you need to connect (select all that apply)? Options: PowerSchool, Infinite Campus, Skyward, Aspen, Google Classroom, Canvas, Other
      • How are rosters, grades, and demographic fields synced today? Options: Automated 1-way sync, Automated 2-way sync, Manual CSV uploads, Ad-hoc exports/imports, Not synced
      • Do you have SSO and roster-sync established district-wide? Options: Yes—district-wide, Yes—partial schools, Planned within 3 months, No
      • What practical obstacles have you encountered when trying to get item-level data into teacher workflows?

      What Would Seeing Tomorrow’s Students Change Today?

      • If teachers could reliably see which students will struggle next month, what three instructional changes would you most want to enable? Options: Small-group instruction, Targeted lesson adjustments, Tiered intervention placement, Immediate progress monitoring, Parent/family outreach, Specialist referrals
      • Which student-outcome signals matter most for your intervention decisions? Options: Standards-mastery by skill, Item-level misconceptions, Short-term growth rate, Predictive risk score, Intervention response history, Attendance/behavior overlays
      • How important is seeing item-level evidence (the specific items students missed) compared with an overall proficiency indicator? Options: Crucial—item-level needed, Important but not essential, Prefer overall score, Unsure
      • What is your acceptable maximum turnaround time from test completion to teacher-ready, actionable insight? Options: Within hours (same day), Next day, 3–7 days, Longer than a week
      • How would you know instruction actually changed because of those insights—what evidence would you expect to see?

      Will Teachers Actually Use This on Monday?

      • If we dropped a ready-to-use teacher dashboard into your schools tomorrow, would it be embraced, tolerated, or ignored—and why?
      • Which barriers most prevent teacher use of assessment analytics in your district? Options: Time in schedule, Lack of training, Unclear action steps, Poor user experience, Lack of trust in item quality, Competing initiatives
      • What training and support model tends to work best for teacher practice change here? Options: Full-day workshops, Microlearning sequences, In-class coaching, Train-the-trainer, On-demand help center, Peer-led PLCs
      • How would teachers prefer intervention suggestions to be presented? Options: Small-group rosters, Suggested lesson plans, Lesson resources linked to standards, Short textual next steps, Assessment item recommendations, Other
      • Describe a teacher-facing data view that actually changed instruction in your district—what features made it actionable?

      How Will You Know We’ve Succeeded?

      • What would you need to see at pilot end to confidently say 'go'—and what did you say 'no' about the last time a pilot failed?
      • Which success metrics should we track for the pilot (choose all that matter)? Options: Teacher adoption rate, Frequency of teacher action within 48 hours, Decrease in students below benchmark, Narrowing of equity gaps, Improvement in growth percentiles, Fidelity of administration, Data integration accuracy
      • What numerical or percentage thresholds would you set for the top 2–3 metrics?
      • Who is the ultimate decision-maker for pilot approval and district-wide rollout? Options: Superintendent, Chief Academic Officer, Assessment Director, School Board, Other
      • What timeline do you expect between pilot completion and a go/no-go decision? Options: 2 weeks, 1 month, 2–3 months, Longer than 3 months

      What Could Derail This Before It Starts?

      • If this effort stalls inside 90 days, what are the most likely causes from your experience?
      • Which internal approval processes typically add the most time (select all that apply)? Options: Procurement, Legal/Contracts, IT security review, Vendor vetting, School board approval, Union agreement
      • What security/privacy requirements must vendors meet for data-sharing (select all that apply)? Options: FERPA compliance, State-specific data privacy law, Vendor security questionnaire, SOC2/ISO certification, COPPA considerations, Encryption at rest/in transit
      • What budget realities should we understand before proposing scope (one-time, recurring, grant-dependent, etc.)? Options: No new funds, Reallocatable existing funds, Grant-funded only, Will evaluate purchase if pilot succeeds, Vendor-assisted pilot funding
      • How many full-time equivalent staff can you realistically dedicate to implementation and operation? Options: None (shared duties), 0.5 FTE, 1 FTE, 2+ FTEs, Unsure

      If We Move Forward — What Should Happen Next?

      • What is the smallest, lowest-risk pilot you would trust to prove value in your context (describe scope/scale)?
      • Which pilot configuration would you prefer? Options: Single grade, single school, Multiple grades in one school, District-wide subset of schools, Grade-span pilot (e.g., K–2 or 3–5), Other
      • What sample data can you provide for integration testing (select all that apply)? Options: Current SIS rosters, Historical assessment results, Student demographics, Intervention logs/MTSS data, No sample data available yet
      • Who should be on the pilot working group from your side (roles/emails if known)?
      • What concerns should we address upfront to make the pilot feel low-risk to your leadership and families?
    2. Deployment Enablement

      Coordinate the rollout: schedule pilots, teacher training on data-informed instruction, assessment calendars, and owner-level task assignments.

    3. Validation Checklist

      Verify integrations, turnaround time to actionable item-level analytics, teacher dashboard usability, and equity-disaggregated reporting meet acceptance criteria.

      Validation Questions

      Quick Moment: What's top of mind about student assessment right now?

      • In one sentence, what outcome would make you say this year’s interim assessment work was a success?
      • Which grade ranges and subjects are you most focused on closing gaps for this year? Options: K–2 literacy, Grades 3–5 literacy, Middle grades ELA, Elementary math, Middle grades math, High school courses, Multiple areas, Other
      • How often does your district currently run any form of interim or benchmark assessment? Options: No regular interim assessments, Once per year (benchmark only), Twice per year, Quarterly, Monthly, Weekly/formative cycles, Pilot/varies by school
      • Who typically reviews interim results first and makes instructional decisions (role/title)? Options: Teachers, Principals/Instructional leaders, Curriculum/Assessment director, District data/analytics team, Instructional coaches, Other
      • What single question about student learning can’t you currently answer district-wide?

      Are we just waiting for the annual fire alarm?

      • How true is this: 'We only know who needs help once the state test scores arrive'? Options: Completely true, Most of the time, Sometimes, Rarely, Not true
      • Describe a recent situation where late assessment feedback changed what you wished you had done—what was the impact?
      • When you get assessment data now, how long does it take from test close to a teacher having actionable item-level information? Options: Same day, Next day, Within a week, Multiple weeks, Months (state results), We don't get item-level data
      • If nothing changed in your assessment cadence this year, what would you expect to be different (or the same) about student outcomes next year?
      • How long have you been operating with your current assessment rhythm? Options: New this year, 1–2 years, 3–5 years, 5+ years, Varies by school

      Who really owns 'actionable' in your district?

      • Who in your organization is expected to turn assessment data into day-to-day instruction changes? Options: Classroom teachers, Instructional coaches, School leaders, District curriculum team, Special education staff, Other
      • When teachers receive data, how confident are they in using it to change instruction? Options: Very confident, Somewhat confident, Neutral/needs support, Reluctant or skeptical, Avoidant—see assessments as compliance
      • Walk me through a recent example where data led to an immediate instructional change—what happened, who was involved, and how was it tracked?
      • Which roles do you think should be accountable for student progress between state tests? Options: Teachers, Principals, District leadership, Instructional coaches, MTSS teams, Other
      • What barriers prevent those roles from acting quickly on assessment insights? Options: Time constraints, Data complexity, Lack of training, No clear intervention options, Trust in data, System access/integration, Other

      Where are the blind spots that quietly erode equity?

      • If I told you your current system is masking opportunity gaps—what would you want to see to prove that isn’t true?
      • Which student groups do you regularly disaggregate data by? Options: Race/ethnicity, ELL/MLL status, Special education, Economically disadvantaged, Gender, Foster/homeless status, None/limited disaggregation, Other
      • How often do equity-disaggregated reports change your intervention assignments or resource allocation? Options: Regularly, Sometimes, Rarely, Never, We don't have reports
      • Tell me about a time you discovered an unexpected gap when you looked deeper—what did you do next and how long did it take to respond?
      • What equity signals are most important for your leadership team to see within 48 hours of assessment results? Options: By subgroup mastery, By standard/skill, By classroom/school, By intervention history, By growth trajectories, Other

      If next-day answers were actually possible, what would you change?

      • Imagine teachers had item-level analytics the next morning—what specific instructional decisions would you expect them to make that they aren’t making now?
      • Which of these would be a meaningful indicator that teachers are using next-day data? Options: Lesson plan changes, Small-group assignment shifts, Intervention referrals, Changes in formative checks, Teacher reported behavior changes, Other
      • What turnaround time do you require to call data 'actionable' for classroom teachers? Options: Same day, Next day, 2–3 days, Within a week, Longer
      • What thresholds or triggers would you set for an automatic alert (e.g., percent below mastery, cluster of standards missed)? Options: % below grade-level mastery, Rapid decline in growth, Multiple students missing same standard, Low performance among a subgroup, Other
      • If we built teacher-facing dashboards, what three insights must be visible on the top screen to make you confident they'll act?

      Can you trust the alignment and the items?

      • Would you accept an assessment without independent alignment validation to your state standards? Options: Yes, with strong evidence elsewhere, Yes, conditionally, No, must have validation, Unsure
      • What does 'trusted alignment' look like to you—item mapping, sample items review, third-party audit, other? Options: Item-to-standard map, Released sample items, Third-party alignment study, Teacher review panels, Pilot with student data, Other
      • How many sample items or anchor items would you need to review before signing off on alignment quality? Options: None—trust vendor, A small set (10–20), Moderate (21–50), Extensive (50+), Prefer a statistical alignment report
      • How important is internal psychometric reporting (reliability, item difficulty, DIF) for your acceptance criteria? Options: Critical, Very important, Helpful but not required, Not a priority
      • If items are redistributed from an item bank, what concerns should we address up front (security, content balance, bias)? Options: Security, Standards balance, Cultural bias, Accessibility, Grade-level appropriateness, Other

      What would make teachers excited instead of compliant?

      • What currently makes teachers see assessment as 'just compliance' in your district? Options: High workload, Poorly timed data, Unclear use of results, Lack of support/resources, Punitive accountability, Other
      • Which teacher-facing features have most influenced adoption in past pilots (e.g., simple next-step recommendations, grouping suggestions, plug-and-play lesson plans)? Options: Next-step actions, Automatic small-group creation, Standards mastery view, Auto-generated mini-lessons, Roster integration, Other
      • How would you describe teachers’ typical bandwidth for training and coaching (per month)? Options: Minimal—30 minutes, 1–2 hours, Half-day sessions, Full-day workshops, Regular coaching cycles
      • What kind of evidence or quick wins would convince teachers to change their assessment habits? Options: Time saved on grading, Clear next-step lesson plans, Visible student progress, Administrator support, Student engagement improvements, Other
      • If we ran a short pilot, what's one small teacher-facing outcome that would persuade you to scale?

      What would stop this before it starts?

      • Which integration or technical dependency would be a non-starter if not resolved (SIS rostering, SSO, data export, security review)? Options: SIS rostering, SSO, Student-level data export, Privacy/security certification, LMS integration, None—can work around
      • How long does your typical IT/security review take for a new ed-tech vendor? Options: Under 2 weeks, 2–4 weeks, 1–2 months, 2–3 months, Longer or undefined
      • Are there any contractual or data-sharing restrictions (local policy, state law, union agreements) that would affect a pilot? Options: Yes—student data restrictions, Yes—vendor approval process, Yes—union/contract limits, No major restrictions, Unsure
      • Who on your side needs to be involved to clear these dependencies (name/role)?
      • What’s the absolute earliest and latest launch window you’d consider for a pilot? Options: Immediately, Within 1 month, 1–3 months, 3–6 months, Next school year
      • If integrations or approvals slip, what contingency would you want (paper/pseudo-data pilot, classroom-only trial, data-limited pilot)? Options: Paper-based pilot, Classroom-only, Teacher-reported data, Synthetic/sample data, Delay launch, Other

      Let’s define a pilot win you can show the board

      • What three measurable acceptance criteria would you use to recommend scaling after a pilot? Options: Teacher adoption rate, Improved mastery by standard, Faster turnaround to actionable data, Equity gap reduction, Positive teacher feedback, Technical stability
      • What numeric targets would feel like a pass/fail for a pilot (e.g., 60% teacher adoption, 10-point mastery gain)?
      • Who signs off on the pilot go/no-go decision and what will they need to see? Options: Chief Academic Officer, Assessment Director, Superintendent, School Board member, IT Director, Other
      • How will you surface pilot results internally—what forum, cadence, and audience are required? Options: Monthly leadership review, Principal meetings, Teacher PLCs, Board update, Public dashboard, Other
      • If the pilot meets technical but not adoption goals, what would you want us to do next (rework PD, extend pilot, iterate UX)? Options: Intensive PD, Extend pilot, UX/workflow changes, Coaching support, Re-evaluate scope
      • Finally, what’s your preferred next step after this discovery (detailed proposal, technical scoping call, pilot design workshop)? Options: Detailed proposal and cost, Technical scoping call, Pilot design workshop, Vendor demo with staff, I'm not ready yet
  6. Success

    Review outcome metrics, adoption signals, and intervention impact; maintain a shared channel for tracked issues and enhancement requests.

    Success Reviews

    • Success Metrics & Adoption Review
    • Intervention Impact Deep Dive
    • Adoption Barriers & Teacher Enablement Workshop
    • Enhancement & Issue Triage (Shared Channel Management)
    • Executive Impact & Renewal Steering

    Issues & Enhancements

    • Product to create spec tickets with acceptance criteria for top 5 backlog items.
    • Add any required analytics changes (e.g., new disaggregation or threshold) to the enhancement backlog.
    • Problem Framing: One-Sentence Future State
    • Produce a prioritized, actionable enablement plan that addresses highest-impact adoption barriers.
    • Secure teacher and coach commitments to pilot proposed enablement items.
    • Create measurable success criteria for each enablement intervention.
    • Develop 30-minute micro-PD module and schedule pilot sessions in two schools.
    • Implement in-dashboard contextual tips for top three teacher tasks and measure clicks.
    • Track pilot results and report back at next monthly Success Metrics Review.
    • Backlog Summary & Severity Triage
    • Prioritize the backlog so the district sees clear timelines for high-impact fixes and enhancements.
    • Ensure every prioritized item has explicit acceptance criteria and an assigned owner.
    • Reduce time-to-resolution by clarifying required sample data and test cases up front.
    • Opening & One-Sentence Current State
    • District to deliver requested sample data sets and test accounts within 5 business days.
    • CSM to post weekly status updates in the shared channel and tag stakeholders.
    • One-Sentence Future State & Consequence
    • Secure an executive decision on renewal or scale with clear conditions and timelines.
    • Align on resource commitments (PD, staffing, funding) required to hit the defined future state.
    • Ensure executive sponsors understand major risks and mitigation plans.
    • Prepare executive one-pager and circulate 48 hours before the meeting.
    • If renewal approved, schedule contract and scoping next steps with Procurement within two weeks.
    • Assign executive sponsor to unblock any district-level dependencies identified.
    • Confirm whether adoption and outcome metrics meet the success criteria defined in the Mutual Commit stage.
    • Identify 2–4 specific barriers preventing teachers from turning analytics into instruction.
    • Assign owners and timelines for corrective actions to be tracked in the shared channel.
    • Owner to investigate top two schools or grades with lowest dashboard engagement and report root causes.
    • Create a targeted PD plan for identified teacher cohorts and schedule sessions.
    • Update the shared issue channel with metrics and owners for each action.
    • One-Sentence Consequence Statement
    • Validate which interventions produce measurable improvement and which require changes.
    • Clarify whether lack of impact is due to fidelity, assessment design, or other factors.
    • Document next-step decisions with acceptance criteria and owners for each intervention.
    • Revise intervention scripts or materials for any cohort marked 'modify' and schedule a 30-day recheck.
    • Assign a coach to three lowest-performing classrooms for focused support and report weekly.
    • Adoption KPI Dashboard Review
    • Teacher Storyboard Reviews
    • Cohort Outcome Comparison
    • Topline Outcome Metrics
    • Customer Impact & Consequence
    • Define Acceptance Criteria & Data Requirements
    • Root-Cause Mapping
    • Adoption & Operational Health Snapshot
    • Fidelity & Implementation Review
    • Outcome Metrics Review
    • Equity Disaggregation
    • Teacher & Coach Feedback
    • Prioritization & Timeline Commitment
    • Intervention ROI Highlights
    • Co-design Solutions
    • Owner Commitments & Timeline
    • Communication Plan
    • Signals-to-Action Gap Analysis
    • Decide: Continue/Modify/Scale
    • Renewal / Scale Recommendation & Decision Points
    • Decisions & Next Steps
    • Risks, Dependencies, and Ask
First-Party AI

1-2 minutes please — Your AI agent is working

First-Party AI™ can make mistakes. Always check important information.