All examples for NPS Driver Analyzer

Post-Launch Rollout Decision Analysis

Analyzes a 150-response post-launch survey showing cohort divergence (power users NPS -18, new users NPS 70) to provide a clear rollout pause/continue recommendation with phased remediation plan and success criteria.

Input

What you provide to the skill

Post-launch survey of 150 users shows power users unhappy while new users rate us 70. Should we pause the rollout?

Output

What the skill generates for you

NPS Driver Analysis Report

Post-Launch Survey Results

Total Responses: 150
Overall NPS: 47
Distribution: 47% Promoters, 23% Passives, 30% Detractors

RECOMMENDATION: PAUSE rollout and address power user concerns before continuing


Executive Summary

  • Mixed sentiment with clear cohort divide: New users enthusiastic (NPS 70), power users highly dissatisfied (NPS -18)
  • New users love simplified interface and onboarding, power users frustrated by removed advanced features
  • Detractor concentration among most valuable user segment presents revenue risk
  • Primary concern: Feature removal without migration path or communication
  • Primary strength: Onboarding experience and performance improvements

Critical Finding: Power users represent 20% of survey respondents but typically drive 60-80% of revenue. Their -18 NPS represents existential risk.


Score Distribution

  • Promoters (9-10): 71 (47%)
  • Passives (7-8): 34 (23%)
  • Detractors (0-6): 45 (30%)

Detractor segment is disproportionately power users (73% of detractors vs 12% of overall user base). This concentration amplifies business impact.


Promoter Drivers

Simplified Interface & Onboarding

Prevalence: 58% | Score Impact: +0.5 | Cohort: 92% new users

“Finally an app that doesn’t require a manual. Onboarding was smooth and I was productive in 10 minutes.”

“Clean interface, no clutter. Everything I need right there.”

Action: Feature in marketing, create video case studies showcasing ease of use for acquisition campaigns.

Performance Improvements

Prevalence: 51% | Score Impact: +0.4 | Cohort: Mixed

“App loads 3x faster now. Searches that took 10 seconds are instant.”

“Responsiveness is night and day. This feels professional now.”

Action: Quantify performance gains in release notes, highlight in retention campaigns.

Mobile Experience

Prevalence: 43% | Score Impact: +0.3 | Cohort: 78% new users

“Mobile app finally works properly. Can do everything from my phone.”

“Mobile-first design shows. Better than competitors.”

Action: Amplify in App Store descriptions, target mobile-heavy segments.


Detractor Drivers

Removed Advanced Features - URGENT

Prevalence: 67% | Score Impact: -2.1 | Cohort: 89% power users

“You removed bulk actions I used 20 times per day. This breaks my entire workflow.”

“Advanced search filters gone. Years of saved queries useless. Considering [Competitor].”

“No announcement, no migration guide. Just deleted features paying customers relied on.”

Specific missing features mentioned:

  • Bulk edit/actions (22 mentions)
  • Advanced filter builder (18 mentions)
  • Custom field sorting (14 mentions)
  • Regex search (11 mentions)
  • API rate limit increases (9 mentions)

Churn risk: 11 detractors explicitly mentioned evaluating competitors or canceling. Estimated annual contract value: $180K-$240K based on power user ARPU.

Action: Emergency restoration of top 3 features (bulk edit, advanced filters, custom sorting) in hotfix release. Estimated impact: +15-18 NPS points, churn prevention.

Feature Discoverability

Prevalence: 44% | Score Impact: -1.2 | Cohort: 65% power users

“Everything moved. 30-minute learning curve just to find settings I access daily.”

“No migration guide, no ‘what changed’ documentation. Flying blind.”

Action: Create contextual “What’s New” guide, add feature discovery tooltips, publish migration documentation. Impact: +6-8 NPS points.

Communication Gap

Prevalence: 38% | Score Impact: -0.9 | Cohort: 71% power users

“Beta program ignored our feedback. Why ask if you won’t listen?”

“No warning about breaking changes. Woke up to a different product.”

“Feels like you optimized for new users and abandoned existing customers.”

Action: Immediate outreach to power users acknowledging concerns, publish transparent roadmap for feature restoration, establish power user advisory board. Impact: +4-5 NPS points (trust recovery).


Passive Drivers

Mixed Sentiment on Redesign

Prevalence: 52% | Conversion opportunity: 18-22 passives

“Looks better but I’m less productive now. Need time to adjust.”

“Performance is great but missing features I need.”

Action: Feature restoration will likely convert majority of passives to promoters. Estimated impact: +9-11 NPS points.

Documentation Gaps

Prevalence: 41% | Conversion opportunity: 12-16 passives

“Good changes overall but no guide on where things moved.”

Action: Comprehensive “What’s New” guide with before/after feature mapping. Impact: +5-6 NPS points.


Cohort Analysis

Cohort Count NPS % of Revenue* Risk Level
New Users (<30 days) 68 +70 8% LOW
Regular Users 52 +28 32% MEDIUM
Power Users 30 -18 60% CRITICAL

*Estimated based on typical SaaS power user patterns

Critical Insight: Revenue concentration among detractors creates immediate business risk. Power users generate 60% of revenue but represent 67% of detractors.


Rollout Decision Framework

PAUSE Recommendation - Supporting Evidence

  1. Revenue Risk: 73% of detractors are power users representing ~60% of revenue
  2. Churn Signals: 11 users mentioned competitor evaluation (7.3% of total respondents)
  3. Fixable Issues: Top 3 complaints are feature restorations (estimated 2-3 week fix)
  4. Positive Foundation: 70 NPS from new users validates product direction
  5. Quick Win Opportunity: Addressing top issues could shift NPS from 47 to 65+

Before Resuming Rollout

Phase 1: Emergency Response (Week 1-2)

  • Restore bulk edit functionality
  • Restore advanced filter builder
  • Restore custom field sorting
  • Publish feature restoration timeline
  • Direct outreach to 11 at-risk accounts

Phase 2: Experience Fixes (Week 2-3)

  • Create interactive “What’s New” tutorial
  • Publish migration guide (old feature → new location)
  • Add feature discovery tooltips
  • Enable legacy view toggle for power users (temporary)

Phase 3: Communication & Trust (Week 3-4)

  • Host power user AMA/feedback session
  • Establish power user advisory program
  • Publish transparent 90-day roadmap
  • Create tiered rollout plan (new users → regular → power)

Phase 4: Validation (Week 4-5)

  • Re-survey power user cohort (target: NPS 40+)
  • Monitor churn rate (target: <2%)
  • Track feature adoption in restored features
  • Verify detractor rate drops below 20%

Success Criteria Before Full Rollout

  • Overall NPS: 55+ (currently 47)
  • Power user NPS: 30+ (currently -18)
  • Detractor rate: <20% (currently 30%)
  • Zero active churn threats from power users
  • <10% “missing feature” complaint rate

Estimated NPS Impact by Action

Action Estimated Impact Timeline Priority
Restore bulk edit +8-10 points 1-2 weeks URGENT
Restore advanced filters +5-7 points 1-2 weeks URGENT
Restore custom sorting +2-4 points 1-2 weeks HIGH
Migration documentation +6-8 points 1 week HIGH
What’s New tutorial +4-5 points 1 week HIGH
Power user outreach +3-5 points Ongoing HIGH
Feature discovery UI +3-4 points 2 weeks MEDIUM

Combined potential impact: +31-43 NPS points, yielding projected NPS of 78-90 post-remediation.


Risk Assessment

Immediate Risks (If Rollout Continues)

  • Revenue: $180K-$240K ARR at immediate risk from stated churn intent
  • Reputation: Power users are influencers; negative word-of-mouth amplified 3-5x
  • Competitive: 11 users actively evaluating alternatives creates beachhead for competitors
  • Morale: Beta feedback ignored signals product team disconnect

Mitigation Benefits (If Paused)

  • Trust Recovery: Demonstrates customer-first approach, long-term loyalty building
  • Product Market Fit: Validates new user direction while preserving power user value
  • Reduced Churn: Feature restoration prevents immediate cancellations
  • Strategic Positioning: Creates differentiation vs competitors who abandoned power users

Confidence & Methodology

  • Method: Thematic analysis using TF-IDF vectorization and K-means clustering (k=4 per segment), sentiment correlation analysis
  • Sample Size: 150 responses (106 with detailed comments)
  • Confidence Level: High for power user segment (30 responses, clear themes), Medium for overall due to cohort imbalance
  • Limitations:
    • Self-selected respondents may skew negative (unhappy users more likely to respond)
    • 2-week post-launch may not capture long-term adaptation
    • Revenue estimates based on industry benchmarks, not actual account data
    • Causation inferred from correlation

Final Recommendation

PAUSE the rollout immediately.

The 70 NPS from new users validates product direction, but -18 NPS from revenue-driving power users creates existential risk. With focused effort over 3-4 weeks, you can:

  1. Prevent $180K-$240K in immediate churn risk
  2. Recover power user satisfaction (projected NPS shift: -18 → +40)
  3. Maintain new user momentum (70 NPS foundation)
  4. Position for sustainable 75+ NPS at scale

This is a fixable crisis, not a failed launch. The product direction is sound; execution on power user migration was inadequate. A 3-4 week pause to restore critical features and rebuild trust will yield stronger long-term outcomes than pushing forward and losing your most valuable customers.

Next Step: Convene immediate war room with product, engineering, and customer success to scope 2-week emergency sprint for top 3 feature restorations.