How-To Guide12 min read

How to Decide What to Build Next from Real Customer Evidence

Last updated: · By Matt Teixeira, Founder and CEO

On this page
Short answer

To decide what to build next from real customer pain points, group 90 days of feedback by the problem behind each request, then size each problem by unique accounts, ARR, severity, and trend. Score the top five to ten with one framework, such as RICE, check the order against this quarter's goal, and write down the evidence behind each bet.

The framework matters less than what you feed it. RICE with guessed reach is gut feel with decimals; RICE with counted accounts and linked quotes survives a planning review.

Key Takeaways

  • Group feedback by the problem behind each request, and keep the customer's words and a source link on every item.
  • Size each pain point by unique accounts, segments and ARR, severity, and trend. Count accounts, not mentions.
  • Set the evidence bar before you look at the list, so it cannot bend toward the item you already wanted.
  • Score only the finalists, with one framework, and override the order only for a strategic reason you write down.
  • Give every bet an evidence brief with counts, quotes, a "not doing" line, and a success metric.

What Counts as Real Customer Evidence?

Evidence is something a customer said or did that you can trace to a source, an account, and a date. "Enterprise customers keep asking for SSO" is an opinion until you can name the accounts. Each source sizes one thing well and distorts another:

SourceBest for sizingWatch out for
Support tickets and chatsFrequency and trendSkews toward bugs and new users
Sales calls and closed-lost notesRevenue at stakeProspects are not customers; keep pipeline apart from ARR
Customer interviewsContext, severity, workaroundsSmall samples; over-weighting the latest call
Churn and renewal notesSeverityStated reasons are often incomplete
Surveys and usage dataImportance, satisfaction, reachShow what, not why

Competitor reviews add a sixth source: problems your rivals' customers describe that yours may share, covered in how to find product opportunities in competitor reviews.

Counts tell you where to look, not what to build. Teresa Torres warns that tickets, sales conversations, and feature requests often lack context, which "puts us at risk of addressing the wrong opportunity," and suggests using them as inspiration for interviews (Product Talk).

Step 1: Pull 90 Days of Feedback into One List

Export the last 90 days from every source into one list with five fields per item: the customer's words, a source link, the account, the date, and plan or ARR. Ninety days smooths out one bad week and still reflects today's product. If feedback is spread across Slack, tickets, Notion, and your CRM, start with how to centralize customer feedback.

Step 2: Group Feedback by Pain Point, Not Feature Request

A feature request is the customer's proposed solution; a pain point is the problem underneath it. Group on the problem, because different requests often describe one pain:

  • "Add a Salesforce sync," "let me export deals to CSV," and "why do I type this twice?" all become reps re-enter deal data in two tools.
  • "Dark mode" could mean the dashboard is hard to read at night, or just a preference. The quotes tell you which.

Write each pain point as a one-line problem in the customer's language. Jobs-to-be-done methods push the same way: Tony Ulwick's Outcome-Driven Innovation focuses "on jobs-to-be-done rather than product improvements" (Wikipedia). For naming and nesting rules, see how to build a customer feedback taxonomy.

Step 3: Size Each Pain Point on Four Signals

Use the same four signals for every pain point:

  1. Frequency: unique accounts that raised it in 90 days. One customer posting in five channels is still one account.
  2. Who is affected: their segments and combined ARR, with pipeline from lost or stalled deals in its own column.
  3. Severity: 3 if it blocks a core job or was named in a churn or lost deal, 2 if the workaround is costly, 1 if it is an annoyance.
  4. Trend: accounts in the last 30 days against the monthly average of the 60 days before: rising, flat, or falling.
Markdown table
Pain pointAccounts (90d)SegmentsARR affectedPipeline at riskSeverity (1-3)TrendTop quote (link)
[Problem statement][n][Enterprise, SMB][$][$][1-3]Rising / Flat / Falling"[quote]"

Show ARR next to the account count, never instead of it, so one large logo cannot set the roadmap. Why feature voting fails covers revenue weighting in depth.

Set the Evidence Bar Before You Look
Decide the minimum evidence for scoring, such as three or more accounts, before you see the list. Set it afterward and it drifts to fit the item you already wanted. Items below the bar go to a research list for interviews, not into the trash.

Step 4: Score the Finalists with One Framework

Score only the top 5 to 10 pain points, and keep one framework for the quarter so scores stay comparable. Pick it by the decision you are making:

FrameworkUse it to decideInputs from your evidenceMain risk
RICEWhich solution to build nextAccounts, severity, corroboration, plus effortGuessed inputs; effort swings the result
Opportunity scoringWhich outcomes are most underservedImportance and satisfaction surveySurvey design and sample size
Opportunity solution treeWhich problem to pursue toward an outcomeSized pain points plus regular interviewsNeeds a clear outcome and weekly discovery

RICE: Reach, Impact, Confidence, Effort

Sean McBride introduced RICE on Intercom's blog as Reach × Impact × Confidence ÷ Effort (Intercom). Reach is people or events per period, Impact runs from 3 (massive) to 0.25 (minimal), Confidence is 100%, 80%, or 50%, and Effort is total person-months.

Fill the first three from Step 3 instead of guessing. One workable mapping: Reach is the account count; severity 3 is Impact 2 or 3, severity 2 is Impact 1, and severity 1 is Impact 0.5; Confidence is 100% when two or more source types agree, 80% for one, and 50% for anecdotes. Effort needs a concrete solution to estimate, so RICE ranks solutions, not raw problems, and McBride says the scores "shouldn't be used as a hard and fast rule."

Opportunity Scoring: Importance Versus Satisfaction

Opportunity scoring comes from Tony Ulwick's Outcome-Driven Innovation, introduced in a 2002 Harvard Business Review article. You survey customers on how important each outcome is and how satisfied they are today, then compute importance + max(0, importance − satisfaction) (Strategyn). Strategyn measures both as the share of top-two ratings and calls important, poorly satisfied outcomes underserved (Strategyn).

On a 0 to 10 scale, 8.1 importance and 3.0 satisfaction scores 13.2; 6.0 and 7.0 scores 6.0. There is no effort term, so add a rough cost check.

Opportunity Solution Trees and Continuous Discovery

Teresa Torres of Product Talk describes the opportunity solution tree as "a simple way of visually representing the paths you might take to reach a desired outcome" (Product Talk): one outcome, then opportunities (unmet needs, pain points, and desires), then solutions, then assumption tests. It is central to her 2021 book Continuous Discovery Habits (Product Talk), and she defines continuous discovery as "weekly touch points with customers by the team building the product, where they conduct small research activities in pursuit of a desired outcome" (Product Talk).

Torres compares sibling opportunities on sizing (how many customers, how often) and on market, company, and customer factors, leaving effort out so teams do not "rule out an opportunity too early." Your Step 3 numbers fill in the sizing; use them to choose who to interview, not to skip interviewing.

Step 5: Check the Ranking Against Strategy

A ranked list is an input, not a decision. Ask four questions of each top candidate:

  1. Does it move this quarter's outcome, such as enterprise retention or activation?
  2. Are the affected accounts in the segment you are trying to win?
  3. Is it already in progress, or blocked by other work?
  4. Does it fit beside the capacity you reserve for non-customer work, such as security?

Keep the scored order unless an answer says otherwise, and write the reason in one sentence. When a stakeholder wants to jump the queue, ask for the same evidence (how to stop the loudest stakeholder from driving your roadmap). To audit an existing roadmap, run the roadmap evidence check.

Step 6: Write an Evidence Brief for Every Bet

Write down why you chose each bet, or nobody will remember by next planning. Attach a brief like this to the roadmap item or ticket:

Markdown template
## [Bet name]
Problem: [one sentence in the customer's words]
Evidence: [n] accounts in 90 days · [segments] · $[ARR] affected · trend [rising/flat/falling]
Severity: [1-3], because [churn, lost deal, or workaround]
Score: [framework and score], confidence [%]
Quotes:
- "[quote]" ([account], [source link])
- "[quote]" ([account], [source link])
Why now: [link to this quarter's outcome]
Not doing: [related requests left out, and why]
Success metric: [what should change] · check on [date]

Teams skip the "Not doing" line, yet it settles next quarter's arguments. On the check date, see whether complaints about the pain point fell. The build from evidence playbook shows how to link each requirement to the insights behind it.

Worked Example: Choosing Between Three Candidate Bets

This example is illustrative, not real customer data. A 12-person B2B SaaS team with about 400 paying accounts pulls 90 days of feedback from Zendesk, Gong, Slack, and interview notes. Three pain points clear the bar, each with a candidate solution sized in person-months:

Pain pointMentionsAccountsARR affectedSeverityTrendRICE
A. Dashboards load slowly in large workspaces5231$410k2Rising31 × 1 × 0.8 ÷ 2 = 12.4
B. Cannot share reports outside the workspace2718$620k3Flat18 × 2 × 1.0 ÷ 3 = 12.0
C. Dark mode449$60k1Flat9 × 0.5 × 0.5 ÷ 0.5 = 4.5
  • Mentions misled. Dark mode had the second-most mentions, mostly from a few Slack regulars, but the fewest accounts.
  • RICE nearly tied A and B. A came almost entirely from tickets, so it got 80% Confidence. B earned Impact 2 and full Confidence from two closed-lost deals and a renewal call.
  • Strategy broke the tie. The quarter's goal was enterprise net revenue retention, and 14 of B's 18 accounts were enterprise. The team picked B and wrote: "Enterprise admins cannot share reports with their own executives, and two deals were lost over it."
  • A went next, with research. Because A was rising, the PM booked five interviews to learn which dashboards were slow.
  • C was parked, not ignored. The team replied to the nine accounts.

Common Mistakes to Avoid

  • Guessing RICE inputs. If the numbers were not counted, the score only formalizes a hunch.
  • Scoring everything. Size every pain point, but score only the finalists; precise scores on the long tail are wasted effort.
  • Never checking the result. Without a success metric and a date, you cannot tell good bets from lucky ones.

Tools That Help

A spreadsheet is enough to start; tools earn their place by doing the counting and keeping quotes attached. For ranked comparisons, see the best AI tools to turn feedback into ranked opportunities for Steps 1 to 3 and the best product roadmap prioritization tools for scoring and planning.

  • Spreadsheet plus whiteboard (free): the Step 3 columns, a RICE formula, and Teresa Torres's opportunity solution tree template on Miro.
  • Jira Product Discovery: attach quotes and ticket links to ideas, including from Slack, and let insights move a prioritization score (Atlassian). Free for up to 3 creators; Standard is $10.50 per creator per month (Atlassian pricing). Feedback analysis is mostly manual.
  • Productboard: the Customer Importance Score adds 0 to 3 points per linked insight, counting each user once (Productboard), and formulas can model RICE, ICE, and WSJF (Productboard). Formulas need Business or Enterprise (Productboard pricing); Business is $59 per maker per month billed annually (Productboard).
  • Canny: scores are "essentially weighted impact divided by the effort required," with inputs such as MRR, opportunity revenue, and votes from key segments (Canny). Pro starts at $79 a month billed yearly (Canny pricing).

Where Deck Fits

Deck automates Steps 1 to 3 and keeps the evidence attached through Step 6. It pulls feedback from tools such as Intercom, Zendesk, Slack, Gong, and CRMs, groups quoted insights into Themes, and ranks them in the Opportunity Backlog. Each week it gives every opportunity an Impact score from 0 to 10, built from evidence volume, sentiment pressure, source diversity, customer breadth, trend acceleration, confidence, and novelty, minus a penalty for contradicting evidence.

  • Evidence behind each rank: customers affected, sentiment, month-over-month trend, confidence, risk signals, and top quotes, with the underlying insights one tab away (Deck docs). With segments enabled, you can see how an opportunity ranks for one segment.
  • From pick to work: create an Initiative or Project from an opportunity and the evidence carries over. Projects hold success metrics, link to Linear or Jira, and attach new feedback after launch (Deck Projects docs).
  • Agent-run sessions: an AI agent can run the 30-minute prioritize your backlog playbook through Deck's MCP server, which is on every plan. For which calls an agent should and shouldn't make, see what an AI product manager agent is.
  • Limitations: the Impact score has no effort input, and Deck's agent builds a RICE score only when asked, labeled as its own (Deck workflow docs). Revenue is not a documented score signal; ARR arrives as CRM fields you filter by, on Business and above (Deck HubSpot docs). The default list hides opportunities with fewer than three pieces of evidence, and Deck has no public voting board and fewer public reviews than older tools.

Free is $0 with 200 AI credits a month and 1 integration; Starter is $99 a month ($79 billed annually) with 5; Business is $249 a month ($199 billed annually) and adds CRM integration. To test it, start on the Free plan with your busiest source and compare Deck's top five with your own.

Frequently Asked Questions

Make every candidate carry counted evidence: unique accounts affected, segments and ARR, severity, and trend, each backed by linked quotes. Score the finalists with one framework fed by those counts, override the order only for a written strategic reason, and check later whether each bet moved its success metric.

There is no single best one. Use RICE to compare concrete solutions when you can estimate effort, opportunity scoring when you can survey customers, and an opportunity solution tree when the team has a clear outcome and talks to customers weekly.

Set a bar before you look at the list, such as three or more unique accounts in 90 days plus one quote that explains the impact. Items below the bar are not rejected. They go to a research list so interviews can confirm or rule them out.

Lean on interviews rather than counts. Ask five to ten target customers about the last time they hit the problem, write the pains down in their words, and rank them on severity and how often they come up unprompted.

AI can do the reading, grouping, counting, and first-pass ranking that takes a person days, and show the quotes behind each rank. The decision should stay with people, because strategy, timing, and cross-team tradeoffs are not in the feedback.

Sources