Goal

Continuing the product engineer career path discussion, this article helps software engineers build a basic product thinking framework:

  1. What validation stages does product innovation usually go through?
  2. What qualitative judgment should be made at each stage?
  3. What quantitative metric can be used to validate that judgment?

This article draws on Lean Analytics, a book on validating innovation that also helps engineers develop product thinking.

Recommended by Kevin Weil, Dan Martell, Fan Bing, Zhang Ximeng, and Ding Lei.

Why

Software engineers often join product work from the delivery side. They know how to build the system, but may not have a clear framework for judging whether the product direction itself is valid.

Common gaps include:

  • Not knowing which stage the product is currently in
  • Treating all metrics as equally important
  • Confusing feature delivery with product progress
  • Optimizing technical or operational details before validating the core product risk
  • Lacking a shared language for discussing product value, business risk, and user behavior

This article uses Lean Analytics to provide a simple operating framework:

  • Use stages to locate the current product uncertainty
  • Use qualitative questions to clarify what needs to be judged
  • Use quantitative metrics to validate whether the product is moving forward

How

The core process is:

  1. Identify the current product stage.
  2. Identify the main question of that stage.
  3. Choose the evidence that can validate the question.
  4. Choose the quantitative metric that best represents the evidence.
  5. Use the metric result to decide whether to keep iterating, change direction, or move to the next stage.

Note: The underlying logic draws on On Contradiction (identify the main question at each stage) and On Practice (test judgments through practice). Interested readers can explore both essays in Selected Works of Mao Zedong.

What

This article has four parts:

  1. Product Decision Pattern: how to turn product uncertainty into decisions.
  2. Metrics: how to choose useful indicators.
  3. Stages: how product innovation stages map to main questions, OMTM, focus, pass logic, and examples.
  4. Business Model Metric References: stage-based metric references for different business models.

Product Decision Pattern

Use Stage to Choose Metrics

Different stages require different metrics.

The metric should serve the current biggest risk. A product in the empathy stage should not optimize channel ROI. A product with weak retention should not treat paid acquisition as the main problem.

Use Metrics to Decide Actions

SituationDecision Focus
The metric worsensLocate the bottleneck
The metric improvesJudge whether the stage risk has been reduced
The metric is distortedReturn to user behavior and qualitative evidence
The metric improves but the business does notRecheck whether the metric is tied to the right risk

Use Stage Signals to Ask for Resources

The stages are introduced in the Stages section below. For product engineers, stage signals are evidence for asking the company to start, continue, or expand a project.

Stage SignalInternal Resource Request
Empathy signal is clearAsk for time to build a prototype or run a focused experiment
Stickiness signal is clearAsk for engineering, design, or data support to improve the product loop
Stickiness and revenue signals are both clearAsk for more resources based on PMF evidence
Revenue signal is clearAsk for sales, marketing, pricing, or infrastructure resources
Scale signal is clearAsk for larger team allocation, channel investment, operations support, or platform work

Note: In startup language, these signals are similar to PMF evidence. Founders use PMF evidence to ask investors or partners for more resources; product engineers can use stage evidence to make similar resource requests inside a company.

Metrics

Metrics are useful only when they help a team make a decision.

What Makes a Good Metric

PrincipleMeaning
ActionableWhen the metric changes, the team knows what to adjust
ComparableIt can be compared with history, targets, segments, or competitors
Ratio firstRatios show efficiency and quality better than raw volume
Simple and clearNon-data roles can understand it
Problem-revealingA decline can expose the business bottleneck

OMTM: One Metric That Matters

OMTM is the one metric that best represents whether the current main risk is being reduced.

A good OMTM should answer three questions:

  1. What is the current main risk?
  2. Which metric best shows whether that risk is improving?
  3. What action will the team take based on the result?

Common Metric Types

These types are useful as a checklist, not as the main framework.

TypeRoleExamples
Vanity metricsShow scale but do not directly guide decisionsPV, total registered users, cumulative downloads
Action metricsGuide product or business actionConversion rate, retention rate, CAC, LTV
Leading indicatorsSignal future outcomes earlyActivation rate, key action completion rate, day-1 retention
Lagging indicatorsReflect final outcomesRevenue, profit, GMV, churn rate
Qualitative evidenceExplain why something happensUser interviews, support feedback, review text
Quantitative evidenceJudge scale and changeFunnel data, retention curves, revenue data

Stages

The stage model answers two questions:

  1. What is the main uncertainty of the current business?
  2. How much evidence is enough to move to the next stage?

The standards below are directional. The actual threshold depends on business model, usage frequency, margin structure, acquisition cycle, and product maturity.

StageCore QuestionOMTM TendencyMinimum Standard for the Next Stage
EmpathyDoes the problem really exist?Valid interviews, reservation rate, manual conversion rateClear target users, real pain, existing alternatives, willingness to act
StickinessDo users keep using it?Activation rate, retention rate, key action completion rateStable retention, clear core value, repeatable activation path
ViralityDo users bring new users?Share rate, invitation conversion rate, viral coefficientInvited users activate and retain, organic spread reduces CAC
RevenueCan it make money?Paid conversion rate, LTV/CAC, gross marginAcceptable unit economics, repeatable revenue, controllable cost structure
ScaleCan growth be amplified efficiently?Channel ROI, CAC payback period, profit marginGrowth, quality, organization, and finance remain controlled

Empathy: Does a Real Problem Exist?

Step 1: Main Question

Whether the target user has a real, painful problem worth solving.

Step 2: Focus

FocusWhat to JudgeEvidenceCommon MistakePass Signal
Problem intensityWhether the problem is painful in a concrete scenarioInterview signal, problem frequencyListening to what users say instead of observing what they doUsers describe the scenario, loss, and current workaround clearly
Existing alternativesWhether users already spend effort solving the problemCurrent workaround, paid alternative, manual processTreating no alternative as a good signUsers already use a workaround, paid product, or manual process
Willingness to actWhether users will spend money, time, or switching costReservation rate, trial request, manual conversion rateTreating verbal interest as real demandUsers leave information, try, reserve, pay, or spend time
Target usersWhich segment feels the pain most stronglySegment-level interview signalAveraging feedback across weak and strong usersThe team can explain who feels the pain most, why, and when

Step 3: Possible OMTM

Valid interviews, reservation rate, or manual conversion rate. Choose one based on the riskiest assumption in the current iteration.

Step 4: Pass Logic

  • Move forward when: the problem, target user, existing alternative, and willingness to act are clear.
  • Risk of skipping: the team may build a solution for an imagined problem.

Example

Suppose the product is an AI code review SaaS. At this stage, the team should not start by measuring model accuracy alone. The first question is whether engineering teams already suffer from review delay, inconsistent review quality, or repeated manual checklist work. Strong evidence would include teams using custom scripts, written review rules, senior engineers spending repeated time on similar comments, or trial requests after seeing a manual demo.

Stickiness: Do Users Keep Using It?

Step 1: Main Question

Whether users keep using the product because it creates real value.

Step 2: Focus

FocusWhat to JudgeEvidenceCommon MistakePass Signal
ActivationWhether new users can reach the first core valueActivation rateTreating registration as activationNew users can consistently complete the core action
RetentionWhether users return within the expected usage cycleDay-1, day-7, day-30 retentionLetting new user growth hide weak retentionCore users keep returning within a reasonable cycle
Usage depthWhether repeated usage happens on the core value pathCore action frequency, task completion rateTreating any activity as core value usageUsers repeatedly use the core value path
Key behaviorWhich behavior predicts long-term retentionBehavior cohort analysisTreating every click as meaningful behaviorThe team can identify behaviors strongly related to long-term retention

Step 3: Possible OMTM

Activation rate, retention rate, or key action completion rate. Choose one based on whether the bottleneck is first value, repeat usage, or a specific retained-user behavior.

Step 4: Pass Logic

  • Move forward when: retention is stable, core value is clear, and new users can repeatedly reach that value.
  • Risk of skipping: scaling acquisition usually only exposes churn faster.

Example

For the AI code review SaaS, stickiness depends on whether teams repeatedly run reviews through the product after the first trial. A useful OMTM may be weekly active repositories with completed AI reviews, because it ties usage to the actual review workflow instead of counting logins or page views.

Virality: Do Users Bring New Users?

Step 1: Main Question

Whether user behavior can create new users without relying only on paid acquisition.

Step 2: Focus

FocusWhat to JudgeEvidenceCommon MistakePass Signal
SharingWhether users share or invite for a real product reasonShare rate, invitation rateTreating share-button clicks as real spreadSharing comes from value, relationship, collaboration, or identity expression
ConversionWhether invited users accept and activateInvitation acceptance rate, share-to-activation rateCelebrating exposure without conversionInvited users activate and retain
Viral loopWhether each user brings in new users within a reasonable cycleViral coefficient, propagation cycleReading viral coefficient without propagation timeOrganic spread reduces overall CAC
User qualityWhether referred users retain and behave like good usersReferred-user retention, complaint rateDriving low-quality users through rewardsNew user quality, retention, and complaints do not worsen significantly

Not every business must pass through the virality stage. Low-frequency, high-ticket, transaction-heavy businesses may move from stickiness directly to revenue validation.

Step 3: Possible OMTM

Share rate, invitation conversion rate, or viral coefficient. Choose one based on whether the current risk is motivation, conversion, loop efficiency, or referred-user quality.

Step 4: Pass Logic

  • Move forward when: sharing has a real motivation, invited users activate and retain, and organic spread lowers acquisition cost without damaging quality.
  • Risk of skipping: referral or sharing mechanisms may bring low-quality users without sustainable growth.

Example

For the AI code review SaaS, virality may come from collaboration rather than public sharing. If one engineer installs the tool and then invites teammates to comment, approve, or configure repository rules, workspace invite activation becomes more meaningful than generic share rate.

Revenue: Can It Make Money?

Step 1: Main Question

Whether product value can become repeatable revenue.

Step 2: Focus

FocusWhat to JudgeEvidenceCommon MistakePass Signal
Payment intentWhether users pay for the product valuePaid conversion rate, trial-to-paid rateTreating free usage as willingness to payUsers pay for the product value
Pricing logicWhether users understand what value they are paying forARPU, plan selection, discount sensitivityTesting price without understanding perceived valueThe team can explain why users pay and which value they pay for
Revenue repeatabilityWhether payment repeats through renewal, repurchase, or expansionRenewal rate, repeat purchase rate, expansion revenueTreating one-time payment as repeatable revenuePayment, renewal, or repeat purchase is not accidental
Unit economicsWhether revenue can cover acquisition and delivery costLTV/CAC, gross margin, payback periodLetting revenue growth hide unsustainable costLTV covers CAC, fulfillment cost, and service cost

Step 3: Possible OMTM

Paid conversion rate, LTV/CAC, or gross margin. Choose one based on whether the current risk is payment intent, acquisition efficiency, or delivery cost.

Step 4: Pass Logic

  • Move forward when: revenue is repeatable, pricing logic is clear, and unit economics are acceptable.
  • Risk of skipping: growth may amplify an unprofitable business model.

Example

For the AI code review SaaS, revenue validation begins when repeated review usage turns into paid team or company accounts. Trial-to-paid rate may be the first useful metric, but renewal rate, expansion seats, and LTV/CAC become more important once teams depend on the tool in their engineering workflow.

Scale: Can Growth Be Amplified Efficiently?

Step 1: Main Question

Whether growth can be amplified without losing efficiency, quality, or financial control.

Step 2: Focus

FocusWhat to JudgeEvidenceCommon MistakePass Signal
Growth efficiencyWhether channels keep working as spend increasesChannel ROI, CAC payback periodLetting total growth hide channel-level lossesCore channel ROI is stable, and CAC does not deteriorate quickly
Organizational efficiencyWhether delivery and experiment speed remain healthyRevenue per employee, experiment throughputUsing headcount growth as the main scaling methodDelivery efficiency and experiment efficiency do not decline significantly
Quality stabilityWhether more volume creates proportional quality problemsComplaint rate, failure rate, fulfillment failure rateIgnoring systemic problems amplified by scaleComplaints, failures, and fulfillment issues do not worsen proportionally with scale
ProfitabilityWhether larger scale improves or preserves financial healthProfit margin, cash flow, marginal cost at scaleAssuming bigger scale automatically improves profitGross margin, cash flow, and payback period support continued investment

Step 3: Possible OMTM

Channel ROI, CAC payback period, or profit margin. Choose one based on whether the current risk is acquisition efficiency, cash recovery, or profitability.

Step 4: Pass Logic

  • Keep scaling when: growth, quality, organization, and finance remain controlled.
  • Risk of skipping: scale may amplify channel losses, quality failures, and organizational inefficiency.

Example

For the AI code review SaaS, scale should be judged after retention and revenue are working. At this stage, CAC payback, NRR, gross margin, and revenue per employee matter because growth may increase onboarding support, repository integration work, and inference cost.

Business Model Metric References

Stage-based metric references for common business models.

E-commerce / Transaction Platform

Core logic: traffic -> supply -> conversion -> repeat purchase -> profit.

StageMetric ReferencesJudgment Point
EmpathySearch behavior, interview signal, existing purchase path, manual order conversionUsers already have purchase intent or existing transaction behavior
StickinessRepeat purchase rate, purchase frequency, reorder interval, saved items, cart recoveryUsers return for the category or transaction need
ViralityReferral conversion rate, share-to-purchase rate, group-buy participation, invite-driven GMVSharing creates new transactions
RevenueGMV, take rate, gross margin, subsidy rate, fulfillment cost, LTV/CACRevenue quality is visible beyond transaction volume
ScaleChannel ROI, CAC payback period, supply coverage, fulfillment failure rate, cash conversion cycleGrowth can be evaluated across acquisition, supply, fulfillment, and cash flow

SaaS / Subscription Business

Core logic: acquisition -> activation -> usage -> retention -> payment -> expansion.

StageMetric ReferencesJudgment Point
EmpathyProblem interviews, workflow frequency, current tool usage, manual workaround, trial requestUsers already have a repeated workflow problem
StickinessActivation rate, first core task completion rate, WAU/MAU, feature usage depth, cohort retentionUsers repeatedly complete the core workflow
ViralityWorkspace invite rate, invite activation rate, collaboration-created accounts, team adoption depthCollaboration brings in qualified users
RevenueTrial-to-paid rate, MRR, ARR, ARPU, churn rate, renewal rate, LTV/CACUsage converts into recurring revenue
ScaleCAC payback period, NRR, seat expansion, revenue per employee, gross marginGrowth is supported by retention, expansion, and efficient acquisition

UGC / Community

Core logic: users create content -> content is consumed -> interaction gives feedback -> creators keep contributing -> the community retains.

StageMetric ReferencesJudgment Point
EmpathyCreator interviews, existing publishing behavior, community participation, manual content contributionUsers already have creation, discovery, or interaction needs
StickinessCreator retention, consumer retention, posting frequency, consumption depth, interaction rateCreators and consumers both keep returning
ViralityShare rate, invite conversion rate, content-driven signup rate, follow graph growthContent or relationships bring in new retained users
RevenueAd revenue per user, creator monetization rate, paid community conversion, take rate, LTV/CACMonetization can be tracked without losing creator and consumer signals
ScaleDAU/MAU, active creators, high-quality content ratio, moderation pass rate, report rateGrowth can be evaluated across activity, supply, quality, and moderation