Listen Here

| |

Actionable
Takeaways

Single-item questionnaires violate measurement principles:

Denny's background in psychometrics immediately flagged NPS as unreliable. One-item measures lack the redundancy needed for reliability, and the methodology of throwing out middle responses (7s and 8s) then subtracting detractors from promoters is statistically nonsensical. At a previous company with thousands of data points, he observed NPS scores drop and rise based solely on how the survey rendered on the page—no business changes, just UI differences. When presentation affects your metric independent of the underlying construct, your instrument is broken. Founders with technical backgrounds should trust their instincts when measurement methodology feels scientifically unsound.

Compensation drives behavior more than metric accuracy:

Portnox structures customer success compensation as 50% gross revenue retention and 50% net revenue retention. These are determined by finance and can't be manipulated. Denny had to rein in his CS team when they became overly focused on time-to-value because any number you give a team becomes their obsession. With NPS, teams game survey timing, cherry-pick recipients, and optimize for score rather than outcome. This is the Heisenberg principle applied to business: measuring changes the behavior. Choose metrics where gaming the number aligns with improving actual business outcomes.

Investors evaluate retention rates, not satisfaction surveys:

When Denny presents gross retention above 90%, investors don't ask about NPS. Renewal behavior reveals actual satisfaction—customers voting with budget rather than survey responses. The test for any metric: "What are we doing differently if this number is up versus down?" If it doesn't drive distinct actions or reveal information not already visible in financials, eliminate it. NPS often becomes a number that exists because "we've always measured it," inherited from previous leadership without questioning its utility.

Question inherited practices ruthlessly:

NPS gained adoption through Harvard Business Review credibility in 2003 and consulting firms building practices around it. The promise of "one number you need" appeals to executives wanting simple solutions. But herd behavior—"everyone else measures it"—perpetuates bad methodology. Denny's advice to founders stuck with NPS: give your team something else to focus on (gross retention is straightforward: don't let customers churn), then stop doing it. Sometimes you need to point to external validation to break internal momentum. The question isn't whether NPS correlates somewhat with growth—it's whether better alternatives exist that can't be gamed.

Conversation
Highlights

 

Why Net Promoter Score Is Fundamentally Broken: A Cognitive Scientist’s Case Against Silicon Valley’s Favorite Metric

Your board wants to see the number. Your customer success platform automatically sends the survey. Every SaaS company you know tracks it religiously. But what if Net Promoter Score is not just imperfect—what if it’s actively misleading your organization?

In a recent episode of BUILDERS, Denny LeCompte, CEO at Portnox, made a case against NPS that’s different from the typical criticism. His argument doesn’t come from anecdotal frustration—it comes from psychometric science. Before leading Portnox through 8x growth over four years, Denny was a cognitive scientist who ran experiments and taught psychometrics at the university level. He knows how to measure human behavior correctly, and NPS violates fundamental principles.

 

The UI Experiment That Broke the Illusion

At a consumer business where Denny worked previously, they had thousands of NPS responses—enough data to be statistically significant. The team made a change to how the survey rendered on the page. Nothing about the business changed. No product improvements, no service updates, no pricing adjustments.

The NPS score dropped.

They reverted the UI back to the original design. The score returned to its previous level.

“If this were measuring something real, that should not matter,” Denny explains. “But it’s just too sensitive to things that don’t matter.”

This is measurement failure. When survey presentation affects your metric independent of the underlying construct you’re trying to measure, your instrument lacks construct validity. It’s picking up noise instead of signal.

 

Single-Item Measures and Statistical Nonsense

The methodology problems start immediately. “One item questionnaires are notoriously unreliable,” Denny notes. In psychometrics, reliable measurement requires redundancy—multiple questions approaching the same construct from different angles to filter out random variation.

But the calculation itself is worse. NPS uses a 0-10 scale, then: throws out the 7s and 8s, takes the percentage of 9-10 responses, subtracts the percentage of 0-6 responses, and calls this your score.

“I’ve never seen a scale that any psychologist would put together that works like that,” Denny says. “It’s just kind of bonkers, the subtraction. You’re throwing data away.”

This isn’t methodological nitpicking. By discarding the middle distribution and using subtraction rather than averaging, you amplify noise and reduce signal. The resulting number is less informative than a simple mean would be.

 

Why Teams Game the Metric

Even if NPS were statistically sound, it fails because of how humans respond to measurement. At Portnox, Denny observed this with a different metric: time to value. “We told our customer success team drive time to value down. We had to actually rein them in because they became so maniacally focused on it.”

Teams don’t improve underlying outcomes—they optimize the number. With NPS, this manifests predictably: timing surveys right after positive interactions, selectively choosing which customers receive surveys, manipulating context to boost scores.

“You start to think about who you’re going to give that survey to, just trying to give it at the right time to maximize the score,” Denny explains. “And like, well, then what is it telling you? It’s not telling you anything anymore.”

This is the observer effect applied to business metrics. “When you start to measure humans, they will change that measure,” Denny notes. “It’s almost like an Heisenberg kind of principle at work with any of these things.”

The question becomes: which metrics align gaming behavior with actual business value?

 

What Investors Actually Care About

At a previous startup, Denny watched the board obsess over NPS scores. They compared numbers to competitors and demanded improvements. Meanwhile, gross revenue retention—whether customers actually renewed—wasn’t strong.

“If we had NPS up, but net revenue retention stayed down, that’s still not a great business,” Denny points out.

This led to his approach at Portnox: the customer success team tracks exactly two metrics. Gross revenue retention (measuring churn) and net revenue retention (measuring expansion). Both are calculated by finance based on actual revenue. They can’t be gamed.

“If I go to any investor and I say I’ve got gross retention and it’s less than 90, they’re not super happy, but ours is in the 90s,” Denny explains. “And so they don’t really care what my NPS score is. They’re like, clearly, the customers stick with you.”

Compensation reflects this. The CS team’s bonuses are split 50/50: half tied to gross revenue retention, half to net revenue retention. The mandate is simple. “Don’t let people churn,” Denny summarizes. “If they don’t churn, then they’re happy with you.”

Customers vote with budget, not survey responses. Renewal behavior reveals actual satisfaction.

 

The Harvard Business Review Effect

NPS persists because of its origin story. Published in Harvard Business Review in 2003, it promised “the one number you need.” Consulting firms built entire practices around it. The simplicity was seductive.

Then herd behavior took over. “There’s some herd behavior like, well, everybody else is doing it. Why are we not doing it?” Denny observes. Most executives don’t have psychometrics training. When you face pressure and everyone else measures something, you measure it too.

The promise of one question solving all your customer insight needs appeals to executives who want simple solutions. But measuring complex human behavior is never that simple.

 

The Better Alternative

Denny’s test for any metric: “What are we doing different for this number if it’s up versus if it’s down?”

If it doesn’t drive distinct actions or reveal information not already in your financials, it’s consuming resources without providing value.

When Denny started at Portnox, people wanted to implement NPS. He refused. His team worried that gross and net revenue retention were too complicated or only available quarterly. But once he explained that finance handles calculations and the team just needs to prevent churn and drive expansion, they understood. The metrics made intuitive sense.

For founders inheriting NPS from previous leadership, his advice is direct: “Sometimes somebody made a decision, I don’t know, years ago and whoever’s there now sort of inherited it and you can’t stop doing it. But, you know, maybe point to my article, say, see this whole thing is BS, and then stop doing it.”

Give your team something else to focus on first. You can’t leave a vacuum. But gross revenue retention provides that alternative: an ungameable metric that directly correlates with business health.

 

The Measurement Principle

The NPS story reveals how businesses adopt flawed practices. A methodology gets published in a prestigious outlet. Consultants promote it. Herd behavior takes over. Suddenly an entire industry measures something poorly correlated with actual outcomes.

“It’s not completely uncorrelated with growth,” Denny concedes. “It’s just not very well correlated with growth. And there are other measures that are better correlated with growth.”

For technical founders—the people who understand statistical significance and measurement validity—Denny’s message is simple: trust your instincts about methodology. If something feels scientifically unsound, it probably is.

The alternative isn’t complicated: measure what matters, make it ungameable, focus on actual business outcomes. “You’re better off on kind of ungameable. Like, net gross retention is. You can’t game it,” Denny says.

Revenue doesn’t lie. Customers either renew or they don’t. They either expand or they don’t. The accountants add up what customers paid last year versus this year. That’s real data.

Everything else is just noise in the system.

 

Recommended Founder
Interviews

Idan Bar-Dov

CEO and Co-Founder of Heka Global

How Heka Global positioned web intelligence as a fourth fraud detection layer to avoid vendor comparison | Idan Bar-Dov

Amit Gupta

Senior Director of Marketing Operations of Fortanix

Why Marketing Ops Should Be Your First GTM Hire

Justin Beals

CEO, Co-Founder of Strike Graph

Justin Beals, CEO of Strike Graph: $12 Million Raised to Build the Future of Automated Security and Compliance

Nadav Arbel

CEO & Co-Founder of Cyrebro

Nadav Arbel, CEO & Co-Founder of Cyrebro: $51 Million Raised to Build the Future of ML-Backed MDR

Aurelie Guerrieri

Chief Marketing & Alliances Officer of DataDome

Aurelie Guerrieri, Chief Marketing & Alliances Officer at DataDome: 20 Years in Silicon Valley – Insights on the Evolving Tech Landscape

Bill Moore

CEO and Founder of XONA

Bill Moore, CEO and Founder of XONA: $30 Million Raised to Build the Future of OT User Access

Tony Scott

CEO & President of Intrusion

How the ex-White House CIO turned around a failing cybersecurity company by fixing the product first | Tony Scott

Dimitri Sirota

CEO & Co-Founder of BigID

Dimitri Sirota: The GTM Story of BigID ($1.25 Billion Valuation)

Stijn Vande Casteele

Founder of Sweepatic

Stijn Vande Casteele, Founder of Sweepatic: $4.4 Million Raised to Build the Future of External Attack Surface Management

Eric Olden

CEO and Founder of Strata Identity

Eric Olden, CEO and Founder of Strata Identity: $42 Million Raised to Build the Identity Orchestration Category

Oren Kaniel

CEO & Co-Founder of AppsFlyer

Oren Kaniel: The GTM Story of AppsFlyer ($2 Billion Valuation)

Matthew Howard

SVP & CMO of Virtru

How to Time Analyst Relations for Maximum Category Impact

Robert Cowart

CEO & Co-Founder of ElastiFlow

Robert Cowart, CEO & Co-Founder of ElastiFlow: $8 Million Raised to Power the Future of Network Performance and Security Analytics

Danny Lopez

CEO of Glasswall

Danny Lopez CEO of Glasswall: $60+ Million Raised to Make the Content Disarm and Reconstruction (CDR) Category Mainstream

Michael Assraf

CEO & Co-Founder of Vicarius

Michael Assraf, CEO of Vicarius: $29 Million Raised to Build the Future of Vulnerability Prioritization

Itzik Alvas

CEO & Co-Founder of Entro Security

Itzik Alvas, CEO & Co-Founder of Entro Security: $24 Million Raised to Build the Future of Non-Human Identity Management

Mykolas Rambus

CEO & Co-Founder of Hush

Mykolas Rambus, CEO & Co-Founder of Hush: $7.5 Million Raised to Build the Future of Data Privacy

Tom Tovar

CEO and Co-Founder of AppDome

Tom Tovar, CEO of AppDome: Over $26 Million Raised to Build the Future of Mobile App Security

Jason Martin

Co-Founder and Co-CEO of Permiso Security

Jason Martin, Co-Founder and Co-CEO of Permiso Security: $10 Million Raised to Build the Future of Cloud Security

Mollie Breen

CEO and Co-Founder of Perygee

Mollie Breen, CEO and Co-Founder of Perygee: $6.4 Million Raised to Build the Future of IT/OT Security

Michael Assraf

CEO & Founder of Flamingo

How Flamingo generated 1,000 waitlist signups before launching a product using a free community tool | Michael Assraf

Philippe Humeau

CEO of CrowdSec

Philippe Humeau, CEO of CrowdSec: $21 Million Raised to Build the Future of Cyber Threat Intelligence

Joshua Motta

CEO & Co-Founder of Coalition

Joshua Motta: How Coalition Created the “Active Insurance” Category ($5B Valuation)

David Etue

CEO of Nisos

David Etue, CEO of Nisos: $33 Million Raised to Build the Future of Managed Intelligence

Dan Lowden

CMO of Blackbird.AI

How to Create a Category: Dan Lowden’s 8-Exit CMO Playbook

Rodrigo Leme

Marketing Director of Right-Hand Cybersecurity

Rodrigo Leme, Marketing Director at Right-Hand Cybersecurity: Standing Out in a Crowded Market – Niche Targeting and Customer-Centric Approach

Austin Gadient

CTO & Co-Founder of Vali Cyber

Austin Gadient, CTO & Co-Founder of Vali Cyber: $15 Million Raised to Build the Future of Linux Security

Ken Bagnall

CEO & Founder of Silent Push

Ken Bagnall, CEO & Founder of Silent Push: $22 Million Raised to Transform Threat Intelligence Through Adversary Infrastructure Monitoring

Adam Cecchetti

CEO & Co-Founder of Staris AI

Adam Cecchetti, CEO & Co-Founder of Staris AI: $5.7 Million Raised to Build Total Context Security for Application Protection

Dave Mor

CEO and Co-Founder of OneLayer

Dave Mor, CEO and Co-Founder of OneLayer: $15 Million Raised to Protect Private Cellular Networks

Jessica Pratt

Director of Marketing and Communications of Peak Metrics

How PeakMetrics Turns Product Data Into Marketing Gold

Christian Almenar

CEO & Co-Founder of Monad

Christian Almenar, CEO of Monad: $19 Million Raised to Solve the Cybersecurity Big Data Problem

Rohan Sathe

Co-Founder & CEO of Nightfall AI

How Nightfall AI uses CISO dinners to generate pipeline | Rohan Sathe

Joe Levy

CEO of Sophos

Joe Levy, CEO of Sophos: $1.5 Billion ARR and the Future of Cybersecurity at Scale

Peter Prizio Jr

CEO of SnapAttack

Peter Prizio Jr, CEO of SnapAttack: $8 Million Raised to Power the Future of Threat Management

Colby Proffitt

VP of Marketing of Shift5

From the Pentagon to B2B: Colby Proffitt’s Journey and ABM Insights

Dan Lorenc

CEO & Founder of Chainguard

Dan Lorenc, CEO & Founder of Chainguard: $250 Million Raised to Power the Future of Software Supply Chain Security

Jean Le Bouthillier

CEO of Qohash

Jean Le Bouthillier, CEO of Qohash: $20 Million Raised to Build the Future of Data Security

Diana Rabba

Head of Marketing of Exein

Long Game Marketing: Building Trust in High-Stakes B2B Sales

Megan Howard

VP of Marketing of Vali Cyber

Do Webinars Still Work in Cybersecurity?

Sebastian Stranieri

CEO & Founder of VU Security

Sebastian Stranieri, CEO & Founder of VU Security: $24 Million Raised to Build the Future of Digital Identity & Fraud Prevention

Ben Kliger

CEO and Co-Founder of Zenity

Ben Kliger, CEO and Co-Founder of Zenity: $21.5 Million Raised to Build the Future of Security and Governance for AI, Low-Code, and No-Code Development

Tiffany Ricks

CEO and Founder of HacWare

Tiffany Ricks, CEO and Founder of HacWare: $2.6 Million Raised to Build the Future of Security Awareness

John Milburn

CEO of Clear Skye

John Milburn, CEO of Clear Skye: More Than $20 Million Raised to Build the Future of Identity and Access Governance

Lisa O’Reilly

Vice President of Marketing of iVerify

How iVerify’s First Marketing Hire Built a Research-Driven Engine

Marina Segal

CEO and Co-Founder of Tamnoon

Marina Segal, CEO & Co-Founder of Tamnoon: Over $5 Million Raised to Build the Future of Cloud Security

Paul Valente

CEO and Co-Founder of VISO Trust

Paul Valente, CEO and Co-Founder of VISO Trust: $17 Million Raised to Build the Future of Third-Party Cyber Risk Management

Julie Preiss

Chief Marketing Officer of Centripetal

Why Your Cybersecurity Brand Sounds Like Everyone Else

Arie Zilberstein

CEO and Co-Founder of Gem Security

Arie Zilberstein, CEO and Co-Founder of Gem Security: $34 Million Raised to Power the Future of Cloud Detection and Response

Ori Eisen

CEO & Founder of Trusona

Ori Eisen, CEO & Founder of Trusona: $38 Million Raised to Power the Future of Account Takeover Prevention

Harley Sugarman

Founder & CEO of Anagram

Harley Sugarman, Founder & CEO of Anagram: $10 Million Raised to Transform Human-Driven Security

Ben Levine

Senior Director of Product Management and Marketing of Axiado Corporation

Building Marketing Guidelines That Actually Stick Across Teams

Eddie DeCurtis

Co-Founder and CEO of Shush

How Shush differentiated against competitors by solving business operations, not just deploying technology | Eddie DeCurtis, Co-Founder & CEO of Shush Inc.

Tom Jermoluk

CEO of Beyond Identity

Tom “TJ” Jermoluk: The GTM Storyteller of Beyond Identity ($1.1 Billion Valuation)

Umaimah Khan

CEO and Co-Founder of Opal Security

Umaimah Khan, CEO & Co-Founder of Opal Security: $32 Million Raised to Build the Future of Identity Security

Ayal Yogev

CEO and Co-Founder of Anjuna

Ayal Yogev, CEO and Co-Founder of Anjuna: $42 Million to Build The Future of Confidential Computing

Paul Lewis

Founder and CEO of Calamu

Paul Lewis, CEO of Calamu: $20 Million Raised to Build the Cyber Storage Category

Mike Janke

Co-Founder of Data Tribe

Funding the Future: Mike Janke, Co-Founder of Data Tribe

Josh Shaul

CEO of Allure Security

Josh Shaul, CEO of Allure Security: $6 Million Raised to Help Businesses Win the Battle Against Online Scammers

Stephen de Vries

CEO and Co-Founder of IriusRisk

Stephen de Vries, CEO and Co-Founder of IriusRisk: $40 Million Raised to Build the Future of Threat Modeling

Matteo Bogana

CEO and Co-Founder of Cleafy

Matteo Bogana, CEO & Co-Founder of Cleafy: $12 Million Raised to Build the Future of Online Fraud Prevention

Russell Spitler

CEO & Co-Founder of Nudge Security

Russell Spitler, CEO & Co-Founder of Nudge Security: $17 Million Raised to Build the Future of SaaS Security

Guy Tytunovich

Creating the Go to Market Security Category with CHEQ’s Guy Tytunovich

Kyle Hanslovan

CEO & Co-Founder of Huntress

What happens when you outgrow your messaging? w/ Huntress CEO Kyle Hanslovan

Neil Serebryany

CEO and Co-Founder of CalypsoAI

Neil Serebryany, CEO & Co-Founder of CalypsoAI: $38 Million Raised to Power the Future of AI Security

Spencer Thompson

CEO and Co-Founder of Prelude

Spencer Thompson, CEO and Co-Founder of Prelude: Over $30 Million Raised to Build the Future of Continuous Security Testing

Kyle Hanslovan

CEO & Co-Founder of Huntress

Kyle Hanslovan, CEO of Huntress: $160 Million Raised to Build the Future of Managed Security

Tom Jermoluk

CEO of Beyond Identity

Tom “TJ” Jermoluk, CEO of Beyond Identity: $200 Million Raised to Build the Future of Multi-Factor Authentication

Carole Winqwist

CMO of GitGuardian

How to Win with Rapid Response: GitGuardian’s Media Playbook

Peter Dvorak

Founder & CEO of Wultra

How Wultra built category leadership as the only post-quantum provider for banking digital identity | Peter Dvorak

Dimitri Sirota

CEO & Co-Founder of BigID

Dimitri Sirota: The GTM Story of BigID ($1.25 Billion Valuation)

David Brumley

CEO of Mayhem

David Brumley, CEO of Mayhem: $38 Million Raised to Build the Future of Security Testing

Sivan Tehila

Founder and CEO of Onyxia

Sivan Tehila, Founder and CEO of Onyxia: $5 Million Raised to Build the Future of Cybersecurity Performance Management

Ani Chaudhuri

CEO & Co-Founder of Dasera

Ani Chaudhuri, CEO & Co-Founder of Dasera: $21 Million Raised to Build the Future of Data Security

Bob Tinker

CEO & Co-Founder of BlueRock

How BlueRock identified three distinct buyer personas by asking “How would you describe what we do to your peers?” | Bob Tinker

Ian Amit

CEO and Founder of Gomboc

Ian Amit, CEO & Founder of Gomboc: $5 Million Raised to Build the Future of Cloud Security Remediation

Arjun Bhatnagar

CEO & Co-Founder of Cloaked

Arjun Bhatnagar, CEO of Cloaked: $25 Million Raised to Build the Future of Data Privacy

Alan LeFort

CEO of StrongestLayer

How StrongestLayer achieved 85% meeting-to-POC and 100% POC-to-win rates using transparent one-week pilots | Alan LeFort

Edward Wu

CEO and Founder of Dropzone AI

Edward Wu, CEO & Founder of Dropzone AI: $20 Million Raised to Build the Future of AI SOC Analysts

Ryan Lasmaili

CEO & Co-Founder of Vaultree

Ryan Lasmaili, CEO of Vaultree: $16 Million Raised to Build the World’s First Fully Functional Data-in-Use Encryption

Scott McCrady

CEO of SolCyber

Scott McCrady, CEO of SolCyber: $20 Million Raised to Build the Future of Managed Security

Ryan Schonfeld

Founder & CEO of Hivewatch

Ryan Schonfeld, CEO of Hivewatch: $25 Million Raised to Build the OS of Physical Security

Tony Lombardo

VP of Marketing of ThreatModeler Software

Why 99% of Cybersecurity Marketers Are Doing Demand Gen Wrong

Pukar Hamal

CEO and Founder of SecurityPal

Pukar Hamal, CEO and Founder of SecurityPal: $21 Million Raised to Power the Future of Customer Assurance