Comparison
How this differs from surveys and focus groups
The first question every leader asks, answered without pretending the alternatives are worthless.
Most organizations already run a survey, and many run focus groups alongside it. The honest position is that these measure different things. A survey is built to tell you whether a number moved. This instrument is built to tell you what happened. Confusing the two is how a company ends up with eleven quarters of engagement scores and no idea why the rollout stalled.
| ENGAGEMENT SURVEY | FOCUS GROUP | THIS INSTRUMENT | |
|---|---|---|---|
| Coverage | Everyone is invited; typically half to three quarters answer. | A curated handful, usually eight to twelve per session. | Everyone in scope is interviewed, one at a time. |
| What is collected | Positions on questions written before anyone was asked. | Discussion, shaped by whoever in the room speaks first. | Accounts of specific recent incidents, followed up individually. |
| Can it be surprised | Only through free-text boxes, which are usually read last. | Yes, and this is the format's real strength. | Yes. The follow-up question is chosen from the answer given. |
| Effect of the observer | Low, but candor is limited by doubt about anonymity. | High. People manage their answer in front of colleagues. | Low. No colleague present, and no person on the other side. |
| Time to a finding | Weeks, mostly in instrument design and analysis. | Weeks, mostly in scheduling. | Days, because the interviews run in parallel. |
| Tone and hesitation | Not captured. | Observed by the facilitator, rarely recorded systematically. | Captured, and the gap between words and delivery is reported. |
| Comparability over time | Strong. This is what surveys are genuinely best at. | Weak. Each session is its own event. | Strong for themes, and the memory persists between rounds. |
| Benchmarking against other firms | Available from most vendors, and often the reason to buy one. | Not applicable. | Not offered. The comparison is to your own prior read. |
Where the other tool is better
A comparison that finds no merit in the alternatives is an advertisement. Here is the case for each of them.
When an engagement survey is the right tool
If you need a defensible longitudinal index, an external benchmark against firms in your sector, or a number the board already recognizes, buy the survey. A well-run survey is cheaper per respondent, statistically tidy, and comparable across years. It is a genuinely good instrument for measuring whether something moved. It is a poor instrument for explaining why, and it was never designed to be otherwise.
When a focus group is the right tool
If you are trying to generate options rather than measure a state, put people in a room. Ideas compound in conversation between colleagues in a way that one-on-one interviews do not reproduce. The cost is candor: nobody names the manager who is the actual problem while sitting across from that manager's direct report.
When exit interviews are the right tool
They are not, at least not for prevention. An exit interview is a well-designed instrument pointed at exactly the wrong moment, because the person answering has already gone and their incentive is to leave cleanly. Exit data is useful for confirming a pattern you already suspect. It cannot change the outcome it describes.
When always-on listening is the right tool
Continuous pulse and sentiment tools are good at telling you that something changed this week. They are weak on what changed and why, because the format that makes them frictionless, two questions in a chat window, is the same format that prevents an account. They pair reasonably with this instrument: the pulse says look here, the interview says why.
The one real difference
Every method above collects what it decided to collect before it met anyone. That is not a flaw in their execution, it is what an instrument is. The difference here is that the next question comes from the last answer, and the population is everyone rather than a sample, so a fact that only three people in the company knew has somewhere to land. Whether that fact is worth the engagement is a fair question, and the lab publishes its attempts to answer it rather than asserting it.
Read the benchmark study · The method, defined · Common questions