Did the Manager Change the Model or Just the Settings

This phrasing carries the work. You are requesting a specific failure, a specific lesson, and a specific structural change. In conversations with allocators and managers across institutional contexts, the responses cluster into three categories.

A strong answer: The manager identifies a certain drawdown episode and describes what structural assumption proved wrong. They distinguish clearly between changes to model settings, such as a lookback window or position-sizing parameter, and changes to the model’s underlying assumptions, such as reformulating how signals interact, restructuring how conflicting information is weighted, or replacing a component whose implicit prior the team could no longer defend. They explain why the same failure mode is less likely to recur, and they connect the lesson to a broader view about what their model assumes the world to be.

A standard answer: The manager describes a difficult period and focuses on the changes made to lookback windows, risk targets, or signal weights. This is the industry baseline. A useful follow-up surfaces whether anything deeper happened: “Was the underlying logic of the model changed, or only its settings?” Honest managers will tell you. Unprepared managers will reach for the language of structural change without the substance, at which point the gap becomes audible.

A concerning answer takes one of three forms. The first is an inability to recall a meaningful failure, which suggests either a short track record or a research process without the discipline of structural post-mortem. The second is attribution of every difficult period to external regime change, with no reflection on the model’s contribution to the loss. The third is a defense of the model’s continued correctness despite the failure. A manager who has never identified a structural assumption they got wrong has either built a model without structural assumptions, which is impossible, or has chosen not to examine them.