I find this to be an important insight about statistical models -- they do not, and possibly cannot, account for the fact that there is another team on the field who will notice and react to changes you make
There’s a limit to how far any of this should be trusted, and it’s worth stating plainly. The odds this model learned were produced by real defenses reacting to what teams actually do. If a team almost never crosses from deep, opposing full-backs don’t have to respect that threat and can tuck inside, which is baked into the data the model learned from. Simulate a version of that team that suddenly crosses a lot more, while keeping those same learned odds fixed, and the simulation is quietly assuming the opposition doesn’t notice or adjust.