The whole Freedom Of Movement thing follows from the Single Market being an integrated market on not just Products but also Services, and people being able to move to and work anywhere in it is a requirement from any individual or company anywhere inside the Single Market being able to provide said services to any individual or company anywhere else in it.

So without integration into the Single Market it's highly unlikely that an outside state gets Freedom Of Movement (I believe this has never happenned) and as I wrote, integration is very complex and takes a lot of time for countries which aren't already deeply aligned with EU Regulatory Norms, which Canada is not (because it's mainly aligned with US Regulatory Norms, which in some domains - for example the regulatory principle used for approving entry of chemical substances in the consumer market, which for the US is "allow until proven dangerous" whilst in the EU it's "only allow after proven safe" - are entirelly imcompatible with EU Norms)