Uhh, maybe?
I think it might be to do with the feeling of obligation. I don’t have it with foods as frequently as you seem to, but I have a similarly recurring issue with video games.
I can absolutely adore a game but past a certain point it twists into anxiety for no real reason other than the idea that I have to “fully” finish it. It’s not reasonable but it’s how my brain works.
So maybe..self imposed demand meets demand avoidance?