I closed all Chrome windows and opened it again - (online).
So I’m pretty sure it should not hit the cache - but still see the issue.
We just tried it on another machine and clearing the browser cache did solve the problem.
Of course I can do that but if out customers face the same issue they won’t be able to do that.
EDIT: Cleared my cache, works now. Praying no customer is facing the same isse 
Thanks for the fast reaction time @Team Anvil