Thanks for the replies, I realized after I posted, this seems to be about Chrome but since I saw people talking about Edge too I just posted that here.
I had to reset my pc today and when I ran CCleaner it cleaned Edge. I assume it was something like @nukecad mentioned, something still running that I just wasn't seeing. However when I just checked, that specific option is not enabled. So I don't know what exactly caused it.
Anyway, it's working now.