acetone will only work before its cured. after its cured your best bet is to scrape off as much as you can.

yeah it's been there months now so I'm just gonna have to replace it

Great Stuff makes a remover, also nail polish remover if it has acetone in it. I would apply to cloth to remove then wipe and clean any residual

Don't use acetone on vinyl, it can easily damage it.