You can but they won't stop charging your card. They have the credit card number, so the only way would be to change the payment method to an invalid card.
Another comment actually says that he managed to create a virtual credit card, change the payment method, and delete the card. Quite clever. It's a shame that methods like this have to be used instead of just the click of a button.
Can't you start issuing chargebacks? Chase is not the most Lawful Good of banks but I have to admit that on the times I needed someone to GTFO my credit card, they had my back.
In the EU you can ask your bank or credit card provider to block subscription payments from specific merchants. This is something EU requires them to support.
Another comment actually says that he managed to create a virtual credit card, change the payment method, and delete the card. Quite clever. It's a shame that methods like this have to be used instead of just the click of a button.