What happens if the merchant folds or disappears? Stripe (or Visa or whoever) then are the bagholder. And if someone has a ton of chargebacks, it's not uncommon they're then difficult to collect from.

Then hold back a portion of funds in escrow.

Ah good job, you fixed it. I suggest you let Stripe and Visa know, I'm sure they'll be keen.