Of course, the fly in the ointment of your suggestion is the fact that those "Just Cash" payments still have to be processed by someone, and as the retailer associations don't have the wherewithal to do that themselves, they'll have to farm it out for a fee, most likely to the already established system of MasterCard, Visa etc.
