It finally quit saying it was downloading all those files and just became normal. They are always deleted off of my server after I read them on Mac mail. I've tried to go back to the server in the past after I'd deleted something, but it was always gone.
You're apparently deleting your emails only on your MBP, NOT your server.
I guess you could quit Mail and go to your server and delete them there to stop the d/l.
