How do i break this really annoying habit?

i have a problem that tends to piss alot of people off. whenever i am excited to say something i just blurt it out usually interrupting the person thats talking. i am not trying to be rude and i am always mad at myself after i do it, but i have no clue how to stop. does anybody have any advice on how i can stop doin this?