hey noisehr, i had the same problem until i bought a balaclava. its basically a ski/snowboard accesory but its thin enough to fit inside helmets. they keep your ears from folding down and keeps your ear buds from slipping out when you put on your helmet.