How big is your chest? That's what you need to go by. Jacket sizes are chest sizes. Also, arm length makes a big difference. You probably need to go try something on. Try on anything. Most 40s fit like 40s throughout the brands. It's when you get to brands that label them "s,m, or large" where it starts to get iffy.