You can, but they take up a lot of pack space and add to the weight.  Keep a couple of pairs at work in one or two colors so you’re always ready for anything.