It is suggested that you perform a skin peeling two or three days after shaving by using a peeling lotion with a coarse sponge. You can find appropriate products in your drug store.
If this does not help, trim your hair with the comb to the shortest remaining hair length instead of shaving it.