Well, you can, if you choose another colour as a transition.
In this case it's khaki.
Have a look:
Charcoal sweater by Hemlock
Shirt by Gilberto
Belt by some Italian shop
Chinos by Dockers
Over the calf socks by Burlington
Half-Brogues by Gordon & Bros.
Underwear by H&M and GANT