I also live in an exposed, windy place (high in the Pennines) and have Rosa rugosa, Weigela, and various Viburnums, Cotoneasters and Cornus which take whatever the weather throws at them, without blinking. Cornus Elegantissima has very prettily variegated leaves, creamy flowers in early summer and nice, dark red stems in winter, so looks good all year round. It does need a soil that is not too dry and may sucker, but can be controlled.
My garden is very exposed to winds. I have found that escallonia does well and there are some nice colours, also berberis darwinii, native hawthorn and even hydrangea.
Going with the theme of light foliage, I think Elaeagnus Commutata, the Silver berry would look nice. Shimmering foliage, small pale yellow scent flowers followed by berries. The plant can be left to grow and create a nice open shape. But if you liked the Buddleia originally, I would go for that one again. Bear in mind, any young shrub/tree will need a bit more care in the first few years.
Posts
Depends what you want in terms of shape, dimensions, colours, evergreen or not, flowering or not, soil ph etc etc