Tree bashing side of house

Our neighbours love their trees, so much so they keep planting them with no concern for anyone else. (4 lleylandii's gone in in last few days out the front (but that's a whole different story...)

There is a silver birch that was here when we moved in, (3 years ago), but now it bashes into the corner of the office on the side of the house when there are any high winds.  It has scrapped a chunk out of the trunk, but I'm also wondering what damage it will do to our house.  (it is a single story office on the side of the house)

I know it is a fairly flexible tree and there is another right next to it. along with conifers planted all round them both... Do you think we have the right to ask our neighbour to cut it down, due to the risk of damage to our house ?

Any advice gratefully received. Thank you.