Olive Tree Help

Hi,

I've recently inherited an Olive tree who's looking a bit sparse in places and slightly wild. Does anyone have any advice on how to encourage growth across the bare bits as all growth seems to be towards the branch tips? Relatively new to gardening and unsure whether/how much/when I should be giving this guy a good old prune!