over crowding

I have a rather overcrowd border mainly a result of vigorous bushes. The main culprits seem fro be the green/white bush and the red/gold ones.

As you can see i have started to cut back and dig out. 

Do you think I should remove the bushes altogether or cut back to old wood and start again keeping them under control.

The one in the second pic it too close to that rather old rose.