how do I protect my peaches from scavengers?

I have a peach tree. I didn't plant it, it was there when we moved in last year. Last year it fruited and produced around about 2 dozen fruit but only about 6 made it to an edible size and ripeness for us to eat. The rest were had by the wasps, flys, ants and probably a few birds. I don't want to cover it as it looks quite attractive in our garden and having poly sheeting or netting around it won't. So without using chemicals what's the best way to fend off the insects? Would hanging a bird feeder work or would the birds just end up eating the fruit as well?