Re-potting a plum Tree advice

I got a plumb tree as a present around 4 years ago which came in a 10l pot. I have neglected the tree pretty much since a got it and the pot its in is pretty much destroyed. All that being said, it's produced fruit every year and this year it looks like it's fruited really well. I now want to make sue that I look after the tree and want to re-pot it into a bigger container. Is it too late to do so ? I don't want to lose this years fruit so I rather not disturb it if it's going to mess with this years crop. Thanks in advance