Wall flowers just starting to bloom

Hi,

about half my wall flowers bloomed from April onwards and went over. The other half didn't bloom at all and some are just starting now. They fill my raised beds and I am wondering if I can keep them  (instead of composting them) - perhaps transplanting them to a quiet corner until next spring. It seems odd that various plants are just starting to bloom now.  I am imagining that they would be ok for next year - a bit woodier (like sweet williams) but pretty fine to keep. I'd love to hear your thoughts on this.