mushrooms!

One of my borders is absolutely overrun with mushrooms. I put bought compost on it earlier in the year and I can only think that it had previously grown mushrooms in it (although the mushrooms have not appeared on other borders that had the same compost on). I have already pulled up 6 huge bin bags full of these fungi. Will they disappear when the cold weather comes and will the spores live till next year? If so, how do I get rid of them?