I leave my plants over the winter so the birds can eat the seeds when it gets cold. It doesn't look quite as nice but I figure more of the plant gets recycled naturally that way. And it helps the wildlife too.

I do a big clean up in the spring when there are other food sources available to them.