ginnie,
If the actual banana leaves are wrecked then you could take them off, but I wouldn't take off any of the burned or dead looking layers on their trunks right now. I'd leave that there until it's warmer because it'll protect the under layers which are probably fine still.