yeah, if I leave I either tie it so it cant fall over, or turn it off. Depends what other heat i have going. I usually turn off the propane and leave one electric going when I leave. Just feels safer to me. =)
I have been know to put plastic over my storm windows too, but I couldnt tell a difference. I do use it in the bathroom, no storm for it.