As long as you can expect some periods of very cheap energy before its cold so you can warm it up again, seems like a decent idea actually.

How do they heat it, ideally would be using heat pumps.

For more on strange batteries, Half As Interesting did a really cool video on different ways we do long-term energy storage.

That’s so cool! It even sounds cool: sand battery.