I asked my grandfather about that once. The weight. Apparently, the way we do it, we either take it or store it in a sort of... place that's not quite a place when we shift into something larger or smaller.

I've actually been as tall as a mountain once. Though I can't recommend it.