Which Way is West?

There is a weird phenomenon here in the Southern Hemisphere when you have lived most of your life in the Northern one. When the sun rises in the East you get an overwhelming sensation that it is sunset! Many people have laughed at this idea. They proclaim to me that East is East! For me the sensation of it being backwards is very strong. Here is what I believe to be the explanation.

When I watch a sunset in San Francisco my right shoulder faces the magnetic North Pole. When I am in Sydney watching the sunrise my right shoulder faces the magnetic South Pole. Because I am used to my right shoulder facing north for sunset this is why my brain says a sunrise in the south is actually sunset. Seems to me that our bodies have a built-in compass which, I for one, am sensitive to.