Why does my heater smell odd when I first turn it on?

A mild dusty smell when heating first starts is usually normal. Persistent or strong odors can indicate a dirty heat exchanger or other issue that should be checked.