The DSL Wiki
has a thorough article about how to permanently change a machine's hostname. It's the last two steps, the mailname and the knoppix-specific stuff, that I was unaware of. Note that a different page on that Wiki suggests using the boot parameter "host=" or "dslhost=" to set the host name. That don't work, at least not in 2.0.