I’m looking for a childhood book that was my favorite:

1. Children’s book
2. Takes place when the British were in charge of America
3. Takes place in southern USA
4. General plot is a boy travels south through the swamps of Georgia and Florida. He ends up in New Orleans (?) in the office of a British officer who holds a scented/perfumed handkerchief over his nose because of the stench from the boy (and others?).
4. It was a grey hardback, typical of good quality children’s books in the 50’s & 60’s. It may have had red highlights or bands.