Duff can also be the almost broken down leaves and such on the forest floor.
The top layer of dirt is mostly just "stuff" from bushes and trees, and not yet turned into true "dirt".
That stuff is duff.
Very useful for gardening, (I beleive it puts Nitrogen back into the soil) and good insulation when piled over sleeping bags if it's extremely cold, and the ground isn't wet.