the term is a contraction of phrase borrow ditch, A borrow ditch is created by removing material the material is then incorporated in the construction of what ever is being built. You are borrowing material to use somewhere else.
When building rural roads, the road bed is raised up to allow for drainage with the material borrowed from the sides of the road.
