Preheat oven to 350 degrees F. Grease an 8 1/2 x 4 1/2 x 2 1/2 loaf pan and set aside.
In a small bowl, prepare streusel. Combine brown sugar, flour, and cinnamon. Add cubed cold butter and cut in until crumbly. Stir in pecans. Set aside.
In a medium bowl combine flour, sugar, baking powder, cinnamon, salt, and nutmeg. Stir in banana and apple.
In a small bowl mix milk, oil,and egg until well blended. Add wet ingredients to dry ingredients and stir until moistened.
Put batter in prepared pan and top with streusel mixture. Gently press topping into batter without crushing it.
Bake in 350 degree oven for 40 to 45 minutes. Remove from oven to cooling rack. Cool in pan for 10 minutes and remove to cooling rack to cool completely.