On the map, you can see a campsite looking place on the South end of the river, so pull off the main road and go down to the camp. Return to Neuhof, then ride North to the river just South of where you and Sir Hans went hunting. Once you reach the camp, you can try some persuasion on the spokesman - even if he doesn’t know where Ginger is, he does know that you’re not the first to ask where he went. Don’t forget Pebbles - your horse will make the trip much faster.
Head to the pond at the stable and work your way South from there. You don’t have to question in charcoal-burners in the South, but it’s a good start. When you tell him where Ginger went, he wants you to be the one to find him. If you took awhile to gather clues, chances are he already led his men to the dead bandit in the woods. You can also tell Captain Bernard what you’ve found.