Try using
PreviewMouseDown
event? Or maybe you just need to <Border Background="Transparent" ... />
.