When an element is dragged outside the vertical bounds of the listbox, the item that was previously on top (or bottom) will get selected.
A workaround for this is:
_myListBox.SelectionChanged += delegate
{
if (_myListBox.SelectedIndex != -1)
_myListBox.SelectedIndex = -1;
};