It depends what OS your operating. If its windows, it's a glitch in the usb connectivity drivers and to be honest its best to live with it as the updates are no better.

Linux and mac just need updated drivers.

Try to turn your phone off after file transfer and see what happens rather than just unplug it.

Lav