Peter G8FWY had a problem with his µBITx. It picked up sound from touching the case and pushed this through his headphones.
If you have a similar problem it is most likely to be ceramic capacitors in the audio stages of your rig.
In this case it turned out to be C50 in the audio pre amp. Peter replaced it with a leaded electrolytic capacitor and the problem went away.