What is the ruling on keeping old cassette tapes that contain undesirable material, and is it permissible to dispose of them by throwing them away?

If the content of the tapes is forbidden, such as singing accompanied by musical instruments, then it is not permissible to distribute or use them in their current state. They can be used if beneficial material can be recorded over them; otherwise, they must be destroyed.