Things are going from bad to worse for the 75-year-old billionaire. But he thinks that the allegations against him are out of proportion.