It is unanimously agreed that statistics depends somehow on probability. But, as to what probability is and how it is connected with statistics, there has seldom been such complete disagreement and breakdown of communication since the Tower of Babel. Savage, The Foundations of Statistics (1972)
Recentely, I had to give a presentation about P value and I discovered during the preparation of this talk a battle to the death within statistics.