‘No difference’ may be wrong conclusion, scientists warn

[u/Zephir-AWT]

https://www.manchester.ac.uk/about/news/no-difference-may-be-wrong-conclusion-scientists-warn/

[u/Zephir-AWT]

‘No difference’ may be wrong conclusion, scientists warn about study Beyond “non-significant” results: Why and how to test for practical equivalence (PDF)

A common statistical shortcut may be causing researchers to miss important discoveries, a new study finds... Instead, the authors say, a non-significant result simply means there is insufficient evidence to conclude a difference exists, not proof that a difference does not exist.

We already discussed this problem many times here. "Old good" reliable low-dimensional science is based on continuous parameter manifolds, which means effects in question manifested somehow across whole parameter range. Unfortunately most of modern science findings are based on hyperdimensional phenomena and their parameter holes exhibit "holes" and "spaces", across whose the experimental evidence for phenomena simply disappears. Once we try to generalize such an effect over whole interval of parameters, we get too low average value and the finding gets indeed neglected as "poorly reproducible". This behavior has lead into premature dismissal of multiple breakthrough findings including overunity and cold fusion, the composite nature of which requires fine tuning of observational/experimental parameters.

Of course this p-value hacking is just one of explanations here and the financial interests of alternative research communities (in particular scientists involved in hot fusion research) and pluralistic ignorance of scientific community in general had lion share on these premature dismissals of these breakthrough findings. In many cases the details of these findings were simply closed into treasure by governments and CIA which bought or even killed authors of relevant patents. Apparently from long term perspective it's more advantageous for billionaire circles to spend public money in fight for the rest of fossil fuels in Crimea and Hormuz strait and to risk WWW III war rather than to invest into alternative energy research. But it's also the problem of ignorant laymen public, which allowed such an outcome - not just scientists or deep state. See also:

• Scientists Challenge No Difference Conclusion: ‘No difference’ may be wrong conclusion, scientists warn
• The problem with p-values: it’s time for science to abandon the term ‘statistically significant’
• Infinite-dimensional symmetry opens up possibility of a new perspective of old physics.
• The U.S. Government Has a Secret System for Stalling Patents
• P-Hacking: How to (Not) Manipulate the P-Value
• Cargo Cult Science If you don't know which conditions actually work, don't try to draw conclusions from it.
• Extraordinary claims require extraordinary evidence The same - sometimes the actual evidence can be based on what is missing there.

[u/Zephir-AWT → u/Zephir-AWT]

A new analysis of 3 years' DAMA/LIBRA experiment data from a nearly identical experiment offers evidence against the prior result detecting dark matter..

Breakthrough findings aren't the only victim of p-value misinterpretations - it also delayed mainstream science useless for laymen, including string theory. Here the usage of more sensitive equipment enabled better separation of measured signal for noise, which is actual source of information about dark matter here. See also:

Is the Higgs Boson Acting Weird at the LHC?