## 202-2 Multiple Comparison Procedures - Cutting the Gordian Knot.

See more from this Division: ASA Section: Biometry and Statistical ComputingSee more from this Session: Symposium--Statistical Concepts and Tools to Aid In Publishing Proper Research Conclusions

An unacceptable operating characteristic of most procedures is their “inconsistency”. This characteristic led me to develop a “practical solution” to the MCP problem, which is to “cut the Gordian knot” by abandoning any attempt at simultaneous formulation and testing. Instead, I recommend using the simplest multiple comparison procedure (the unrestricted LSD procedure) to formulate new hypotheses at a known “false discovery rate” (e.g., 5%), then independently test interesting new hypotheses in a second experiment. Since this is normal scientific practice, this solution fits well with the way in which reputable scientists operate, and allows maximum probability of coming up with new ideas, in conjunction with a known type I error rate for the subsequent, independent testing of any interesting ideas thus generated.

In the current talk, I discuss the above topics, illustrate the problem of inconsistency in relation to several procedures, and discuss the implications for sample size calculations of using multiple comparison procedures other than the simplest, unrestricted LSD procedure.

See more from this Session: Symposium--Statistical Concepts and Tools to Aid In Publishing Proper Research Conclusions