This paper
discussed Bayesian variable selection methods for models from split-plot mixture
designs using samples from Metropolis-Hastings within the Gibbs sampling
algorithm. Bayesian variable selection is easy to implement due to the
improvement in computing via MCMC sampling. We described the Bayesian
methodology by introducing the Bayesian framework, and explaining Markov Chain
Monte Carlo (MCMC) sampling. The Metropolis-Hastings within Gibbs sampling was
used to draw dependent samples from the full conditional distributions which
were explained. In mixture experiments with process variables, the response
depends not only on the proportions of the mixture components but also on the
effects of the process variables. In many such mixture-process variable
experiments, constraints such as time or cost prohibit the selection of
treatments completely at random. In these situations, restrictions on the
randomisation force the level combinations of one group of factors to be fixed
and the combinations of the other group of factors are run. Then a new level of
the first-factor group is set and combinations of the other factors are run. We
discussed the computational algorithm for the Stochastic Search Variable
Selection (SSVS) in linear mixed models. We extended the computational
algorithm of SSVS to fit models from split-plot mixture design by introducing
the algorithm of the Stochastic Search Variable Selection for Split-plot Design
(SSVS-SPD). The motivation of this extension is that we have two different
levels of the experimental units, one
for the whole plots and the other for subplots in the split-plot mixture
design.
References
[1]
Aljeddani, S. (2022) Bayesian Variable Selection for Mixture Process Variable Design Experiment. https://doi.org/10.21203/rs.3.rs-1906056/v1
[2]
Tang, X., Xu, X., Ghosh, M. and Ghosh, P. (2016) Bayesian Variable Selection and Estimation Based on Global-Local Shrinkage Priors. Sankhya A, arXiv: 1605.07981.
[3]
Mitchell, T.J. and Beauchamp, J.J. (1988) Bayesian Variable Selection in Linear Regression. Journal of the American Statistical Association, 83, 1023-1032. https://doi.org/10.1080/01621459.1988.10478694
[4]
George, E.I. and McCulloch, R.E. (1993) Variable Selection via Gibbs Sampling. Journal of the American Statistical Association, 88, 881-889. https://doi.org/10.1080/01621459.1993.10476353
[5]
Geweke. J. (1996) Variable Selection and Model Comparison in Regression. Bayesian Statistics 5, Valencia, 5-9 June 1994.
[6]
Tan, M.H.Y. and Wu, C.F.J. (2013) A Bayesian Approach for Model Selection in Fractionated Split Plot Experiments with Applications in Robust Parameter Design. Technometrics, 55, 359-372. https://doi.org/10.1080/00401706.2013.778790
[7]
George, E.I. and McCulloch, R.E. (1997) Approaches for Bayesian Variable Selection. Statistica Sinica, 7, 339-373.
[8]
Aljeddani, S. (2022) Variable Selection in Randomized Block Design Experiment. Journal of Computational Mathematics, 12, 216-231. https://doi.org/10.4236/ajcm.2022.122013
[9]
Gilmour, S.G. and Goos, P. (2009) Analysis of Data from Non-Orthogonal Multistratum Designs in Industrial Experiments. Journal of the Royal Statistical Society Series C: Applied Statistics, 58, 467-484. https://doi.org/10.1111/j.1467-9876.2009.00662.x
[10]
Jones, B. and Nachtsheim, C.J. (2009) Split-Plot Designs: What, Why, and How. Journal of Quality Technology, 41, 340-361. https://doi.org/10.1080/00224065.2009.11917790
[11]
Aljeddani, S. (2019) Statistical Analysis of Data from Experiments Subject to Restricted Randomisation. University of Southampton, Southampton.
[12]
Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A. and Rubin, D.B. (2014) Bayesian Data Analysis. Vol. 2, CRC Press, Boca Raton. https://doi.org/10.1201/b16018
[13]
O’Hagan, A. and Forster, J. (2004) Kendall’s Advanced Theory of Statistics: Bayesian Statistics. Vol. 2B, Arnold, London.
[14]
Gilks, W.R., Richardson, S. and Spiegelhalter, D. (1995) Markov Chain Monte Carlo in Practice. CRC Press, Boca Raton. https://doi.org/10.1201/b14835
[15]
Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H. and Teller, E. (1953) Equation of State Calculations by Fast Computing Machines. The Journal of Chemical Physics, 21, 1087-1092. https://doi.org/10.1063/1.1699114
[16]
Hastings, W.K. (1970) Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika, 57, 97-109. https://doi.org/10.1093/biomet/57.1.97
[17]
Gelman, A., Roberts, G.O., Gilks, W.R., et al. (1996) Efficient Metropolis Jumping Rules. Bayesian Statistics, 5, 599-607.
[18]
Cornell, J.A., Kowalski, S.M. and Vining, G.G. (2002) Split-Plot Designs and Estimation Methods for Mixture Experiments with Process Variables. Technometrics, 44, 72-79. https://doi.org/10.1198/004017002753398344
[19]
Cornell, J.A. (2011) Experiments with Mixtures: Designs, Models, and the Analysis of Mixture Data. John Wiley & Sons, Hoboken.
[20]
Goos, P. and Donev, A.N. (2007) Tailor-Made Split-Plot Designs for Mixture and Process Variables. Journal of Quality Technology, 39, 326-339. https://doi.org/10.1080/00224065.2007.11917699
[21]
Barbieri, M.M., Berger, J.O. et al. (2004) Optimal Predictive Model Selection. The Annals of Statistics, 32, 870-897. https://doi.org/10.1214/009053604000000238
[22]
Fan, J. and Li, R. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360. https://doi.org/10.1198/016214501753382273
[23]
Ibrahim, J.G., Zhu, H., Garcia, R.I. and Guo, R. (2011) Fixed and Random Effects Selection in Mixed Effects Models. Biometrics, 67, 495-503. https://doi.org/10.1111/j.1541-0420.2010.01463.x