Latin hypercube sampling
From Free net encyclopedia
The statistical method Latin hypercube sampling (LHS) was developed along by Ronald L. Iman, J. C. Helton, and J. E. Campbell, et al to generate a distribution of plausible collections of parameter values from a multidimensional distribution.
Their paper An approach to sensitivity analysis of computer models, Part I. Introduction, input variable selection and preliminary variable assessment. appeared in the Journal of Quality Technology in 1981. Earlier, M.D. McCay already described this technique in McKay, M. D., W. J. Conover and R. J. Beckman. 1979. A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code, in Technometrics 21: 239-245.
In the context of statistical sampling, a square grid containing sample positions is a Latin square if (and only if) there is only one sample in each row and each column. A Latin hypercube is the generalisation of this concept to an arbitrary number of dimensions, whereby each sample is the only one in each axis-aligned hyperplane containing it.
When sampling a function of <math>N</math> variables, the range of each variable is divided into <math>M</math> equally probable intervals. <math>M</math> sample points are then placed to satisfy the Latin hypercube requirements; note that this forces the number of divisions, <math>M</math>, to be equal for each variable. Also note that this sampling scheme does not require more samples for more dimensions (variables); this independence is one of the main advantages of this sampling scheme. Another advantage is that random samples can be taken one at a time, remembering which samples were taken so far.
Orthogonal sampling adds the requirement that the entire sample space must be sampled evenly. Although more efficient, orthogonal sampling strategy is more difficult to implement since all random samples must be generated simultaneously.
In two dimensions the difference between random sampling, Latin Hypercube sampling and orthogonal sampling can be explained as follows: I) In random sampling new sample points are generated without taking into account the previously generated sample points. One does thus not necessarily need to know beforehand how many sample points that are needed. II) In Latin Hypercube sampling one must first decide how many sample points to use and for each sample point remember in which row and column the sample point was taken. III) In Orthogonal Sampling, the sample space is divided into equally probable subspaces, the figure above showing four subspaces. All sample points are then chosen simultaneously making sure that the total ensemble of sample points is a Latin Hypercube sample and that each subspace is sampled with the same density.
To put it in layman terms, orthogonal sampling ensures that the ensemble of random numbers is a very good representative of the real variability, LHS sampling ensures that the ensemble of random numbers is a good representative of the real variability whereas traditional random sampling (sometimes called brute force) is just an ensemble of random numbers without any guarantees.