Blocking (statistics)
This article includes a list of references, but its sources remain unclear because it has insufficient inline citations. (January 2018) (Learn how and when to remove this template message)

In the statistical theory of the design of experiments, blocking is the arranging of experimental units in groups (blocks) that are similar to one another.
Contents
 1 Use

2 Randomized block design
 2.1 Blocking used for nuisance factors that can be controlled
 2.2 Definition of blocking factors
 2.3 Block a few of the most important nuisance factors
 2.4 Table of randomized block designs
 2.5 Example of a Randomized Block Design
 2.6 Model for a Randomized Block Design
 2.7 Estimates for a Randomized Block Design
 2.8 Generalizations of randomized block designs
 3 Theoretical basis
 4 See also
 5 Bibliography
 6 External links
Use
Blocking reduces unexplained variability. Its principle lies in the fact that variability which cannot be overcome (e.g. needing two batches of raw material to produce 1 container of a chemical) is confounded or aliased with a(n) (higher/highest order) interaction to eliminate its influence on the end product. High order interactions are usually of the least importance (think of the fact that temperature of a reactor or the batch of raw materials is more important than the combination of the two  this is especially true when more (3, 4, ...) factors are present); thus it is preferable to confound this variability with the higher interaction.
Examples
 Male and Female: An experiment is designed to test a new drug on patients. There are two levels of the treatment, drug, and placebo, administered to male and female patients in a double blind trial. The sex of the patient is a blocking factor accounting for treatment variability between males and females. This reduces sources of variability and thus leads to greater precision.
 Elevation: An experiment is designed to test the effects of a new pesticide on a specific patch of grass. The grass area contains a major elevation change and thus consists of two distinct regions  'high elevation' and 'low elevation'. A treatment group (the new pesticide) and a placebo group are applied to both the high elevation and low elevation areas of grass. In this instance the researcher is blocking the elevation factor which may account for variability in the pesticides application.
 Intervention: Suppose a process is invented that intends to make the soles of shoes last longer, and a plan is formed to conduct a field trial. Given a group of n volunteers, one possible design would be to give n/2 of them shoes with the new soles and n/2 of them shoes with the ordinary soles, randomizing the assignment of the two kinds of soles. This type of experiment is a completely randomized design. Both groups are then asked to use their shoes for a period of time, and then measure the degree of wear of the soles. This is a workable experimental design, but purely from the point of view of statistical accuracy (ignoring any other factors), a better design would be to give each person one regular sole and one new sole, randomly assigning the two types to the left and right shoe of each volunteer. Such a design is called a randomized complete block design. This design will be more sensitive than the first, because each person is acting as his/her own control and thus the control group is more closely matched to the treatment group.
Randomized block design
In the statistical theory of the design of experiments, blocking is the arranging of experimental units in groups (blocks) that are similar to one another. Typically, a blocking factor is a source of variability that is not of primary interest to the experimenter. An example of a blocking factor might be the sex of a patient; by blocking on sex, this source of variability is controlled for, thus leading to greater accuracy.
In Probability Theory the blocks method consists of splitting a sample into blocks (groups) separated by smaller subblocks so that the blocks can be considered almost independent. The blocks method helps proving limit theorems in the case of dependent random variables.
The blocks method was introduced by S.Bernstein:
Bernstein S.N. (1926) Sur l'extension du théorème limite du calcul des probabilités aux sommes de quantités dépendantes.  Math. Annalen, v. 97, 159.
The method was successfully applied in the theory of sums of dependent random variables and in Extreme Value Theory:
Ibragimov I.A. and Linnik Yu.V. (1971) Independent and stationary sequences of random variables. WoltersNoordhoff, Groningen.
Leadbetter M.R., Lindgren G. and Rootzén H. (1983) Extremes and Related Properties of Random Sequences and Processes. New York: Springer Verlag.
Novak S.Y. (2011) Extreme Value Methods with Applications to Finance. Chapman & Hall/CRC Press, London.
Blocking used for nuisance factors that can be controlled
When we can control nuisance factors, an important technique known as blocking can be used to reduce or eliminate the contribution to experimental error contributed by nuisance factors. The basic concept is to create homogeneous blocks in which the nuisance factors are held constant and the factor of interest is allowed to vary. Within blocks, it is possible to assess the effect of different levels of the factor of interest without having to worry about variations due to changes of the block factors, which are accounted for in the analysis.
Definition of blocking factors
A nuisance factor is used as a blocking factor if every level of the primary factor occurs the same number of times with each level of the nuisance factor. The analysis of the experiment will focus on the effect of varying levels of the primary factor within each block of the experiment.
Block a few of the most important nuisance factors
The general rule is:
 “Block what you can; randomize what you cannot.”
Blocking is used to remove the effects of a few of the most important nuisance variables. Randomization is then used to reduce the contaminating effects of the remaining nuisance variables. For important nuisance variables, blocking will yield higher significance in the variables of interest than randomizing.
Table of randomized block designs
One useful way to look at a randomized block experiment is to consider it as a collection of completely randomized experiments, each run within one of the blocks of the total experiment.
Name of Design  Number of Factors k  Number of Runs n 

2factor RBD  2  L_{1} * L_{2} 
3factor RBD  3  L_{1} * L_{2} * L_{3} 
4factor RBD  4  L_{1} * L_{2} * L_{3} * L_{4} 
kfactor RBD  k  L_{1} * L_{2} * * L_{k} 
with
 L_{1} = number of levels (settings) of factor 1
 L_{2} = number of levels (settings) of factor 2
 L_{3} = number of levels (settings) of factor 3

L_{4} = number of levels (settings) of factor 4
 L_{k} = number of levels (settings) of factor k
Example of a Randomized Block Design
Suppose engineers at a semiconductor manufacturing facility want to test whether different wafer implant material dosages have a significant effect on resistivity measurements after a diffusion process taking place in a furnace. They have four different dosages they want to try and enough experimental wafers from the same lot to run three wafers at each of the dosages.
The nuisance factor they are concerned with is "furnace run" since it is known that each furnace run differs from the last and impacts many process parameters.
An ideal way to run this experiment would be to run all the 4x3=12 wafers in the same furnace run. That would eliminate the nuisance furnace factor completely. However, regular production wafers have furnace priority, and only a few experimental wafers are allowed into any furnace run at the same time.
A nonblocked way to run this experiment would be to run each of the twelve experimental wafers, in random order, one per furnace run. That would increase the experimental error of each resistivity measurement by the runtorun furnace variability and make it more difficult to study the effects of the different dosages. The blocked way to run this experiment, assuming you can convince manufacturing to let you put four experimental wafers in a furnace run, would be to put four wafers with different dosages in each of three furnace runs. The only randomization would be choosing which of the three wafers with dosage 1 would go into furnace run 1, and similarly for the wafers with dosages 2, 3 and 4.
Description of the experiment
Let X_{1} be dosage "level" and X_{2} be the blocking factor furnace run. Then the experiment can be described as follows:
 k = 2 factors (1 primary factor X_{1} and 1 blocking factor X_{2})
 L_{1} = 4 levels of factor X_{1}
 L_{2} = 3 levels of factor X_{2}
 n = 1 replication per cell
 N = L_{1} * L_{2} = 4 * 3 = 12 runs
Before randomization, the design trials look like:
X_{1}  X_{2} 

1  1 
1  2 
1  3 
2  1 
2  2 
2  3 
3  1 
3  2 
3  3 
4  1 
4  2 
4  3 
Matrix Representation
An alternate way of summarizing the design trials would be to use a 4x3 matrix whose 4 rows are the levels of the treatment X_{1} and whose columns are the 3 levels of the blocking variable X_{2}. The cells in the matrix have indices that match the X_{1}, X_{2} combinations above.
Treatment  Block 1  Block 2  Block 3 

1  1  1  1 
2  1  1  1 
3  1  1  1 
4  1  1  1 
By extension, note that the trials for any Kfactor randomized block design are simply the cell indices of a k dimensional matrix.
Model for a Randomized Block Design
The model for a randomized block design with one nuisance variable is
where
 Y_{ij} is any observation for which X_{1} = i and X_{2} = j
 X_{1} is the primary factor
 X_{2} is the blocking factor
 μ is the general location parameter (i.e., the mean)
 T_{i} is the effect for being in treatment i (of factor X_{1})
 B_{j} is the effect for being in block j (of factor X_{2})
Estimates for a Randomized Block Design
 Estimate for μ : = the average of all the data
 Estimate for T_{i} : with = average of all Y for which X_{1} = i.
 Estimate for B_{j} : with = average of all Y for which X_{2} = j.
Generalizations of randomized block designs
 Generalized randomized block designs (GRBD) allow tests of blocktreatment interaction, and has exactly one blocking factor like the RCBD.
 Latin squares (and other rowcolumn designs) have two blocking factors that are believed to have no interaction.
 Latin hypercube sampling
 GraecoLatin squares
 HyperGraecoLatin square designs
Theoretical basis
The theoretical basis of blocking is the following mathematical result. Given random variables, X and Y
The difference between the treatment and the control can thus be given minimum variance (i.e. maximum precision) by maximising the covariance (or the correlation) between X and Y.
See also
 Algebraic statistics
 Block design
 Combinatorial design
 Generalized randomized block design
 Glossary of experimental design
 Optimal design
 Paired difference test
 Randomized block design
 Dependent and independent variables
Bibliography
 Addelman, S. (1969). "The Generalized Randomized Block Design". The American Statistician. 23 (4): 35–36. doi:10.2307/2681737. JSTOR 2681737.
 Addelman, S. (1970). "Variability of Treatments and Experimental Units in the Design and Analysis of Experiments". Journal of the American Statistical Association. 65 (331): 1095–1108. doi:10.2307/2284277. JSTOR 2284277.
 Anscombe, F.J. (1948). "The Validity of Comparative Experiments". Journal of the Royal Statistical Society. A (General). 111 (3): 181–211. doi:10.2307/2984159. JSTOR 2984159. MR 0030181.
 Bailey, R. A (2008). Design of Comparative Experiments. Cambridge University Press. ISBN 9780521683579. Archived from the original on 20180322. Prepublication chapters are available online.
 Bapat, R. B. (2000). Linear Algebra and Linear Models (Second ed.). Springer. ISBN 9780387988719.
 Caliński T. & Kageyama S. (2000). Block designs: A Randomization approach, Volume I: Analysis. Lecture Notes in Statistics. 150. New York: SpringerVerlag. ISBN 0387985786.
 Caliński T. & Kageyama S. (2003). Block designs: A Randomization approach, Volume II: Design. Lecture Notes in Statistics. 170. New York: SpringerVerlag. ISBN 0387954708. MR 1994124.
 Gates, C.E. (Nov 1995). "What Really Is Experimental Error in Block Designs?". The American Statistician. 49 (4): 362–363. doi:10.2307/2684574. JSTOR 2684574.
 Kempthorne, Oscar (1979). The Design and Analysis of Experiments (Corrected reprint of (1952) Wiley ed.). Robert E. Krieger. ISBN 0882751050.

Hinkelmann, Klaus and Kempthorne, Oscar (2008). Design and Analysis of Experiments. I and II (Second ed.). Wiley. ISBN 9780470385517.
 Hinkelmann, Klaus and Kempthorne, Oscar (2008). Design and Analysis of Experiments, Volume I: Introduction to Experimental Design (Second ed.). Wiley. ISBN 9780471727569.
 Hinkelmann, Klaus and Kempthorne, Oscar (2005). Design and Analysis of Experiments, Volume 2: Advanced Experimental Design (First ed.). Wiley. ISBN 9780471551775.
 Lentner, Marvin; Thomas Bishop (1993). "The Generalized RCB Design (Chapter 6.13)". Experimental design and analysis (Second ed.). P.O. Box 884, Blacksburg, VA 24063: Valley Book Company. pp. 225–226. ISBN 096162552X.
 Raghavarao, Damaraju (1988). Constructions and Combinatorial Problems in Design of Experiments (corrected reprint of the 1971 Wiley ed.). New York: Dover. ISBN 0486656853.
 Raghavarao, Damaraju and Padgett, L.V. (2005). Block Designs: Analysis, Combinatorics and Applications. World Scientific. ISBN 9812563601.
 Shah, Kirti R. & Sinha, Bikas K. (1989). Theory of Optimal Designs. Lecture Notes in Statistics. 54. SpringerVerlag. pp. 171+viii. ISBN 0387969918.
 Street, Anne Penfold & Street, Deborah J. (1987). Combinatorics of Experimental Design. Oxford U. P. [Clarendon]. pp. 400+xiv. ISBN 0198532563.
 Wilk, M. B. (1955). "The Randomization Analysis of a Generalized Randomized Block Design". Biometrika. 42 (1–2): 70–79. doi:10.2307/2333423. JSTOR 2333423.
 Zyskind, George (1963). "Some Consequences of randomization in a Generalization of the Balanced Incomplete Block Design". The Annals of Mathematical Statistics. 34 (4): 1569–1581. doi:10.1214/aoms/1177703889. JSTOR 2238364.
 Addelman, S. (1969). "The Generalized Randomized Block Design". The American Statistician. 23 (4): 35–36. doi:10.2307/2681737. JSTOR 2681737.
 Addelman, Sidney (1970). "Variability of Treatments and Experimental Units in the Design and Analysis of Experiments". Journal of the American Statistical Association. 65 (331): 1095–1108. doi:10.2307/2284277. JSTOR 2284277.
 Bailey, R. A (2008). Design of Comparative Experiments. Cambridge University Press. ISBN 9780521683579. Prepublication chapters are available online.
 Caliński T. & Kageyama S. (2000). Block designs: A Randomization approach, Volume I: Analysis. Lecture Notes in Statistics. 150. New York: SpringerVerlag. ISBN 0387985786.
 Gates, C.E. (1995). "What Really Is Experimental Error in Block Designs?". The American Statistician. 49 (4): 362–363. doi:10.2307/2684574. JSTOR 2684574.
 Kempthorne, Oscar (1979). The Design and Analysis of Experiments (Corrected reprint of (1952) Wiley ed.). Robert E. Krieger. ISBN 0882751050.

Hinkelmann, Klaus; Kempthorne, Oscar (2008). Design and Analysis of Experiments. I and II (Second ed.). Wiley. ISBN 9780470385517.
 Hinkelmann, Klaus; Kempthorne, Oscar (2008). Design and Analysis of Experiments, Volume I: Introduction to Experimental Design (Second ed.). Wiley. ISBN 9780471727569.
 Hinkelmann, Klaus; Kempthorne, Oscar (2005). Design and Analysis of Experiments, Volume 2: Advanced Experimental Design (First ed.). Wiley. ISBN 9780471551775.
 Lentner, Marvin; Thomas Bishop (1993). Experimental design and analysis (Second ed.). P.O. Box 884, Blacksburg, VA 24063: Valley Book Company. pp. 225–226. ISBN 096162552X.
 Wilk, M. B. (1955). "The Randomization Analysis of a Generalized Randomized Block Design". Biometrika. 42 (1–2): 70–79. doi:10.2307/2333423. JSTOR 2333423.
 Zyskind, George (1963). "Some Consequences of randomization in a Generalization of the Balanced Incomplete Block Design". The Annals of Mathematical Statistics. 34 (4): 1569–1581. doi:10.1214/aoms/1177703889. JSTOR 2238364.
External links
 Examples of all ANOVA and ANCOVA models with up to three treatment factors, including randomized block, split plot, repeated measures, and Latin squares, and their analysis in R (University of Southampton)
 Randomized Block Designs
This article incorporates public domain material from the National Institute of Standards and Technology website http://www.nist.gov.