2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial...

25
17-1 ©2006 Raj Jain CSE567M Washington University in St. Louis 2 2 k k Factorial Factorial Designs Designs Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 [email protected] These slides are available on-line at: http://www.cse.wustl.edu/~jain/cse567-06/

Transcript of 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial...

Page 1: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-1©2006 Raj JainCSE567MWashington University in St. Louis

22kk Factorial Factorial DesignsDesigns

Raj Jain Washington University in Saint Louis

Saint Louis, MO [email protected]

These slides are available on-line at:http://www.cse.wustl.edu/~jain/cse567-06/

Page 2: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-2©2006 Raj JainCSE567MWashington University in St. Louis

OverviewOverview

! 22 Factorial Designs! Model! Computation of Effects! Sign Table Method! Allocation of Variation! General 2k Factorial Designs

Page 3: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-3©2006 Raj JainCSE567MWashington University in St. Louis

22kk Factorial DesignsFactorial Designs

! k factors, each at two levels.! Easy to analyze.! Helps in sorting out impact of factors.! Good at the beginning of a study.! Valid only if the effect is unidirectional.

E.g., memory size, the number of disk drives

Page 4: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-4©2006 Raj JainCSE567MWashington University in St. Louis

2222 Factorial DesignsFactorial Designs

! Two factors, each at two levels.

Page 5: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-5©2006 Raj JainCSE567MWashington University in St. Louis

ModelModel

Interpretation: Mean performance = 40 MIPSEffect of memory = 20 MIPS; Effect of cache = 10 MIPSInteraction between memory and cache = 5 MIPS.

Page 6: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-6©2006 Raj JainCSE567MWashington University in St. Louis

Computation of EffectsComputation of Effects

Page 7: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-7©2006 Raj JainCSE567MWashington University in St. Louis

Computation of Effects (Cont)Computation of Effects (Cont)Solution:

Notice that effects are linear combinations of responses.Sum of the coefficients is zero ⇒ contrasts.

Page 8: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-8©2006 Raj JainCSE567MWashington University in St. Louis

Computation of Effects (Cont)Computation of Effects (Cont)

Notice:qA = Column A × Column yqB = Column B × Column y

Page 9: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-9©2006 Raj JainCSE567MWashington University in St. Louis

Sign Table MethodSign Table Method

Page 10: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-10©2006 Raj JainCSE567MWashington University in St. Louis

Allocation of VariationAllocation of Variation! Importance of a factor = proportion of the variation explained

! For a 22 design:

! Variation due to A = SSA = 22 qA2

! Variation due to B = SSB = 22 qB2

! Variation due to interaction = SSAB = 22 qAB2

! Fraction explained by A = Variation ≠ Variance

Page 11: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-11©2006 Raj JainCSE567MWashington University in St. Louis

DerivationDerivation! Model:

Notice1. The sum of entries in each column is zero:

2. The sum of the squares of entries in each column is 4:

Page 12: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-12©2006 Raj JainCSE567MWashington University in St. Louis

Derivation (Cont)Derivation (Cont)

3. The columns are orthogonal (inner product of any two columns is zero):

Page 13: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-13©2006 Raj JainCSE567MWashington University in St. Louis

Derivation (Cont)Derivation (Cont)

!

Page 14: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-14©2006 Raj JainCSE567MWashington University in St. Louis

Derivation (Cont)Derivation (Cont)

! Variation of y

Page 15: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-15©2006 Raj JainCSE567MWashington University in St. Louis

Example 17.2Example 17.2! Memory-cache study:

! Total variation= 2100Variation due to Memory = 1600 (76%)Variation due to cache = 400 (19%)Variation due to interaction = 100 (5%)

Page 16: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-16©2006 Raj JainCSE567MWashington University in St. Louis

Case Study 17.1: Interconnection NetsCase Study 17.1: Interconnection Nets! Memory interconnection networks: Omega and

Crossbar.! Memory reference patterns: Random and Matrix! Fixed factors:

" Number of processors was fixed at 16." Queued requests were not buffered but blocked." Circuit switching instead of packet switching." Random arbitration instead of round robin." Infinite interleaving of memory ⇒ no memory

bank contention.

Page 17: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-17©2006 Raj JainCSE567MWashington University in St. Louis

2222 Design for Interconnection NetworksDesign for Interconnection Networks

Page 18: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-18©2006 Raj JainCSE567MWashington University in St. Louis

Interconnection Networks ResultsInterconnection Networks Results

! Average throughput = 0.5725! Most effective factor = B = Reference pattern⇒ The address patterns chosen are very different.

! Reference pattern explains ∓ 0.1257 (77%) of variation.! Effect of network type = 0.0595

Omega networks = Average + 0.0595Crossbar networks = Average - 0.0595

! Slight interaction (0.0346) between reference pattern and network type.

Page 19: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-19©2006 Raj JainCSE567MWashington University in St. Louis

General 2General 2kk Factorial DesignsFactorial Designs

! k factors at two levels each.2k experiments.2k effects:

Page 20: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-20©2006 Raj JainCSE567MWashington University in St. Louis

22kk Design ExampleDesign Example

! Three factors in designing a machine:" Cache size" Memory size" Number of processors

Page 21: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-21©2006 Raj JainCSE567MWashington University in St. Louis

22kk Design Example (cont)Design Example (cont)

Page 22: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-22©2006 Raj JainCSE567MWashington University in St. Louis

Analysis of 2Analysis of 2kk DesignDesign

! Number of Processors (C) is the most important factor.

Page 23: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-23©2006 Raj JainCSE567MWashington University in St. Louis

SummarySummary

! 2k design allows k factors to be studied at two levels each! Can compute main effects and all multi-factors interactions! Easy computation using sign table method! Easy allocation of variation using squares of effects

Page 24: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-24©2006 Raj JainCSE567MWashington University in St. Louis

Exercise 17.1Exercise 17.1

Analyze the 23 design:

" Quantify main effects and all interactions." Quantify percentages of variation explained." Sort the variables in the order of decreasing

importance.

Page 25: 2k Factorial Factorial Designs - cse.wustl.edujain/cse567-08/ftp/k_172kd.pdf · 2k Factorial Designs, 22 Factorial Designs, Model, Computation of Effects, Sign Table Method, Allocation

17-25©2006 Raj JainCSE567MWashington University in St. Louis

HomeworkHomework

Modified Exercise 17.1 Analyze the 23 design:

" Quantify main effects and all interactions." Quantify percentages of variation explained." Sort the variables in the order of decreasing

importance.