Design of Experiments (DOE) Basics for the ASQ CQE
DOE lets you learn the most about a process from the fewest experiments. Here are the core concepts every CQE candidate needs to understand.
When a process has many inputs and you need to find the settings that produce the best output, guessing is expensive and one-change-at-a-time testing is slow. Design of Experiments (DOE) is the statistical discipline that extracts the most knowledge from the fewest runs—and it is one of the more challenging quantitative topics on the CQE exam.
I am John Lee of Alpha Training and Consulting. This introduction covers the vocabulary and reasoning of DOE so the exam questions feel approachable rather than intimidating.
The vocabulary of experiments
- Factor: an input variable you control, such as temperature or pressure.
- Level: a specific setting of a factor, such as 200 degrees or 250 degrees.
- Response: the output you measure, such as strength or yield.
- Main effect: the average change in the response caused by changing a single factor.
- Interaction: when the effect of one factor depends on the level of another.
Why not just change one factor at a time?
The one-factor-at-a-time (OFAT) approach feels intuitive but has two fatal weaknesses. First, it is inefficient—reaching the same statistical precision takes more runs. Second, and more importantly, it is blind to interactions. If the ideal temperature depends on which catalyst you use, OFAT will never reveal it because it never varies the two together. DOE varies factors simultaneously and estimates both main effects and interactions.
Full and fractional factorial designs
A full factorial design tests every combination of factor levels. With three factors at two levels each, that is eight runs. Add factors and the count grows quickly—seven factors at two levels would be 128 runs. Fractional factorial designs run a carefully chosen fraction of those combinations, accepting some confounding of higher-order interactions in exchange for a dramatic reduction in runs. Screening designs like Plackett-Burman push this further to identify the vital few factors from many.
The three principles of good experimental design
| Principle | Purpose |
|---|---|
| Randomization | Runs are performed in random order to spread the effect of unknown nuisance variables. |
| Replication | Repeating runs provides an estimate of experimental error and improves precision. |
| Blocking | Grouping runs by a known nuisance factor (e.g., material lot) removes its effect from the comparison. |
DOE is where statistics turns into process improvement. Once an experiment identifies the factors that drive your response, you can set them to make the process more capable—which links directly to capability analysis and to the broader continuous improvement toolkit covered elsewhere in this series.
Frequently asked questions
Why is DOE better than changing one factor at a time?+
One-factor-at-a-time testing requires more runs to reach the same precision and, critically, cannot detect interactions between factors. DOE varies factors together, so it finds the best combination and reveals when factors influence each other.
What is an interaction?+
An interaction occurs when the effect of one factor depends on the level of another. For example, the best temperature might depend on which material is used. Only a designed experiment that varies both factors together can detect this.
What is the difference between a full and fractional factorial?+
A full factorial runs every possible combination of factor levels, giving complete information but requiring many runs. A fractional factorial runs a strategically selected subset, trading some higher-order interaction information for far fewer experimental runs.
Written by
John Lee
President, Alpha Training and Consulting
John Lee has more than 25 years of experience in quality engineering and has personally earned every ASQ certification, including the Certified Quality Engineer (CQE). A Shingo Award–winning author, he has helped thousands of engineers pass their ASQ exams on the first attempt with a 94% first-time pass rate.
Certifications: BSME, MBA, CMQ/OE, CQE, CRE, CQA, CQIA, CQI, CCT, CQPA, CQT, CHA, CBA, CSQE, CSQP, CCQM, CSSYB, CSSGB, CSSBB, CPGP, CMBB
Alpha Training and Consulting is an independent training provider and is not affiliated with, endorsed by, or sponsored by ASQ. "ASQ" and "Certified Quality Engineer (CQE)" are trademarks of the American Society for Quality. Exam policies, fees, and Body of Knowledge weightings are set by ASQ and can change—always confirm current details at asq.org.