Instructors often focus on content when embarking on course design, but it’s equally important to think about the result of a course: the student’s learning. Intended Learning Outcomes (ILOs) focus on just that — they articulate what students should be able to know, do, and value by the end of a course.
Instructional goals vs. learning outcomes
Instructional goals focus on what the instructors will do. Learning Outcomes focus on what the student will learn and do.
Instructional goals tend to focus on what we will do as instructors and the opportunities a course will provide to students:
- Offer students the opportunity to participate in open dialogue about the impact of technology on society.
- Cover the following topics: Euler’s Formula, Complex Numbers, and Factoring Polynomials.
- Enhance students’ understanding of phase transitions and Landau Theory.
Outcomes focus on the learner, stating what the student should be able to do and achieve by the end of a course.
- Analyze the behaviour of realistic nonlinear systems.
- Identify all major syntactical constructions of the Latin language.
- Critique a variety of methodological approaches to the study of literature.
Rather than focus on what an instructor will do in a course, ILOs focus on what learners can achieve. They can prompt us to ask, “What assignment or learning activity will help my students reach the intended learning outcomes of the course?” This can help instructors think through how best to assess that learning.
Three principles of effective learning outcomes
Specificity
There is a fine balance between too generic and overly specific. Consider an outcome related to writing:
- By the end of the course, a student should be able to write an essay.
Unless this outcome is for an introductory composition course, the problem with write an essay is that it is too vague to be easily assessable. This learning outcome is not connected to the desired analytical skills you may want students to demonstrate in their essays or to the content of the course.
At the same time, it is possible to be too specific:
- Summarize War and Peace in a 5-page essay.
The specificity of this outcome makes it rather rigid for a course-level outcome; it would be more appropriate as part of an assignment description. Again, what do you actually want students to be able to do? Could they achieve the intended outcome if the essay were based on a different book? Is the 5-page essay a critical component of assessment? Are there other ways to accomplish the writing task other than through an essay?
To improve this outcome statement, consider what your students need to achieve in the course. Are they expected to simply comprehend the text or do they need to analyse it? Perhaps the focus is on the skill of developing an argument in an essay and the text to be analysed is a secondary component. Here is a more specific outcome that emphasises analysis rather than writing:
- Appraise character development in 19th century Russian literature.
The wording of ILOs is also important to consider: action verbs such as write, summarize, and appraise connect to clearer learning behaviours than understand or know. Specific learning outcomes help students to make sense of the kinds of learning they need to demonstrate in a course.
Attainability – the right level
An attainable outcome describes a realistic expectation of your students. For example, first-year accounting students would not be required to analyze a complex tax case study because they would not have the needed prerequisite knowledge. A fairly linear progression through the program’s curriculum is required.
In other disciplines, the content might not change as much as the required learning activity. Consider the review of journal articles by second-year students and master’s students. While the second-year student might be expected to find credible sources within the discipline, the master’s student is expected to critically evaluate those articles. It is valuable to understand where your course fits into the broader curriculum to assist with identifying what your students can reasonably achieve.
When writing outcomes, Bloom’s Taxonomy (1956) is a useful in defining the level that students need to attain. Bloom and his colleagues divided learning into three domains: cognitive, psychomotor, and affective. Today, we expand psychomotor to include a broad range of skills (e.g., problem-solving, critical thinking, communication, etc.).
Within each domain, a learning hierarchy demonstrates the increasing complexity associated with learning. In the cognitive domain, for example, there are six levels: knowledge, comprehension, application, analysis, synthesis, and evaluation. In 2001, Anderson and Krathwohl modified the original hierarchy suggesting, for example, that creating something requires a higher level of thinking than evaluating someone else’s creation. The resulting cognitive domain hierarchy is presented in Table 1.
| Cognitive Domain Hierarchy | Associated Actions |
| Remember | Recall, remember, match, select, identify, choose, order, outline |
| Understand | Plot, define, summarize, classify, describe, present, explain |
| Apply | Propose, audit, edit, predict, construct, use, show, solve, compute |
| Analyze | Distinguish, differentiate, investigate, scrutinize, consider, question |
| Evaluate | Appraise, assess, judge, critique, comment, examine, interrogate |
| Create | Develop, design, devise, generate, propose, build, form, assemble |
Bloom created hierarchies for the psychomotor and affective domains as well.
| Psychomotor Domain Hierarchy | Affective Domain Hierarchy |
| 1. Imitation | 1. Receiving |
| 2. Manipulation | 2. Responding |
| 3. Precision | 3. Valuing |
| 4. Articulation | 4. Organization |
| 5. Naturalization | 5. Characterization |
As you select the right level for your students, another consideration is what is achievable in a twelve-week course. Additional contextual factors that may influence your ILOs include: class size, whether or not students are from the same programme or a variety of programmes, year of the course, level, number of tutors.
Measurability
ILOs must be measurable. You need to evaluate whether — and how well — each requirement has been fulfilled. Each ILO, then, needs to relate to particular assessment questions or activities as a means of collecting evidence of learning. Using an alignment table or matrix can help you to determine whether all ILOs are assessed in your course.
Specificity can also assist with measurement. For example, if an ILO indicates that students will understand electrical circuits, how might that be measured? Should they be able to build and test a circuit or simply draw a diagram of one? The actual learning that is to be assessed is not very clear from a vague ILO statement. Identifying the assessments that you want to use can help you to sharpen your ILOs.
Given that ILOs can relate to different learning domains and different levels within those domains, they are not all equally easy to measure. Some types of ILOs are straightforward to measure (e.g., those on the lower end of the cognitive domain or specific behaviours in the psychomotor domain). For example, measurement is clear when assessments have right versus wrong answers. In math, students can demonstrate their ability to apply certain equations through assignment or test questions; they get marks when they are correct and no marks when they are not. However, not all ILOs are so easily assessable. An ILO that asks students to analyse a text according to a particular theory of literary criticism may be assessed via an analytical paper or seminar presentation, but there is not one optimal end product. In such cases it is typically possible to create criteria for a rubric that can be used to assess how well the various criteria have been met.
Measuring outcomes that look for changes in attitudes or values rather than specific behaviours can be even more challenging. These ILOs typically stem from the affective domain. It may be more productive to think of what evidence can be collected as indicators of a change than to focus on measurement. For example, what evidence could you collect to demonstrate that the following outcomes have been met:
- Appreciate works of art from the 20th century.
- Value lifelong learning in their profession.
- Question the impact of socioeconomic status in relation to access to higher education.
In the lifelong learning example, if a student researches continuing education courses and makes a professional development plan for the future, this could demonstrate that they see value in lifelong learning. Journaling or other types of learning documents like ePortfolios may provide students with a means to explain or show changes in how or what they think.
24 April 2021.
Writing Learning Outcomes by University of Waterloo / Dr. Gil Dekel is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of Educational Objectives. New York: Longman.
Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals. New York: D. MacKay.