After the sudden shift to online instruction in spring 2020, colleges and universities faced a daunting task for the 2020-2021 academic year: to continue teaching and campus activities in the safest but least disruptive way possible, while confronting even greater uncertainty as the pandemic continued to unfold. In planning the 2021 survey administration, NSSE recognized the need to address these challenges and their impact on students. Two ways we sought to accommodate these shifts were to revise an existing survey question about course modality and the development of a topical module focused specifically on the challenges and adaptations resulting from the pandemic: Coping with COVID. Questions from the module focus on topics such as faculty and institutional responsiveness, disrupted educational plans, stressors and negative emotional experiences, and changes in activities and time demands.
Pandemic & Student Engagement
I have enjoyed meeting people in my Living Learning Community, but COVID restrictions, although they are necessary, have caused some difficulties for me in making friends and connections.FIRST-YEAR STUDENT, PSYCHOLOGY MAJOR
Dramatic Shifts in Course Modality
- Mostly in-person courses
- Mostly remote courses (online, web-based, Zoom, etc.)
- Mostly hybrid or blended courses that combine in-person and remote instruction
- A balanced mix of the above course types
Results from the new course modality question are striking. Although direct comparisons to prior years cannot be made, until 2021 relatively few students took all courses online in the spring—for example, in 2019, only 8% of first-years and 20% of seniors took all spring courses online. In 2021, however, fully 65% of first-year students took mostly remote courses, while 16% took mostly hybrid, and 12% took a balanced mix of modalities. Just 7% of said their courses were mostly in-person! For seniors, 66% of courses were mostly remote, 13% hybrid, and 10% a balanced mix, while only 11% were mostly in-person (Figure 1).
Note: NSSE 2021 results in figure 1 are from 154,653 first-year and senior students at 337 U.S. bachelor's degree-granting institutions.
These patterns varied somewhat depending on the type of student and institution. Students at doctorate-granting universities were more likely to take most courses online, whereas students at baccalaureate-level institutions were more likely to take most courses in-person or in a hybrid format. Nontraditionally aged students (21 and older for first-years; 25 and older for seniors) were much more likely to take mostly remote courses. While on-campus residents were more likely to have in-person courses, it is noteworthy that 47% of first-years and 44% of seniors who lived on campus had mostly remote courses.
NSSE 2021 in Context: COVID Impact
As many schools adapted to remote instruction, participation in some HIPs declined and students had fewer opportunities for collaborative learning and faculty interaction. This Enews story also links to a Webinar on the subject.Visit the Enews story
Mental Health and Academic Difficulty: BCSSE Findings
Time to check in with our first-year students? COVID-induced distance learning challenged their final year of high school. How might we expect their engagement to be affected?Visit the BCSSE story
COVID Module Results: Group Differences a Cause for Concern
Exploring the spring 2021 module data illuminates several of the obstacles that students have faced during the pandemic. With responses from 7,413 first-year students and 9,229 seniors from 47 bachelor’s degree-granting colleges and universities in the US, we investigated multiple pandemic-related topics. Broad patterns indicate increases in mental health issues, with around two-thirds of both first-years and seniors experiencing substantial increases in mental or emotional exhaustion, and nearly half experiencing increases in anxiety and inability to concentrate. Students also felt that the pandemic had a negative impact on their educational plans, most notably with more than half expressing an interference with participation in special learning opportunities such as internships, study abroad, or field experiences.
Mental Health Differences by Gender Identity
Table 1. Selected Mental Health Issue Increases by Gender Identity
|As a result of the COVID-19 pandemic, to what extent, if any, have you experienced an increase in the following?||First-year female||First-year|
|Mental or emotional exhaustion||74%||57%||72%||56%|
|Depression that interfered with daily functioning||46%||34%||43%||34%|
|Anxiety that interfered with daily functioning||56%||36%||52%||36%|
|Feeling hopeless about your current situation||41%||31%||36%||28%|
|Inability to concentrate||55%||41%||51%||41%|
Notes: Percentages are the sum of "very much" and "quite a bit." Results for nonbinary gender identities are not displayed due to low counts.
Female students were more likely to experience increased mental health issues. This was particularly notable with anxiety that interfered with daily functioning with 56% of first-year female students suffering a substantial (“very much” or "quite a bit") increase, compared to 36% of males. Other concerning gaps involved increases in mental and emotional exhaustion, depression, feeling hopeless, inability to concentrate, and difficulty sleeping (Table 1). Female respondents were also more likely to have increased concerns about personal health and safety, as well as that of friends and family. These are troubling findings, as women students seem to struggle with greater emotional burdens of the pandemic, and this kind of stress can damage overall health and college success. Also troubling is that exacerbated mental health issues appear to be even more prominent among nonbinary gender identities (for instance, 74% of nonbinary first-year students noted a substantial increase in anxiety that interfered with daily functioning), although such results may be less conclusive due to the relatively small numbers in this group.
Course Modality Impacts Perceptions
Given the dramatic shift in course modality for the 2020-2021 academic year, we explored differences across subgroups of students. First-year students taking mostly remote courses were more likely than others to feel that the pandemic interfered with their college plans and their preferred living situation (Figure 2). A larger percentage (66%) of first-year remote students were living with family members, compared to 34% of in-person and 37% of hybrid, which may partially explain the perceived hindrance with preferred living situations. First-year students taking most courses in person were more likely to feel their instructors were substantially (“very much” or “quite a bit”) responsive to the needs of students, compared to those taking most courses remotely and in hybrid formats (73% versus 62%). First-year students taking their courses in remote or hybrid formats were also somewhat more likely to feel an increase in mental health issues such as inability to concentrate (51% of remote and 52% of hybrid, compared to 40% of in-person), as well as depression, feeling hopeless, and difficulty sleeping (Table 2). However, few of these discrepancies by course modality were evident for seniors.
Table 2. Selected Mental Health Issue Increases for First-Year Students by Course Modality
|As a result of the COVID-19 pandemic, to what extent, if any, have you experienced an increase in the following?||Mostly |
|Mostly remote||Mostly hybrid||Balanced mix|
|Mental or emotional exhaustion||63%||69%||70%||65%|
|Depression that interfered with daily functioning||35%||42%||43%||37%|
|Anxiety that interfered with daily functioning||43%||49%||49%||46%|
|Feeling hopeless about your current situation||30%||38%||40%||34%|
|Inability to concentrate||40%||51%||52%||47%|
Note: Percentages are the sum of "very much" and "quite a bit."
Age-Related Differences in the Student Experience
Table 3. Pandemic Interference by Age Group
|To what extent, if any, has the COVID-19 pandemic interfered with the following?||First-year traditional age||First-year nontrad. age||Senior traditional age||Senior nontrad. age|
|Your college plans||55%||39%||49%||35%|
|Your ability to succeed as a student||43%||36%||41%||30%|
|Your plans to participate in special learning opportunities||57%||36%||60%||40%|
|Your ability to pay for college and living expenses||33%||37%||36%||36%|
|Your preferred living situation||37%||30%||33%||25%|
Note: Percentages are the sum of "very much" and "quite a bit." Nontraditional age is defined as 21 and older for FY students and 25 and older for seniors.
Some differences were observed for nontraditional-age students (21 and older for first-years; 25 and older for seniors), compared with their traditional-age counterparts. Given the variation in course modality for these groups, this is understandable, but further investigating discrepancies can help to reveal opportunities for customized support aligned with the needs of the group. Both first-year and senior traditional-age students were more likely to feel that the pandemic interfered with their college plans, ability to succeed as a student, ability to participate in special learning opportunities, and preferred living situation (Table 3). These traditional-age students were also more likely to struggle with increased mental health issues, including feeling hopeless, inability to concentrate, and difficulty sleeping, as well as increased concern (“quite a bit” or “very much”) about their ability to socialize. It may be that traditional-age students had higher or more developed expectations about the changes that college would bring (i.e., living away from home, freedoms), but given pandemic shifts in course modality and social life not all of these experiences were possible. In comparison, nontraditional-age students may have better tempered their expectations or could be more resilient and have better coping strategies than their younger counterparts. Meanwhile, first-year nontraditional-age students were more likely to feel increased concern about their ability to pay bills, health and safety, and access to adequate medical care (Figure 3). Not surprisingly, both first-year (33%) and senior (36%) nontraditional-aged students were more likely to substantially (“more” and “much more”) increase their time spent caring for dependents and others, compared to 17% (first-years) and 19% (seniors) of traditional-aged students.
Note: In the results above, all core item percentages are weighted by institution-reported sex, enrollment status, and institutional size. All module item percentages are weighted by institution-reported sex and enrollment status.
How Engagement Shifted During the Pandemic
Given the widespread adoption of online learning during the 2020-21 academic year as well as the tumult—both organizational and personal—caused by the pandemic, it comes as no surprise that certain forms of student engagement shifted from prior years at many institutions. What is surprising is that only a few engagement measures declined substantially.
Figures 4-7 are featured in the slideshow below.
We used information from more than 200,000 first-year and senior respondents at 296 institutions to shed light on whether and how engagement was affected. The institutions included in this analysis participated in NSSE 2021 and at least one recent administration other than 2020 (2018 or 20191).
We examined NSSE’s 10 Engagement Indicators (EI) and six High-Impact Practices (HIP), as shown in the slideshow for Figures 4 to 7. For each Engagement Indicator, we calculated a standardized difference (effect size) using 2021 and prior year data for first-year and senior respondents at each institution; negative scores indicate that engagement decreased in 2021. Reviewing the distribution of institution-level difference scores for each EI leads to several conclusions.2 Most notably, forms of student engagement that have historically relied on face-to-face interactions or accessing services and attending events, including Collaborative Learning, Discussions with Diverse Others, Student-Faculty Interaction, and Supportive Environment, declined at many institutions. While approximately half of institutions saw a 0.5 standard deviation or more decrease in first-year Collaborative Learning scores, the other measures showed more modest shifts (median declines of 0.14 to 0.20 standard deviations).
In contrast, six EIs tended not to decrease substantially, including Higher-Order Learning, Reflective & Integrative Learning, Quantitative Reasoning, Learning Strategies, Effective Teaching Practices, and Quality of Interactions. In fact, many institutions scored slightly higher on these measures in 2021, regardless of class level. Though a comparison of results between class levels shows similar difference score distributions, Collaborative Learning and Supportive Environment appeared to decline more for first-year students than for seniors, suggesting that seniors may have weathered pandemic-related obstacles by relying on their pre-pandemic support networks and awareness of campus resources.
"The most significant learning experience I have had is the shift to online learning during the pandemic. This was a shift for everyone at my school and we all joined together to learn how to handle things and do things differently. It was a big learning experience to become educated on how to work through online courses and learn a new way of being in a class. Overall, it provided a sense of community because everyone was in it together (faculty, students, staff), learning how to do things differently."
SENIOR, ART MAJOR, WHEATON COLLEGE (MA)
We analyzed HIP participation rates using standardized difference scores to assess the extent of change as well, but using different effect size evaluative criteria for four of the six practices.3 In the aggregate, most HIP participation rates declined in trivial or modest ways in 2021. The median effect sizes for first-year and senior students all indicated small declines in participation rates, with standardized difference scores averaging about –0.08; a review of 25th percentile scores indicated slightly greater decline but still within the range of small effect sizes. First-year participation in service-learning as well as senior participation internships and study abroad showed the strongest relative decline of all HIPs with approximately 25% of institutions showing standardized difference scores of –0.30, -0.22, and –0.25 or less, respectively. A small number of institutions saw increases in HIP participation, but for the vast majority of these the shift was small or trivial in size.
Overall, the pandemic resulted in fairly predictable changes to student engagement from prior years. Students, faculty, and staff have persevered, finding ways to be engaged remotely or in hybrid modes and to take advantage of pandemic-altered opportunities for learning. We encourage institutions to examine where their results diverge from our comparative analysis to enhance the interpretation of institution-level engagement trends.
1. Despite NSSE 2020 institutional results being mostly unaffected by the pandemic, we chose to use earlier administration data to err on the side of caution given the baseline’s importance for measuring change.
2. To assess the magnitude of Engagement Indicator changes, differences greater than .1, .3, and .5 are considered small, medium, and large, respectively. For service-learning, internships, study abroad, and culminating senior experiences, an effect size of about .2 may be considered small, .5 medium, and .8 large. For learning community and research with faculty, .1 may be considered small, .3 medium, and .5 large (Rocconi & Gonyea, 2018).
3. For first-year students, we only analyze participation in three HIPs that are likely to be experienced during the first-year of college: learning community, service-learning, and research with faculty.
Rocconi, L. M., & Gonyea, R. M. (2018). Contextualizing effect sizes in the National Survey of Student Engagement: An empirical analysis. Research and Practice in Assessment, 13(Summer/Fall), 22-38.