Search again
Publications
Mapping High-Impact Practices to Advising Research Briefs
Kinzie, J., Keup, J., Holmes, B. Hilliard, K.
National Resource Center for the First-Year Experience and Students in Transition, 2024.
Mapping High-Impact Practices to Advising is a research brief series published by the National Resource Center for The First-Year Experience and Students in Transition in collaboration with the National Survey of Student Engagement (NSSE) with grant funding from the Advising Success Network. This four-issue series explores a range of novel connections between advising and HIPs, elaborating on the multiple ways advising can be transformative in undergraduate education.
Full version
Can Shorter Surveys Motivate Nonrespondents to Respond? A Randomized Controlled Experiment with College Students
Sarraf, Shimon
Atlanta, GA: , 2024.
During the spring 2023, NSSE conducted a randomized controlled experiment with nonrespondents to assess the impact of administering shorter surveys on response rates and question completion. This poster documents the experiment's major findings and concusions.
Full version
Expanding our knowledge of LGBQ+ faculty
BrckaLorenz, A., Fassett, K., Merckle, R., & Chamis, E.
Journal of Diversity in Higher Education, , , 2023.
Most research about queerness at colleges and universities has been aimed at examining the student experience. Research on queer faculty often has quantitative limitations, has grown outdated, or is qualitative in nature, but from this work, we know that the experiences of queer faculty are often difficult. Through a large-scale, multi-institution, multiyear investigation of LGBQ+ faculty, this study gives an overview of the academic lives of these understudied academics. We investigate who they are, what institutions employ them, and different ways they contribute to undergraduate education. With this story, we hope to strengthen the voices of qualitative studies and encourage higher education to think more broadly about notions of diversity and identity.
Full version
How do university faculty feel about grading? Insights from a control-value theory perspective
Schwab, C., Frenzel, A. C., BrckaLorenz, A., Jaeger, J., & Stupnisky, R.
Studies in Higher Education, , , 2023.
Research on faculty emotions is scarce, despite their evident relevance for faculty well-being, higher education quality, and student outcomes. The present studies aimed to investigate six discrete emotions (enjoyment, pride, boredom, anxiety, anger, frustration) faculty may experience during grading. Study 1 compared faculty emotions for grading with emotions for research and teaching (US sample, N??=??1226). Mean comparisons showed that grading generally elicited less positive and more negative emotions than research and teaching. Study 2 further examined faculty emotions for grading through the lens of control-value theory, by identifying emotion-specific appraisal patterns in two countries (US, n??=??244 and Germany, n??=??201). Multiple linear regressions revealed that the most consistent predictor for grading emotions across both samples was cost, in terms of the extent to which faculty perceived grading as a thankless task that kept them away from more meaningful tasks. Our findings further point to the important role of faculty??student relationships and faculty members?? confidence in their grading ability for eliciting grading emotions. This study extends existing research on emotions in higher education by considering grading as a relevant emotion-inducing task, and by applying control-value theory to a new context in two countries, thereby contributing to the question of this theory??s generalizability. Practical implications of our findings entail that universities should aim to improve the circumstances of grading and equip their faculty with the means to handle their grading duties well, to optimize their somewhat worrisome emotional experiences in this context.
Full version
International students?? career preparation
Oktafiga, D., Zhu, Y. & BrckaLorenz, A.
In M. Mohamad & J. Boyd International Student Support and Engagement in Higher Education: Exploring Innovative Practices in Campus, Academic and Professional Support Services Routledge, 2023.
International students (ISs) are a significant and growing student group with unique needs. We use 2015??2019 National Survey of Student Engagement data that includes over 4,000 ISs, senior undergraduate college students in the United States from other countries studying at more than 450 colleges and universities. We describe these ISs?? future career plans, how prepared they are in terms of career-related skills and abilities, and how internships and other career preparation experiences relate to these skills and abilities. Findings indicate that ISs?? country of origin, major, and participation in internships play an important role in understanding students?? confidence in the use of selected skills and abilities. We will provide detailed information about the IS landscape and the benefits that career services would bring to them, with implications for practice and future research that include finding effective ways to balance ISs?? academic and social lives.
Full version
Teaching development opportunities & faculty teaching practice at four-year institutions
Fassett, K., Hiller, S. C., BrckaLorenz, A., & Nelson Laird, T.
College Teaching, 71(3), 165-175, 2023.
To contextualize the myriad of teaching development efforts available to faculty, this large-scale study of nearly 4,500 faculty at four-year institutions broadens our understandings of who participates in teaching development practices, how their participation relates to their institutional environments, and how their participation connects to their use of effective teaching practices. Results show some notable patterns by academic field, social identity, the type of courses taught, and institutional characteristics. The overview of educational development participation in this study gives strength to positive findings from smaller-scale research studies and provides a solid base for more specific studies of these practices.
Full version
Understanding international student experiences and career preparation challenges through COVID-19
Zhu, Y., Gopal, K., & BrckaLorenz, A.
In A.W. Wiseman, C. Matherly, & M. Crumley-Effinger Internationalization and Imprints of the Pandemic on Higher Education Worldwide Emerald Publishing, 2023.
College support and career development are two significant challenges international students encountered during the pandemic, and these two factors have an enormous impact on the internationalization of higher education. The data for this study came from the 2020 to 2021 administrations of the National Survey of Student Engagement (NSSE) that includes over 500 international students enrolled at over 120 four-year colleges and universities in the United States. These students specifically responded to an open-ended item asking them what they think institutions should do better to assist their academic achievement and career goals. This study takes an in-depth look at international students?? qualitative responses about ways that institutions could better support their preparation for future careers. Using theories of cultural wealth and ecological systems to understand the unique experiences of international students during the pandemic offers an opportunity to help students not just in times of crisis but more holistically as they continue to pursue their higher education experiences in the United States. Ultimately, the authors provide recommendations for higher education professionals working with international students to better support their students?? career development and overall college experience.
Full version
Delivering on the Promise of High-Impact Practices: Research and Models for Achieving Equity, Fidelity, Impact, and Scale
Zilvinskis, J., Kinzie, J., Daday, J., O??Donnell, K & Vande Zande C.
Stylus, 2022.
Research shows that enriching learning experiences such as learning communities, service-learning, undergraduate research, internships, and senior culminating experiences ?? collectively known as High-Impact Practices (HIPs) ?? are positively associated with student engagement; deep, and integrated learning; and personal and educational gains for all students ?? particularly for historically underserved students, including first-generation students and racially minoritized populations. Delivering on the Promise of High-Impact Practices is to provide examples from around the country of the ways educators are advancing equity, promoting fidelity, achieving scale, and strengthening assessment of their own local high-impact practices. Its chapters bring together the best current scholarship, methodologies, and evidence-based practices within the HIPs field, illustrating new approaches to faculty professional development, culture and coalition building, research and assessment, and continuous improvement that help institutions understand and extend practices with a demonstrated high impact.
Full version
Exploring the Influence of Course-Based Career Experiences and Faculty on Students?? Career Preparation
Kinzie, J. & Akuyz, F.
NACE JournalNACE Journal, 83(4), 23-31, 2022.
The effective preparation of college students for careers is an important college outcome. Yet, employers and the public increasingly feel that universities are not doing enough to prepare students for the workforce. This article features NSSE data to focus on courses, exploring the extent to which students are exposed to course-based career experiences using new evidence of college students?? career and workforce preparation. We explore facets of course-based career experiences, along with students?? perceptions of their career preparation outcomes, and the influence of interactions with faculty and advisers on their career plans.
Full version
Centering Black women faculty: Magnifying powerful voices
Priddie, C., Palmer, D., Silberstein, S., & BrckaLorenz, A.
To Improve the Academy, 41(2), 96-127, 2022.
While much of the quantitative research on Black women faculty has taken a comparative approach to understanding their experiences, this study provides a counternarrative, centering their experiences as faculty. This large-scale, multi-institution glance at Black women faculty helps to give us an overview of these women across the country, looking at who they are, where they are, how they spend their time, and what they value in undergraduate education. This study allows us to strengthen various arguments made in qualitative studies of Black women faculty and amplify their perspectives and experiences. Furthermore, it reaffirms and reinvigorates the need for educational developers to practice intentional assessment of Black women faculty??s teaching, support the current teaching efforts of Black women faculty on their campus, and advocate for policy change centering the work of Black women faculty.
Full version
Delivering on the Promise of High-Impact Practices: A New Resource for Assessment
Zilvinskis, J., Kinzie, J., Daday, J., O??Donnell, K & Vande Zande C.
Assessment Update, 34(4), 1-2, 16, 2022.
Is a HIP Always a HIP? The Case of Learning Communities
Fosnacht, Kevin; Graham, Polly
Journal of Student Affairs Research and PracticeJournal of Student Affairs Research and Practice, , , 2021.
With the increasing adoption of learning communities, it is imperative to document their effectiveness. Using a large, longitudinal, multi-institutional dataset, we found that linked-learning communities positively impact students?? engagement and perceived gains. We also found that the estimated effect of learning communities varies widely across institutions on various measures. Some learning communities are very beneficial, while others have a negligible impact on students.
Full version
Elevating Student Voice in Assessment: Approaches to Using NSSE's Student Comments
Kinzie, Jillian; Silberstein, Samantha; Palmer, Dajanae
Assessment Update, 33(2), , 2021.
Full version
Linking Faculty Involvement in High-Impact Practices to First-Year Student Participation
Fassett, Kyle T. and BrckaLorenz, Allison
National Resource Center Research Brief, 2021(2), 1-4, 2021.
Tasked with developing, encouraging, and participating in highly impactful educational experiences, faculty serve in roles vital to first-year student success. Known for benefiting many students, high-impact practices assist institutions in promoting a variety of outcomes ranging from retention to civic engagement. Using data from the National Survey of Student Engagement (NSSE) and the Faculty Survey of Student Engagement (FSSE), we investigated the relationship between faculty emphasis and participation in high-impact practices with first-year student participation at over 80 diverse four year institutions. We found that faculty values for participation are positively related to student participation, but faculty involvement in more high-impact practices could decrease student participation. Administrators should consider ways to support their faculty in providing these experiences and to assess potential barriers for providing equitable quality high impact practices.
Full version
An Examination of Inclusivity and Support for Diversity in STEM Fields
BrckaLorenz, Allison; Haeger, Heather; Priddie, Christen
Journal for STEM Education Research, , , 2021.
The lack of diversity in STEM professions is an ongoing concern for the US both in terms of social justice and in having a globally competitive workforce. This study provides information for campus leaders to be proactive in considering a wide array of identities to meet the needs of students beyond attending to structural forms of diversity. Data from a large-scale, multi-institution study of students?? perceptions of inclusive coursework and institutional commitment to diversity in STEM fields furthers what we know about diversity in these majors. Results encourage campus leaders to additionally consider sexual orientation and disability status in conversations about diversity and to think about how culturally engaging and inclusive courses go beyond the content of the course.
Full version
Assessing intersectional experiences: Where to begin?
BrckaLorenz, A., & Kirnbauer, T.
Assessment in Practice, , , 2021.
Full version
Campus climate (college & university)
BrckaLorenz, A.
In K. K. Strunk & S. A. Shelton Encyclopedia of Queer Studies in Education Brill, 2021.
Expectations for and quality experiences in undergraduate research over time: Perspectives of students and faculty
Kinzie, J. & BrckaLorenz, A.
Journal of the Scholarship of Teaching and Learning Special Issue on Undergraduate Research, 21(1), 35-56, 2021.
Attention to undergraduate research (UGR) is not surprising given its widespread appeal and evidence of educational benefit. Tracking participation and identifying equity gaps in UGR are important markers of access to and equity in educationally beneficial experiences. Information about students?? exposure to elements of quality in UGR and how this corresponds to faculty perspectives and instructional practice can help inform efforts to advance and improve UGR. In this article, we use 7 years of data from the National Survey of Student Engagement (NSSE) to explore the national landscape of UGR by examining the responses of 972,088 1st-year students who reported that they planned to participate in UGR before they graduated and the responses of 1,248,854 senior students who reported that they had done or were currently involved in a UGR experience. To complement our student perspectives, we present perspectives on faculty importance of and instructional practice in UGR with data from NSSE??s companion survey, the Faculty Survey of Student Engagement, by examining the experiences of 106,000 faculty respondents. Our presentation of descriptive statistics provides a national overview of UGR participation by a variety of salient institutional and student characteristics, a broad summary of faculty involvement in UGR, and baseline data about students?? exposure to elements of high-impact UGR.
Full version
Honors college faculty support for high-impact practice participation
Miller, A., Silberstein, S., & BrckaLorenz, A.
Journal for the Education of the Gifted, 44(3), , 2021.
Much of the existing research on honors colleges or programs is focused on the student experience, with less information offered concerning the faculty perspective. This study presents findings from the Faculty Survey of Student Engagement (FSSE), comparing support for high-impact practices between faculty who teach honors courses and those who do not. Along with core FSSE items, this study uses responses from 1,487 faculty members at 15 institutions on two experimental items about teaching honors courses. A series of ordinary least squares and binary logistic regression analyses suggest that faculty who teach honors courses are more likely to supervise undergraduates on research and internships and to think that it is important for students to participate in learning communities, study abroad, and research with faculty. These findings are interpreted within the context of previous research and current theory, bridging knowledge from the fields of higher education and gifted education.
Full version
Teaching honors courses: Perceptions of engagement from the faculty perspective.
Miller, A., Silberstein, S., & BrckaLorenz, A.
Journal of Advanced Academics, 32(1), 3-27, 2021.
Research suggests that honors students are more likely to be engaged in some, but not all, aspects of the college experience, although there is less information available from the faculty perspective. This study presents findings from the Faculty Survey of Student Engagement (FSSE), comparing various engagement-related practices between faculty who teach honors courses and those who do not. Along with core FSSE items, this study uses responses from 1,487 faculty members at 15 institutions on two items about teaching honors courses. A series of ordinary least squares regression analyses suggest that faculty who teach honors courses are more likely to encourage engagement in the areas of student??faculty interaction, learning strategies, and collaborative learning, even after controlling for other demographic and institutional variables. These findings are considered within the context of existing research and theory, connecting knowledge from higher education and gifted education.
Full version
The COVID Pivot and Quality of the Undergraduate Experience: NSSE Pulse Project Report
National Survey of Student Engagement, , 2021.
The coronavirus upended all aspects of education. The 2020?21 academic year required rapid adaptation to unprecedented and unpredictable circumstances. Amidst these circumstances, it was especially important to understand students' experiences and support educators working to implement effective educational practices. In response to these challenges, NSSE offered a special fall 2020 survey at no charge (NSSE 2021 registration not required). The short online survey—NSSE Pulse—included selected questions from NSSE critical to persistence to help colleges and universities take the pulse of the undergraduate student experience and use results to diagnose shortcomings and strengths and to inform campus action.
Approximately 1.2 million bachelor's degree–seeking students attend the colleges and universities that participated in NSSE Pulse. These institutions reflect the diversity of U.S. bachelor's–granting colleges and universities with respect to institution type, public or private control, size, region, and locale. Eight headline findings are discussed in the NSSE Pulse Report, along with implications and recommendations for colleges and universities.
Full version
An Overlooked Factor? How Religion and Spirituality Influence Students' Perception of the Campus Environment
Fosnacht, K. & Broderick, C.
Journal of College and CharacterJournal of College and Character, 21(3), 186-203, 2020.
Postsecondary institutions are frequently forced to respond to discriminatory acts, including those against religious minorities. Such actions can create the perception of a hostile campus for students, which impinges on their learning and development. Research on the campus environment has traditionally focused on race and sex but has largely neglected other important aspects of students? identities like religion and spirituality. This study investigates how the religious/spiritual aspects of the campus environment influenced students? perceptions of the overall campus environment using data from a multi-institutional sample of first-year and senior undergraduates. The multivariate results show that the religious/spiritual dimensions of the campus environment account for a significant proportion of the variance in students? campus environmental perceptions.
Full version
How to reorient assessment and accreditation in the time of COVID-19 disruption
Kinzie, J.
Assessment Update, 32(4), 4-5, 2020.
Among the many issues facing higher education during COVID-19 is uncertainty about the status of student learning outcomes assessment and accreditation. Will necessary shifts in course assignments and assessments affect completion, particularly for those scheduled to graduate this year? Will a suspension (or slowdown) of program-level assessment put the institution out of compliance with state regulations or accreditation requirements? If accreditation visits are postponed, will the institution find its federal funding in jeopardy? All of these concerns are understandable, and it is good to have them aired and discussed. However, the disruptions caused by COVID-19 may also provide an occasion for some useful rethinking of assessment. What those disruptions underscore is that decisions about assessment and accreditation must, above all, be sensitive to current realities and do what is best for students and faculty. Rather than aiming for compliance, or sticking with the plan to ?just give students the exam and asterisk the results,? now is the time to prioritize what people need and embrace compassion-driven assessment, and reassess the fundamental goals of assessment. To help think about the issues at hand, I offer some practical suggestions for course- and program-level assessment and accreditation demands. Then I suggest we take advantage of this moment to make some meaningful improvements to assessment and accreditation.
Full version
Pick and Choose
Gonyea, Robert; Fosnacht, Kevin; Graham, Polly
Talking Stick, 37(5), , 2020.
Getting a roommate is one of the first milestones of a student?s campus experience. Is there a best way to manage this process and support students of color?
Full version
Information Literacy's Influence on Undergraduates' Learning and Development: Results from a Large Multi-institutional Study
Fosnacht, Kevin
College & Research Libraries, 81(2), 272-287, 2020.
This paper investigated the reliability and validity of the National Survey of Student Engagement's Experiences with Information Literacy module, an assessment instrument developed in collaboration with a group of instructional librarians. After identifying three information literacy?related factors in the module, it assessed the relationship between the factors and students' engagement in Higher-Order Learning and Reflective and Integrative Learning activities and students' perceived gains. The results from these analyses indicated that information literacy activities were positively and significantly correlated with student engagement and students' perceived gains.
Full version
NSSE's Quest for Quality: Seven Lessons in Designing a Better Survey
Gonyea, Robert M. and Sarraf, Shimon
Assessment UpdateAssessment Update, 32(2), 6-14, 2020.
In 20 years NSSE has learned much about how to manage a successful survey administration, and how to continuously improve the questionnaire, data collection tools, and reporting. This article includes seven lessons that may help assessment professionals improve their own surveys.
Full version
The National Survey of Student Engagement (NSSE) at Twenty
Ewell, P. and McCormick, A.C.
Assessment UpdateAssessment Update, 32(2), 1-16, 2020.
Full version
Twenty Years of NSSE Data Use: Assessment Lessons for the Collective Good
Kinzie, J. and Franklin, K.
Assessment UpdateAssessment Update, 32(2), 4-15, 2020.
Full version
Expectations for Engagement: What 1st-year Students and Transfers Say
Cole, J. S., & Kinzie, J.
Washington, DC: , 2020.
Understanding entering student expectations is critical to assure that staff can align appropriate institutional resources for each student. This session will include how the Beginning College Survey of Student Engagement (BCSSE) provides comprehensive information about your entering first-year and transfer student?s prior academic experiences, as well as their expectations and beliefs regarding the upcoming academic year. Participants will learn how other institutions use BCSSE for academic advising, retention efforts, faculty and staff development, and other activities. Participants will be encouraged to share their campuses current practices and how BCSSE could facilitate best practices on their campus.
Full version
Examining the Meaning of Vague Quantifiers in Higher Education: How Often is "Often"?
Rocconi, L.M., Dumford, A.D., & Butler, B.
Research in Higher Education, 61, 229-247, 2020.
Researchers, assessment professionals, and faculty in higher education increasingly depend on survey data from students to make pivotal curricular and programmatic decisions. The surveys collecting these data often require students to judge frequency (e.g., how often), quantity (e.g., how much), or intensity (e.g., how strongly). The response options given for these questions are usually vague and include responses such as "never," "sometimes," and "often." However, the meaning that respondents give to these vague responses may vary. This study aims to determine the efficacy of using vague quantifiers in survey research. More specifically, the purpose of this study is to explore the meaning that respondents ascribe to vague response options and whether or not those meanings vary by student characteristics. Results from this study indicate a high degree of correspondence between vague and numeric response and suggest that students seem to adapt the meaning of "sometimes," "often," and "very often" based on the appropriate reference for the question. Overall, findings provide evidence of the utility and appropriateness of using vague response options. Some differences by student characteristics and the implications of these differences are discussed.
Full version
The Relationship of First-Year Residence Hall Roommate Assignment Policy with Interactional Diversity and Perceptions of the Campus Environment
Fosnacht, K., Gonyea, R. M., & Graham, P.
The Journal of Higher Education, , , 2020.
A heterogeneous student body is valued in part because diverse interactions among students help create educated and competent citizens and promote learning and development. Campus housing is a primary setting for diverse interactions as students navigate living with individuals who differ from themselves. This study investigated how the roommate assignment process influences interactional diversity and perceptions of the campus environment for first-year students living on campus, and if these relationships differ by race/ethnicity and national origin. On average, students whose roommates were assigned by the institution (as opposed to choosing their own roommates) did not interact with diverse others more often. At the same time, however, Asian, Black and multiracial students who were assigned roommates by the institution perceived a substantially less welcoming campus environment than their same-race peers who chose their roommates. This difference was not observed for White students.
Full version
Graduate Student Instructors, the Courses They Teach, and the Support They Value
Allison BrckaLorenz, Rong Wang, Thomas F. Nelson Laird
New Directions for Teaching & Learning, 2020(163), 25-34, 2020.
This chapter presents a study exploring the diverse characteristics of Graduate Student Instructors (GSIs) employed at eight research universities in the United States and investigates the ways in which these characteristics impact the value GSIs place on types of professional development and support in teaching.
Full version
Teaching honors courses: Perceptions of engagement from the faculty perspective
Miller, A., Silberstein, S., & BrckaLorenz, A.
Journal of Advanced Academics, , , 2020.
Research suggests that honors students are more likely to be engaged in some, but not all, aspects of the college experience, although there is less information available from the faculty perspective. This study presents findings from the Faculty Survey of Student Engagement (FSSE), comparing various engagement-related practices between faculty who teach honors courses and those who do not. Along with core FSSE items, this study uses responses from 1,487 faculty members at 15 institutions on two items about teaching honors courses. A series of ordinary least squares regression analyses suggest that faculty who teach honors courses are more likely to encourage engagement in the areas of student?faculty interaction, learning strategies, and collaborative learning, even after controlling for other demographic and institutional variables. These findings are considered within the context of existing research and theory, connecting knowledge from higher education and gifted education.
Full version
The relationship between residential learning communities and student engagement
Hurtado, S. S., Gonyea, R. M., Graham, P. A., & Fosnacht, K.
Learning Communities Research and Practice, 8(1), 5, 2020.
Residential learning communities (RLCs) are residence hall environments designed to deliver academic and social benefits. For decades, many have argued RLCs are an effective means for increasing student success. Yet substantial changes in the defining characteristics of campus housing and student diversity have led to new questions about the impact of living on campus and the benefits of RLCs in particular. Consequently, we investigated the continued efficacy of RLCs as an effective educational practice. Using data from a diverse, multi-institution sample of first-year and sophomore students, this study provides insight into the relationships between RLC participation, student engagement, and perceived gains in learning.
Full version
The relationship between residential learning communities and student engagement
Hurtado, S.S., Gonyea, R.M., Graham, P. A., & Fosnacht, K.
Learning Communities Research and PracticeLearning Communities Research and Practice, 8(1), , 2020.
Residential learning communities (RLCs) are residence hall environments designed to deliver academic and social benefits. For decades, many have argued RLCs are an effective means for increasing student success. Yet substantial changes in the defining characteristics of campus housing and student diversity have led to new questions about the impact of living on campus and the benefits of RLCs in particular. Consequently, we investigated the continued efficacy of RLCs as an effective educational practice. Using data from a diverse, multi-institution sample of first-year and sophomore students, this study provides insight into the relationships between RLC participation, student engagement, and perceived gains in learning.
Full version
Reassessing disparities in online learner student engagement in higher education
Paulsen, J., & McCormick, A. C.
Educational Researcher, 49(1 January-February), 20–29, 2020.
Online learning is the fastest growing segment in U.S. higher education and is increasingly adopted in public and private not-for-profit institutions. While the impact of online learning on educational outcomes is becoming more clear, the
literature on its connection with student engagement is sparse. Student engagement measures identify key aspects of the
learning process that can improve learning and outcomes like retention and achievement. The few studies investigating
the link between online learning and student engagement found positive benefits for online learners compared to face-to-face
learners in terms of perceived academic challenge, learning gains, satisfaction, and better study habits. On the other
hand, face-to-face learners reported higher levels of environment support, collaborative learning, and faculty interaction.
However, these studies did not effectively account for the differences in background characteristics like age, time spent
working or caring for dependents, and enrollment status. Further, they did not consider the increasingly large population
of students who enroll in both online and face-to-face courses. In our study, we used propensity score matching on the
2015 National Survey of Student Engagement data to account for the disparities in these groups? demographics variables.
After matching, we found that some of the previous literature?s differences diminish or disappear entirely. This suggests
differences in supportive environments and learning strategies have more to do with online student characteristics than
learning mode. However, online learning still falls well below other modes in terms of collaborative learning and interaction
with faculty.
Supporting LGBQ+ students with disabilities: Exploring the experiences of students living on campus
BrckaLorenz, A., Fassett, K. T., & Hurtado, S. S
The Journal of College and University Student Housing, 46(3), 78–90, 2020.
Students with multiple oppressed identities, such as LGBQ+ students with disabilities, face a multitude of barriers on college campuses due to heterosexism and ableism, sometimes even from those in-group. This large-scale, multi-institution comparative quantitative study of LGBQ+ students with disabilities living on campus examines these students? experiences with belonging and discrimination. Guided by the Model of Multiple Dimensions of Identity, we compare the experiences of students in the intersections of sexual and ability identities to guide housing and residence life practitioners in supporting students with complex identities. A series of chi-square (?2) analyses and adjusted standardized residuals allowed us to explore the experiences of students who identify as LGBQ+ and without a disability, as well as students who identify as straight with or without a disability, in order to highlight the experiences of LGBQ+ students with disabilities. Findings indicate that LGBQ+ students most frequently report a mental health disorder or multiple disabilities or impairments and that these students feel less physically safe, comfortable being themselves, like part of the campus community, and valued by their institution than their peers. Most troubling is the large proportion of LGBQ+ students with a disability who have personally experienced offensive behavior, discrimination, or harassment at their institution based on their sexual orientation. Implications focus on creating partnerships with mental health, disability services, and LGBTQ/Pride Center professionals; evaluating roommate matching policies; the proactive creation of support systems; and applying concepts of Universal Design.
Full version
How valid is grit in the postsecondary context? A construct and concurrent validity analysis
Fosnacht, K., Copridge, K., & Sarraf, S.
Research in Higher Education, 60(6), 803–822, 2019.
College admissions leaders increasingly desire to incorporate non-cognitive factors like grit into admissions decisions. Consequently, we examined the validity of the short grit scale (Grit-S) using data collected on undergraduates attending 38 colleges. Using confirmatory factor analysis (CFA), we found that Grit-S does not possess adequate model fit; however, a modified version of the scale does possess this property. Using multi-group CFA, we also found that Grit-S is relatively invariant across multiple demographic groups. Next, we examined the concurrent validity of grit with students‘ engagement, perceived gains, time spent studying, and grades. These results confirmed previous research that most of the predictive power of grit is contained in its perseverance of effort, not consistency of interest, dimension.
Full version
Behavior-based student typology: A view from student transition from high school to college
Mu, L., & Cole, J.
Research in Higher Education, , , 2019.
Several recent studies have successfully identified college student typologies based on individuals‘ behaviors. One limitation of past studies has been their reliance on one-time cross-sectional assessments. As a result, we are left to ponder the stability of students‘ behavioral types as their academic years move forward. This study used longitudinal student data from high school to college, to investigate the stability of a behavior-based student typology. Guided by findings in behavioral consistency from personality psychology, this study explored the associations of higher education institution‘s structure, and supportive elements of the environment and the transition of students‘ behavior-based types. The results showed that, in high school and higher education settings, students‘ behaviors in a variety of activities classified students into four types. In the higher education setting, about half of the students were of the same behavioral type while the remaining students engaged in changes as compared with their behavior-based types in high school. Students‘ background characteristics and institutional environment demonstrated an association related to these shifts.
Full version
Better Together: How Faculty Development and Assessment Can Join Forces to Improve Student Learning
Kinzie, J., Landy, K., Sorcinelli, M. & Hutchings, P.
Change magazine, 51(5), 46-54, 2019.
Full version
Effective advising: How academic advising influences student learning outcomes in different institutional contexts
Mu, L., & Fosnacht, K.
The Review of Higher Education, 42(4), 1283–1307, 2019.
Using survey data from 156 bachelor‘s-granting institutions, this study explored the relationship between academic advising services and seniors‘ grades and self-perceived gains. We found advising experiences has a positive relationship with students‘ grades and self-perceived gains. In addition, our results indicate that the institutional advising climate is positively correlated with perceived gains, but not grades. The results also showed that the relationships between advising and students‘ learning and development varied across institutions. Implications for policy and practice were discussed.
Full version
How does faculty research motivation type relate to success? A test of self-determination theory
Stupnisky, R., BrckaLorenz, A., & Nelson Laird, T. F.
International Journal of Educational Research, 98, 25-35, 2019.
Studies show institutional, demographic, and social-environmental factors to be incomplete predictors of professor research productivity; meanwhile, the effects of motivation on faculty research are relatively understudied. The current study tested the extent to which self-determined motivation served as a predictor of faculty research success. Analysis of 1,846 U.S. faculty from 19 institutions using structural equation modeling found autonomous motivation (enjoyment, value) positively related to self-reported research productivity and number of publications, beyond demographics and position details. The basic needs of autonomy and competence predicted autonomous motivation, and indirectly predicted achievement. External motivation (rewards) had relatively smaller positive relationships with research productivity, while introjected motivation (guilt) had no relationships. The results contribute to both the faculty development and motivation research literatures.
Full version
Opening the activism and postsecondary education black box: Relating high-impact practices and student identity with activist behaviors
Morgan, D. L., Zilvinskis, J., & Dugan, B.
Journal of Political Science Education, , , 2019.
Faculty and administrators at postsecondary institutions continue to grapple with understanding the dynamic nature of student activism. In response, the National Survey of Student Engagement administered a supplemental item set following the 2016 presidential election, in which more than 3,000 respondents were asked about their involvement in activism. Leveraging these data, this study employed multilevel modeling to measure the relationship between activist behaviors and student backgrounds, high-impact practice (HIP) participation, involvement in student activities, and institutional characteristics. The present study adds nuance to and models the connection among HIPs, student identities (e.g., queer, black or African American), and student activism. Implications for practice and research are shared that outline a renewed understanding of student activism as a pillar of civic learning and democratic engagement work in higher education.
Full version
Predicting the quality of Black women collegians' relationships with faculty at a public historically Black university
Williams, M. S., & Johnson, J. M.
Journal of Diversity in Higher Education, 12(2), 115-125, 2019.
Using data from the National Survey of Student Engagement, multivariate analyses were conducted to examine the impact of effective teaching practices and student?faculty interactions on perceptions of faculty relationship quality for Black women collegians at a public historically Black university. Using a conceptual framework that integrates Tinto‘s (1993) interactionalist theory of college student departure, Astin‘s (1993) student involvement theory, and Weidman‘s (1989) undergraduate socialization model, the final regression model explained 56% of the variance in faculty relationship quality. Significant predictors included faculty feedback, course-related conversations outside of class, and discussions around academic performance. We close with implications for policy, praxis, and future investigations.
Full version
The within-group differences in LGBQ+ college students? belongingness, institutional commitment, and outness
BrckaLorenz, A., Duran, A., Fassett, K. & Palmer, D.
Journal of Diversity in Higher Education, Advance online publication, , 2019.
Although scholars have examined how lesbian, gay, bisexual, and queer (LGBQ +) students perceive their collegiate environments, few quantitative studies disaggregate data to see how populations within the LGBQ + community experience certain outcomes. The purpose of this quantitative study was to investigate how student subgroups within the LGBQ + community differed in their perceptions of belongingness, institutional commitment, and outness. Using large-scale, multi-institution data from thousands of first-year and senior undergraduates, we examined how these important affective outcomes differ by sexuality groups (e.g., gay/lesbian, bisexual, or queer) and when the intersections of sexual and racial/ethnic identities are considered. Findings suggest that within-group differences exist in LGBQ + student populations that are not necessarily visible when understanding these communities in monolithic ways. We then offer implications for research and student affairs practitioners.
Full version
Thwarting the temptation to leave college: An examination of engagement's impact on college sense of belonging among Black and LatinX students
Kitchen, J. A., & Williams, M. S.
Journal for the Study of Postsecondary and Tertiary Education, 4, 67-84, 2019.
Persistence rates among Black and LatinX students continue to fall behind those of their White peers. One way to address this issue is to promote a stronger college sense of belonging. While student involvement has been linked to sense of belonging, postsecondary institutions need to seriously reflect on, and re-commit to, their own role in engaging Black and LatinX students to promote their sense of belonging, a strong correlate of persistence and college completion. A sense of belonging has been linked to college success, including student persistence. One potential way to promote a sense of belonging among Black and LatinX students is through student engagement. This paper examines the relationship between student engagement and college sense of belonging among a national sample of 10,475 Black and LatinX students. Guided by student engagement theory, we parse out the role of student involvement and institutional engagement to examine the unique and net impact of each facet of engagement as it relates to college sense of belonging among Black and LatinX students. This study employs hierarchical linear regression modeling to examine the unique and net impact of two facts of student engagement: a) student involvement, and b)institutional engagement, as each relates to college sense of belonging among a national sample of 10, 475 Black and LatinX students.
Full version
Time well spent: Flipped classrooms and effective teaching practices.
Fassett, K., BrckaLorenz, A., Strickland, J., & Ribera, A.
In E. Alqurashi Fostering Student Engagement with Instructional Technology in Higher Education ICI Global, 2019.
Good teaching practices are the crux of student education and require constant evaluation to meet current generations' learning needs. Flipped classrooms have sought a foothold in higher education to provide opportunities for deep learning through the delivery of content online prior to attending class while having activities related to processing and applying the information during class. Using a large-scale, multi-institution study of faculty teaching flipped courses, this study empirically links flipped procedures to other forms of effective educational practice and additionally focuses on the motivations and impacts on the faculty side of this pedagogical practice. Findings indicate numerous learning and development benefits for students with implications for supporting and motivating faculty across disciplines, faculty identities, and course types.
Full version
Do working students buy into HIPs? Working for pay and participation in high-impact practices
Zilvinskis, J., & McCormick, A. C.
Journal of College Student Development, 60(5 September-October), 543–562, 2019.
High-impact practices (HIPs), a set of distinctive educational experiences associated with a range of educational benefits, have garnered the attention of educators, policy makers, and researchers alike. Concerns exist regarding who has access to HIPs, and one possible impediment is paid employment. We investigated the relationship between student employment and participation in two HIPs: service-learning and undergraduate research. Using data from 207,925 respondents to the 2015 and 2016 administrations of the National Survey of Student Engagement, we examined patterns of HIPs participation when considering the differing circumstances of part-time and full-time senior undergraduates with regard to paid employment on campus, off campus, and both. The findings can guide institutional practice, such as the design of campus employment opportunities as well as academic advising to promote HIPs participation.
Engagement insights: Survey findings on the quality of undergraduate education--Annual results 2018
National Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2018.
This year‘s Annual Results examines how colleges and universities are preparing students for work and careers. Our analyses investigated the importance of educational context?with special attention to major?in shaping students‘ development of workplace-relevant skills such
as working with others and solving real-world problems, as well as basic skills valued by employers such as critical thinking and effective
writing and speaking. We also asked a subset of respondents a set of targeted questions about their career goals and their use of career
planning resources and related activities. Finally, we used results from NSSE‘s Topical Module on First-Year Experiences and Senior Transitions to study seniors planning to take less-traveled paths after college.
Full version
The benefits of living on campus: Do residence halls provide distinctive environments of engagement?
Graham, P. A., Hurtado, S. S., & Gonyea, R. M.
Journal of Student Affairs Research and Practice, 55(3), 255–269, 2018.
The changing landscape of on- and off-campus undergraduate residential options underline the need to reexamine the impact of on-campus living. Using multi-institutional survey data from first-year students, this study investigates the relationship of residential status with engagement and perceived gains in learning and development. Results indicate, after controlling for student and institution characteristics, that on-campus residence has small positive effects on some outcomes but not on others where effects might be expected.
Full version
Engaging in the margins: Exploring differences in biracial students' engagement by racial heritage
Harris, J. C., BrckaLorenz, A., & Nelson Laird, T. F.
Journal of Student Affairs Research and Practice, 55(2), 137–154, 2018.
The research presented in this article utilizes data from four years of the National Survey of Student Engagement to shed light on the biracial student population and their engagement practices in postsecondary contexts. Specifically, this study explored the ways in which biracial students with different racial heritages engage differently from one another and from their monoracial peers on campus. Study findings complicate the ideology that biracial individuals are a monolithic group, fostering a conversation concerning multiraciality in higher education and providing critical implications for future research and practice.
Full version
Faculty members' motivation for teaching and best practices: Testing a model based on self-determination theory across institution types
Stupnisky, R., BrckaLorenz, A., Yuhas, B., & Guay, F.
Contemporary Educational Psychology, 58, 15-26, 2018.
This study tested a conceptual model based on self-determination theory to examine how university faculty members‘ motivation for teaching predicts their utilization of teaching best practices, and explored if faculty at various higher education institution types are differentially motivated for teaching. Data from a national online survey of 1,671 faculty from 19 universities was analyzed using structural equation modeling. Support for the overall model showed faculty autonomy, competence, and relatedness positively predicted autonomous motivation (intrinsic, identified), but not controlled motivation (introjected, external). Autonomous motivation, in turn, predicted greater incorporation of effective teaching strategies, namely instructional clarity, higher-order learning, reflective and integrative learning, and collaborative learning. There were no differences found across faculty at doctoral, master‘s, and bachelor‘s institutions in terms of autonomous motivation mean levels, nor for the predictive effects of autonomous motivation on teaching best practices. The findings have implications for the faculty motivation and teaching research literatures, as well as for faculty development initiatives aimed at improving teaching effectiveness.
Full version
The role of religion and institution type in seniors' perceptions of the religious and spiritual campus climate
Fosnacht, K., & Broderick, C.
Journal of College and Character, 19(1), 18-31, 2018.
This study investigated the correlates of two measures that capture students‘ perception of the religious and spiritual campus climate. It focuses on how the factors, religious identity and attending a religiously affiliated institution, influence students‘ perception of the respect for their beliefs and comfort in expressing their views on campus. The results indicate few differences by religious identity in students‘ perception of the respect for their beliefs, but significant differences by religion in their comfort in expressing their views. Additionally, attending a religiously affiliated institution was positively associated with students‘ comfort in expressing their beliefs.
Full version
A meta-analysis of queer-spectrum and trans-spectrum student experiences at U.S. research universities
Greathouse, M., BrckaLorenz, A., Hoban, M., Huesman, R., Rankin, S., & Stolzenberg, E.
In Krista M. Soria Evaluating Campus Climate at U.S. Research Universities: Opportunities for Diversity and Inclusion Palgrave MacMillan, 2018.
Queer-spectrum and trans-spectrum students remain a significantly underserved population within higher education, despite the presence of significant disparities related to campus climate, academic engagement, and health outcomes. In this chapter, the authors explore the climate for queer-spectrum and trans-spectrum undergraduate students attending US Public Research Universities within higher education through a meta-analysis of 2016 and 2017 national datasets assessing campus climate, academic outcomes, and health outcomes?each of which has incorporated sexual identity and gender identity demographics within their respective survey instruments.
Full version
Activists, non-activists, and allies: Civic engagement and student types at MSIs
Fassett, K. T., Priddie, C., BrckaLorenz, A., & Kinzie, J.
Frontiers in Education, 3(103), , 2018.
Although civic engagement has been examined across various student groups, there is limited research on the impact of civic engagement at minority-serving institutions (MSIs). This study uses a large-scale, cross-sectional approach to analyze college students' participation in civic engagement activities at 24 MSIs from 2013 to 2017 using data from the National Survey of Student Engagement (NSSE). Aspects of civic engagement examined include students' participation in events that address social or political issues, frequency of interactions with diverse others, participation in leadership and service-learning activities, and perceptions of their institution's contribution to their growth in areas such as becoming an informed and active citizen. Additionally, researchers explored students' ability to resolve conflicts that involve bias and prejudice and contribute to the well-being of their community; how frequently students inform themselves of state, national, or global issues; and how they may organize others around a common cause.
Full version
Contextualizing effect sizes in the National Survey of Student Engagement: An empirical analysis
Rocconi, L. M., & Gonyea, R. M.
Research and Practice in Assessment, 13(Summer/Fall), 22-38, 2018.
The concept of effect size plays a crucial role in assessment, institutional research, and scholarly inquiry, where it is common with large sample sizes to find small relationships that are statistically significant. This study examines the distribution of effect sizes from institutions that participated in the National Survey of Student Engagement (NSSE) and empirically derives recommendations for their interpretation. The aim is to provide guidelines for researchers, policymakers, and assessment professionals to judge the importance of an effect from student engagement results. The authors argue for the adoption of the recommendations for interpreting effect sizes from statistical comparisons of NSSE data.
Full version
Do high achieving students benefit from honors college participation? A look at student engagement for first-year students and seniors
Miller, A. L., & Dumford, A. D.
Journal for the Education of the Gifted, 41(3), 217–241, 2018.
This study investigates findings from the National Survey of Student Engagement (NSSE), comparing various aspects of student engagement between honors college and general education students. Responses from 1,339 honors college students and 7,191 general education students across 15 different universities suggest a positive impact for honors college participation on reflective and integrative learning, use of learning strategies, collaborative learning, diverse discussions, student-faculty interaction, and quality of interactions for first-year students, even when controlling for student and institutional characteristics. For senior students, honors college participation was related to more frequent student-faculty interaction. Potential experiential and curricular reasons for these differences are discussed, along with implications for educators, researchers, parents, and students.
First-year students' time use in college: A latent profile analysis
Fosnacht, K., McCormick, A. C., & Lerma, R.
Research in Higher Education, 59(7), 958–978, 2018.
Students‘ time expenditures influence their learning and development. This study used latent profile analysis to identify a taxonomy of how first-year students spend their time using a large multi-institution sample. We identified four time usage patterns by first-year students titled Balanced, Involved, Partiers, and Parents. Sex, expected major field, on-campus residency, age, Greek-life membership, and standardized test scores were predictive of students‘ time use patterns. Holding a range of student and institutional factors constant, members of the involved group, on average, reported higher levels of engagement than the Balanced group, while Partiers reported lower levels of engagement. Implications for policy and practice are discussed.
Full version
Focus on the finish line: Does high-impact practice participation influence career plans and early job attainment?
Miller, A. L., Rocconi, L. M., & Dumford, A. D.
Higher Education: The International Journal of Higher Education Research, 75(3), 489–506, 2018.
High-impact practices (HIPs) are important co-curricular educational experiences in postsecondary education, as they promote learning, development, and persistence among students. The goal of this study was to extend the research on HIPs to explore potential connections with HIP participation and career outcomes. Using data from the National Survey of Student Engagement, this study explores whether HIP participation influences college seniors‘ post-graduation plans for career and further education, and whether HIP participation has a positive impact on early job attainment for these students. Results suggest that even after controlling for a variety of demographic and institutional factors, HIP participation is a statistically significant predictor of future career plans and early job attainment. HIP participation can give students a career-related advantage through transferable skill development, engaging in learning opportunities, and generating ?stories? for potential employers.
High-impact practices and student-faculty interactions across sexual orientations
Garvey, J. C., BrckaLorenz, A., Latopolski, K., & Hurtado, S. S.
Journal of College Student Development, 59(2), 211-226, 2018.
The purpose of this study was to investigate the relationship between high-impact practices and student?faculty interactions for lesbian, gay, bisexual, and questioning (LGBQ) students. Results yield few differences in participation of high-impact practices for LGBQ students compared to heterosexual students. Results also demonstrate the significant influences of student and institutional characteristics on high-impact practice participation for LGBQ students, and in particular student?faculty interactions.
Full version
International student engagement: An exploration of student and faculty perceptions
Wang, R. & BrckaLorenz, A.
Journal of International Students, 8(2), 1002-1033, 2018.
An increasing number of faculty have brought up questions and concerns about supporting international students? academic engagement and success. However, little is known about faculty?s approaches to international student engagement and how they may differ from international students? self-reported engagement at four-year institutions. Using data from the National Survey of Student Engagement and Faculty Survey of Student Engagement, both large-scale and multi-institutional datasets, this study explores international student engagement in learning strategies, collaborative learning, and student-faculty interaction as well as international student engagement from the perspectives of faculty and students. Recommendations on supporting international student engagement from an individual faculty level, department level, and institutional level are discussed.
Full version
Looking across high-impact practices: First-year student democratic awareness and democratic participation
Weiss, H. A., & Fosnacht, K.
Journal of the First-Year Experience and Students in Transition, 30(2), 45–64, 2018.
Creating educated and informed citizens for our diverse democracy has long been one of the objectives of the U.S. educational system. Traditionally, service-learning has been the primary tool for colleges and universities to promote civic outcomes; however, other practices, particularly those requiring substantial student investments of time and energy, also hold the potential to improve civic outcomes. Using data from nearly 13,000 first-year students who responded to the National Survey of Student Engagement's Civic Engagement module, we found that service-learning, learning communities, and research with faculty were positively and significantly correlated to two measures of democratic engagement. The results have important implications for how postsecondary institutions promote civic outcomes.
Full version
Queer-spectrum and trans-spectrum student experiences in American higher education: The analysis of national survey findings
Greathouse, M., BrckaLorenz, A., Hoban, M., Huesman, R., Rankin, S., & Stolzenberg, E.
New Brunswick, NJ: , 2018.
Full version
Reimagining student engagement: How nontraditional adult learners engage in traditional postsecondary environments
Rabourn, K., BrckaLorenz, A., & Shoup, R.
Journal of Continuing Higher Education, 66(1), 22-33, 2018.
Adult learners are a growing population in U.S. postsecondary education who experience distinct barriers to academic success. However, higher education institutions continue to create and adhere to policies that favor traditional college students. Thus, adult learner experiences must be better understood to ensure this population is supported. This study used data from the 2013 and 2014 administrations of the National Survey of Student Engagement to identify characteristics of adult learners and compare their engagement with traditional-aged students. Our regression analysis revealed that adult learners were more likely to take their classes online, begin their education at another institution, and enroll part-time. Adult learners also were more engaged academically and had positive perceptions of teaching practices and interactions with others, despite reporting fewer interactions with faculty and peers and less supportive campuses. These findings challenge institutions to continue to seek a deeper understanding of how adult learners engage with postsecondary education.
Full version
The dependability of the updated NSSE: A generalizability study
Fosnacht, K., & Gonyea, R. M.
Research and Practice in Assessment, 13(Summer/Fall), 62–74, 2018.
This study utilized generalizability theory to assess the context where the National Survey of Student Engagement‘s (NSSE) summary measures, the Engagement Indicators, produce dependable group-level means. The dependability of NSSE group means is an important topic for the higher education assessment community given its wide utilization and usage in institutional assessment and accreditation. We found that the Engagement Indicators produced dependable group means for an institution derived from samples as small as 25 to 50 students. Furthermore, we discuss how the assessment community should use NSSE data.
Full version
The role of creative coursework in skill development for university seniors
Miller, A. L.
Global Education Review, 5(Creativity & Education Special Issue 1), 88–107, 2018.
Previous research suggests that creativity training can be effective in academic settings and that teachers in particular can have an impact on creativity. Furthermore, creativity is one of many transferable skills in higher education that will benefit students when they enter the workforce. This study extends research on creativity training and transferable skills in higher education, using data from the Senior Transitions topical module of the National Survey of Student Engagement (NSSE). Responses from over 48,000 seniors at 227 different U.S colleges and universities were used to explore curricular differences across disciplinary fields as well as how exposure to creative coursework can predict confidence in numerous skills and abilities. Exploratory and confirmatory factor analysis provided support for a measure of exposure to creative coursework, and an ANOVA suggested significant differences by major fields, with arts majors showing a distinct advantage. Results from ordinary least squares regression models found that even after controlling for several demographic and institutional characteristics, creative coursework is a significant positive predictor of confidence in several different skills and abilities that are important for adapting to traditional and non-traditional work settings, including creative thinking, critical thinking, entrepreneurial skills, and networking abilities. Potential reasons for these patterns of results are discussed. These findings can help to inform curricular and programming enhancements for college students across all major fields, helping to better prepare them for their futures in various workplace settings.
Full version
With retention, the key is "act locally"
Cole, J. S., Gonyea, R. G., & Rocconi, L.
In R. Feldman (Ed.) The first year of college: Research, theory, and practice on improving the student experience and increasing retention Cambridge, UK: Cambridge University Press, 2018.
The authors build on retention theory to show how data from the National Survey of Student Engagement (NSSE) and the Beginning College Survey of Student Engagement (BCSSE) can be used to understand and potentially affect retention. Emphasizing the fact that solutions must be local and taking into account the unique characteristics of an institution, they highlight the ways in which retention outcomes can be improved by considering multiple variables that impact performance.
Full version
Refining an Approach to Assessment for Learning Improvement
Stitt-Bergh, M., Kinzie, J., & Fulcher, K.
Research and Practice in Assessment, , , 2018.
Full version
Promoting democratic engagement during college: Looking beyond service-learning
Howe, E. C., & Fosnacht, K.
Journal of College and Character, 18(3), , 2017.
Preparing students to be engaged participants in our democratic society has long been an important college outcome. Over the past few decades, postsecondary institutions have primarily attempted to improve civic outcomes by integrating service activities into their curricula. While research on the effects of service-learning are plentiful, research on how other educationally beneficial activities influence democratic outcomes is scarce. In this study, we find that service-learning may not be the only means for promoting democratic outcomes because other high impact practices, most prominently learning communities, have greater or equivalent relationship to two dimensions of democratic engagement.
Full version
Black, White, and biracial students’ engagement at differing institutional types
Harris, J. C., & BrckaLorenz, A.
Journal of College Student Development, 58(5), 783-789, 2017.
The purpose of this research is to fill a large gap in the literature on college student engagement by exploring differences in engagement for White students, Black students, and Black/White biracial students within and between institutional types. To achieve this purpose, this study explores how engagement compares for Black, White, and biracial students with Black and White heritage within HBCUs and non-HBCUs and how engagement compares for these same biracial students between HBCUs and non-HBCUs.
Full version
Undergraduate financial stress, financial self-efficacy, and major choice: A multi-institutional study
Fosnacht, K., & Calderone, S. M.
Journal of Financial Therapy, 8(1), Article 7, 2017.
Over time, undergraduates students been increasingly forced to assume a greater portion of college costs. For most students, this means borrowing larger sums and cutting back on expenses to fulfill their college dreams, which often leads to financial stress. Using financial self-efficacy theory, we sought to better understand how a lack of financial confidence and a diminished sense of financial well-being may serve to undermine students‘ intended short and long-term goals. To this end, we examined the predictors of financial stress based upon a multi-institutional sample of senior undergraduates and focus on the role of the earnings potential of different majors.
Full version
Information literacy's influence on undergraduates' learning and development: Results from a large multi-institutional study
Fosnacht, K.
In D. M. Mueller, (Ed.) At the helm: Leading transformation: The proceedings of the ACRL 2017 conference, March 22?25, 2017, Baltimore, Maryland Chicago, IL: Chicago, IL: Association of College and Research Libraries, 2017.
This paper investigated the reliability and validity of the National Survey of Student Engagement‘s Experiences with Information Literacy Topical Module, an assessment instrument developed in collaboration with a group of instructional librarians. After identifying three information literacy related constructs in the module, it assessed the relationship between the constructs and students‘ engagement in Higher-Order Learning and Reflective and Integrative Learning activities and students' perceived gains. The results from these analyses indicated that information literacy activities are positively and significantly correlated with student engagement and students‘ perceived gains.
Full version
A glimpse of global learning: Assessing student experiences and institutional commitments
Kinzie, J., Helms, R. M., & Cole, J.
Liberal Education, 103(2), , 2017.
What do we know about the extent to which institutions are designing international activities, providing students with direct experience of different cultures and courses on global topics, and ensuring that graduates acquire global learning outcomes? To provide this information, the American Council on Education (ACE) and the Center for Postsecondary Research at the Indiana University School of Education collaborated on a study that takes advantage of national surveys administered by each organization. In this article, we discuss preliminary findings from a study of combined results from the 2016 administration of the ACE Mapping Internationalization on U.S. Campuses survey and the National Survey of Student Engagement (NSSE) Global Learning Topical Module.
Full version
Concluding comments about student transition to higher education
Cole, J. S.
Higher Education: The International Journal of Higher Education Research, 73, 539–551, 2017.
This special issue of Transition to Higher Education contained studies from nine countries across the globe. The following provides a brief review of all nine studies, identifying common themes. These common themes include the importance of student expectations regarding their first-year experiences, as well as the importance of student academic and social integration. Another common theme was first-year stagnation, where some students experience little to no growth regarding motivation or deep approaches to learning. This section concludes by stressing the need for campuses to utilize their local data to better understand the factors that facilitate or undermine successful student transition on their campus.
Exceeding statements: How students and faculty experience institutional missions
Graham, P. A., Ribera, A., BrckaLorenz, A., & Broderick, C.
Journal of College and Character, 18(4), 246-263, 2017.
While the importance of institutional mission is acknowledged within the higher education community, there is a lack of empirical evidence investigating how missions are experienced. Using survey data from students and faculty, this study investigates perceptions of mission engagement at religiously affiliated and independent institutions. Implications for practice are discussed.
Full version
Frequency of first-year student interactions with advisors
Fosnacht, K., McCormick, A. C., Nailos, J. N., & Ribera, A. K.
NACADA Journal, 37(1), 74-86, 2017.
Although acknowledged that academic advising helps students adjust to and deal with the challenges of college, little is known about students' frequency of interactions with advisors. Using data from 52,546 full-time, first-year students at 209 diverse institutions, we examined the frequency with which students met with academic advisors and the way these interactions vary by student and institutional characteristics. We found that the typical first-year student met with an advisor 1 to 3 times during his or her first college year; however, the number of meetings varied across student subpopulations and institutional types.
Full version
High-impact practices and student-faculty interactions for gender-variant students
BrckaLorenz, A., Garvey, J. C., Hurtado, S. S., & Latopolski, K.
Journal of Diversity in Higher Education, , Advance online publication, 2017.
The vast amount of research on student success and engagement in college focuses on a narrative for majority student populations that does not account for unique experiences across social identities. This article examines the experiences of gender-variant students (i.e., students who do not identify as either cisgender men or women) regarding engagement in high-impact practices and student?faculty interactions using a large-scale, multi-institution quantitative data set collected from the 2014 administration of the National Survey of Student Engagement. Although high-impact practice participation was similar for gender-variant and cisgender students, positive student-faculty interaction was found to be a significant predictor for increased high-impact practice participation for gender-variant students. Results from this study may also point to chillier climates of certain major fields for gender-variant students. Implications for these findings focus on investigating major choice as a mediating factor for high-impact practice participation and advocating for the inclusion of different gender identities in surveys, institutional data, and higher-education research.
Full version
How important are high response rates for college surveys?
Fosnacht, K., Sarraf, S., Howe, E., & Peck, L. K.
The Review of Higher Education, 40(2), 245–265, 2017.
Surveys play an important role in understanding the higher education landscape. However, declining survey participation rates threaten this source of vital information and its perceived utility. Although survey researchers have long assumed that the best way to obtain unbiased estimates is to achieve a high response rate, many survey researchers have begun to question the widely held assumption that low response rates provide biased results. Due to the prevalence of survey data in higher education research and assessment efforts, it is imperative to better understand the relationship between response rates and data quality. This study investigates this assumption with college student assessment data. It utilizes data from hundreds of samples of first-year and senior students with relatively high response rates using a common assessment instrument with a standardized administration protocol. It investigates how population estimates would have changed if researchers put forth less effort when collecting data and achieved lower response rates and respondent counts.
Full version
How writing contributes to learning: New findings from a national study and their local application
Anderson, P., Anson, C. M., Fish, T., Gonyea, R. M., Marshall, M., Menefee-Libey, W., Paine, C., Palucki Blake, L., & Weaver, S.
Peer Review, 19(Winter, 1), , 2017.
This article summarizes findings from NSSE Consortium for the Study of Writing in College by which three writing constructs were derived ? Interactive Writing Processes, Meaning-Making Writing Tasks, and Clear Writing Expectations. Authors describe how to use the constructs to create better writing assignments, and provide examples from three institutions in their application.
Full version
Indirect assessments in higher education
Nelson Laird, T. F. & BrckaLorenz, A.
In T. Cumming & M. D. Miller Enhancing Assessment in Higher Education: Putting Psychometrics to Work Stylus Publishing, LLC, 2017.
Assessment and accountability are now inescapable features of the landscape of higher education, and ensuring that these assessments are psychometrically sound has become a high priority for accrediting agencies and therefore also for higher education institutions. Bringing together the higher education assessment literature with the psychometric literature, this book focuses on how to practice sound assessment.
This volume provides comprehensive and detailed descriptions of tools for and approaches to assessing student learning outcomes in higher education. The book is guided by the core purpose of assessment, which is to enable faculty, administrators, and student affairs professionals with the information they need to increase student learning by making changes in policies, curricula, and other programs.
The book is divided into three sections: overview, assessment in higher education, and case studies. The central section looks at direct and indirect measures of student learning, and how to assure the validity, reliability, and fairness of both types. The first six chapters (the first two sections) alternate chapters written by experts in assessment in higher education and experts in psychometrics. The remaining three chapters are applications of assessment practices in three higher education institutions. Finally, the book includes a glossary of key terms in the field.
Full version
Sense of peer belonging and institutional acceptance in the first year: The role of high-impact practices
Ribera, A. K., Miller, A. L., & Dumford, A. D.
Journal of College Student Development, 58(4), 545–563, 2017.
This study examines the role that high-impact practices play in shaping first-year students‘ sense of belonging as it relates to peers and institutional acceptance. Using data from the National Survey of Student Engagement (n=9,371), results reveal troublesome gaps for historically underrepresented populations in their sense of belonging among their peers and affiliation with the institution. Yet, when students participated in certain high-impact practices (learning communities, service learning, research with faculty, and campus leadership), positive associations were found, even after controlling for other institutional and student-level characteristics. Implications for first-year programming are discussed.
The journey or the destination: Exploring engagement patterns of disabled student veterans
Kraus, A., Nicholls, R. C., & Cole, J. S.
In D. DiRamio (Ed.) What?s next for student veterans? Moving from transition to academic success Herndon, VA: Stylus, 2017.
Higher education has worked in recent years to create more inclusive campus practices for student veterans, and disability is an important aspect of this community. An estimated 25% of student veterans have a disability, and student veterans are twice as likely as their non-veteran peers to have at least one disability. To address the unique characteristics of student veterans, including those with disabilities, college and university professionals have developed vet-friendly campuses across the country with services such as dedicated spaces for student veterans to gather and seek refuge from the hectic nature of campus, Veterans Affairs work-study positions, and participation in the Yellow Ribbon program to more seamlessly facilitate the approval of transfer credit. Also, to respond to the concerns of military-connected students, campuses are identifying points of contact across important student services such as counseling and psychological services, financial aid, and disability services. However, little research has been conducted to help us understand the impact of these programs and services on student engagement. While we understand general trends and characteristics of student veterans, we do not have a clear sense with respect to involvement or engagement of what makes these students successful in higher education. Even less descriptive information is available to help us understand the behaviors and experiences of disabled student veterans. This chapter uses findings from the 2015 National Survey of Student Engagement as well as individual interviews to explore the engagement patterns of disabled student veterans in their final year of university to better understand how and why these students persist to graduation.
Full version
The use of student engagement findings as a case of evidence-based practice
Kinzie, J.
New Directions for Higher Education, 2017(178), 47–56, 2017.
The chapter considers student engagement to discuss the use of assessment evidence to advance evidence-based practice and to illustrate a scholarship of practice.
Full version
Creative cognitive processes in higher education
Miller, A. L., & Dumford, A. D.
The Journal of Creative Behavior, 50(4), pp. 282–293, 2016.
This paper explores whether or not students in higher education settings are using creative cognitive processes, how these processes are related to deep approaches to learning, and in what types of settings and students these processes are most prevalent. Data collected from 8,724 students at 17 institutions participating in the 2010 National Survey of Student Engagement suggests that first-year and senior students employ several different creative cognitive processes in their everyday activities. Results from exploratory and confirmatory factor analyses suggest two distinct types of processes: deliberate creative processes and intuitive cognitive processes. Additional analyses indicate significant positive relationships between both types of creative processes and deep approaches to learning, as well as statistically significant differences in the use of creative processes based on gender, enrollment type, and type of institution. Potential reasons for and implications of these findings are discussed.
To be or not to be (an arts major): Career aspirations and perceived skills of graduating seniors across multiple disciplines
Miller, A. L., Dumford, A. D., Gaskill, S., Houghton, R., & Tepper, S. J.
Indiana University Center for Postsecondary Research, 2016.
Full version
A lottery improves performance on a low-stakes test for males but not females
Cole, J. S., Bergin, D. A., & Summers, J.
Assessment in Education: Principles, Policy, and Practice, , 1–16, 2016.
The purpose of this study was to address the effectiveness of autonomy support and a lottery-based reward in enhancing test performance and test-taking motivation on a low-stakes test. Two hundred and forty-six university students were randomly assigned to three groups ? lottery, autonomy support and control ? and took a mathematics test. Students in the autonomy support and lottery group reported putting forth more test-taking effort than students in the control group. Males who were offered a chance at winning the financial reward scored almost 10 points higher on the exam compared to females. Results showed no significant difference in test scores for female students among groups, suggesting that neither intervention had an impact on females.
Impact of the environment: How does attending a Hispanic-Serving Institution influence the engagement of baccalaureate-seeking Latina/o students?
Fosnacht, K., & Nailos, J. N.
Journal of Hispanic Higher Education, 14(3), 191–297, 2016.
Hispanic-Serving Institutions (HSIs) enroll the majority of Latina/o students in higher education; however, it is unclear how HSIs influence Latina/os‘ postsecondary experiences. In this study, we examined how the Latina/o student experience differed between students who did and did not attend 4-year HSIs. The results suggest that HSIs generally have positive, but modest, effects on Latina/o‘s student engagement and self-perceived gains. The differences were more pronounced for first-year students than seniors.
Full version
Engaging Latino students for transfer and completion
Waiwaiole, E., Kinzie, J., & Brown, S.
Diverse Issues in Higher Education, , , 2016.
Both community colleges and bachelor‘s degree-granting institutions across the country are responding to a chorus of calls for dramatic improvements in student success and college completion, while maintaining and improving the quality of students‘ educational experiences. A companion challenge is to close persistent and troubling attainment gaps across a diverse population of students. Because Latinos are the largest under-served population and the numbers will continue to increase, achieving these goals requires consideration of how these students experience higher education and what institutions can do to better serve them.
An alternative approach: Using panels to survey college students
Sarraf, S. A., Hurtado, S., Houlemarde, M., & Wang, X.
AIR Professional File, (Fall), Article 138, 2016.
Eight short surveys based on select items from the National Survey of Student Engagement (NSSE) were administered to approximately five hundred students over a nine-week period at five diverse colleges and universities. The goal of the experiment was to investigate what impact a survey panel data collection approach would have on recruitment, survey data quality indicators, and scale properties. Results indicated higher response rates, shorter survey duration, and minimal impact on scale factor structures. However, both cost of incentives and panel member attrition make this alternative survey method less attractive than it would be otherwise.
Assessment in student affairs (2nd ed.)
Schuh, J. H., Biddix, P., Dean, L. A., & Kinzie, J.
San Francisco, CA: Jossey-Bass, 2016.
A practical, comprehensive manual for assessment design and implementation,
Assessment in Student Affairs (Second Edition) offers a contemporary look at the foundational elements and practical application of assessment in student affairs. Higher education administration is increasingly called upon to demonstrate organizational effectiveness and engage in continuous improvement based on information generated through systematic inquiry. This book provides a thorough primer on all stages of the assessment process. From planning to reporting and beyond, you'll find valuable assessment strategies to help you produce meaningful information and improve your program. Combining and updating the thoroughness and practicality of Assessment in Student Affairs and Assessment Practice in Student Affairs, this new edition covers design of assessment projects, ethical practice, student learning outcomes, data collection and analysis methods, report writing, and strategies to implement change based on assessment results. Case studies demonstrate real-world application to help you clearly see how these ideas are used effectively every day, and end-of-chapter discussion questions stimulate deeper investigation and further thinking about the ideas discussed. The instructor resources will help you seamlessly integrate this new resource into existing graduate-level courses.
Student affairs administrators understand the importance of assessment, but many can benefit from additional direction when it comes to designing and implementing evaluations that produce truly useful information. This book provides field-tested approaches to assessment, giving you a comprehensive how-to manual for demonstrating?and improving?the work you do every day.
?Build your own assessment to demonstrate organizational effectiveness.
?Utilize quantitative and qualitative techniques and data.
?Identify metrics and methods for measuring student learning.
?Report and implement assessment findings effectively.
Accountability and effectiveness are the hallmarks of higher education administration today, and they are becoming the metrics by which programs and services are evaluated. Strong assessment skills have never been more important. Assessment in Student Affairs gives you the knowledge base and skill set you need to shine a spotlight on what you and your organization are able to achieve.
Do later wake times and increased sleep duration of 12th graders result in more studying, higher grades, and improved SAT/ACT test scores?
Cole, J. S.
Sleep and Breathing, 20, 1053–1057, 2016.
Background: The aim of this study was to investigate the relationship between sleep duration, wake time, and hours studying on high school grades and performance on the Scholastic Aptitude Test (SAT)/ American College Testing (ACT) college entrance exams.
Method: Data were collected from 13,071 recently graduated high school seniors who were entering college in the fall of 2014. A column proportions z test with a Bonferroni adjustment was used to analyze proportional differences. Analysis of covariance (ANCOVA) was used to examine mean group differences.
Results: Students who woke up prior to 6 a.m. and got less than 8 h of sleep (27 %) were significantly more likely to report studying 11 or more hours per week (30 %), almost double the rate compared to students who got more than 8 h of sleep and woke up the latest (16 %). Post hoc results revealed students who woke up at 7 a.m. or later reported significantly higher high school grades than all other groups (p < 0.001), with the exception of those students who woke up between 6:01 a.m. and 7:00 a.m. and got eight or more hours of sleep. The highest reported SAT/ACT scores were from the group that woke up after 7 a.m. but got less than 8 h sleep (M = 1099.5). Their scores were significantly higher than all other groups.
Conclusion: This study provides additional evidence that increased sleep and later wake time are associated with increased high school grades. However, this study also found that students who sleep the longest also reported less studying and lower SAT/ACT scores.
The who, what, and where of learning strategies
Dumford, A. D., Cogswell, C. A., & Miller, A. L.
The Journal of Effective Teaching, 16(1), 72-88, 2016.
Learning strategies have been shown to be an important part of success in the classroom, but little research exists that examines differences across major fields concerning the use and faculty emphasis of learning strategies. This study uses data from the National Survey of Student Engagement and the Faculty Survey of Student Engagement to explore whether there is congruence for academic disciplines between the student use and faculty encouragement of learning strategies. Patterns in the results suggest that are certain fields, including health professions, biology, agriculture, natural resources, and social service professions most frequently emphasizing and using learning strategies, while others, including engineering, physical sciences, mathematics, and computer science are less likely to do so. OLS regression models also suggest demographic and environmental predictors of student use of learning strategies, such as gender, enrollment status, cumulative college grades, Greek affiliation, and participation in a learning community. Potential reasons for and implications of these findings are discussed.
Using student engagement results to oversee educational quality
Kinzie, J., McCormick, A. C., & Gonyea, R. M.
Trusteeship, 24(1), , 2016.
Since the advent of the National Survey of Student Engagement (NSSE) in 2000, more than 1,600 bachelor‘s degree-granting colleges and universities have had access to reliable evidence about their students‘ engagement in effective educational practices that can inform discussions about educational quality. Yet too few institutions and boards take full advantage of this information to document and improve quality. Board members must come to understand the importance of student engagement and how institutions under their leadership can use it to improve educational quality.
Full version
What is NSSE?
Paine, C., Gonyea, R. M., Anson, C. M., & Anderson, P. V.
In R. Malenczyk (Ed.) A rhetoric for writing program administrators Anderson, SC: Parlor Press, 2016.
The contributions of writing to learning and development: Results from a large-scale multi-institutional study
Anderson, P., Anson, C. M., Gonyea, R. M., & Paine, C.
Research in the Teaching of English, 50(2), 199-235, 2015.
Conducted through a collaboration between the Council of Writing Program Administrators(CWPA) and the National Survey of Student Engagement (NSSE), this study identified and tested new variables for examining writing‘s relationship to learning and development. Eighty CWPA members helped to establish a consensus model of 27 effective writing practices. Eighty US baccalaureate institutions appended questions to the NSSE instrument based on these 27 practices, yielding responses from 29,634 first-year students and 41,802 seniors. Confirmatory factor analysis (CFA) identified three constructs: Interactive Writing Processes, Meaning-Making Writing Tasks, and Clear Writing Expectations. Regression analyses indicated that the constructs were positively associated with two sets of established constructs in the regular NSSE instrument--Deep Approaches to Learning (Higher-Order Learning, Integrative Learning, and Reflective Learning)and Perceived Gains in Learning and Development as defined by the institution‘s contributions to growth in Practical Competence, Personal and Social Development, and General Education Learning--with effect sizes that were consistently greater than those for the number of pages written. These were net results after controlling for institutional and student characteristics, as well as other factors that might contribute to enhanced learning. The study adds three empirically established constructs to research on writing and learning. It extends the positive impact of writing beyond learning course material to include Personal and Social Development. Although correlational, it can provide guidance to instructors, institutions, accreditors, and other stakeholders because of the nature of the questions associated with the effective writing constructs.
Full version
Independent colleges and student engagement: Descriptive analysis by institutional type
Gonyea, R. M., & Kinzie, J.
Washington, DC: Council of Independent Colleges, 2015.
Critics of traditional, residential, liberal arts colleges and universities contend that this form of higher education is outmoded, too costly, and no longer educationally relevant for 21st century students. Economies of scale, large classes taught by contingent faculty members and graduate students, and increasing reliance on technology and online learning, so the argument goes, are the only cost-effective means of meeting the educational challenges of the future. This report, prepared for the Council of Independent Colleges (CIC), draws on the most current NSSE data, from 2013 and 2014, that include more than 540,000 first-year and senior students enrolled at more than 900 four-year colleges and universities. Findings are presented with comparisons across four institutional types: (1) baccalaureate and master‘s level private institutions (CIC‘s predominant membership profile), (2) baccalaureate and master‘s level public institutions, (3) doctoral private institutions, and (4) doctoral public institutions. Included in the analysis are measures from the updated NSSE that includes ten new Engagement Indicators, six High-Impact Practices, the Perceived Gains scale, and a Satisfaction scale. Findings from this study affirm the effectiveness of independent colleges and universities for undergraduate student learning. Students at private institutions are more likely to be engaged in educationally effective experiences than their peers at public institutions. Areas of distinction in the private institution undergraduate experience include a more academically challenging education, better relations with faculty members, more substantial interactions with others on campus, and the consistent perception that students have learned and grown more, in comparison with public institutions.
Full version
College seniors' plans for graduate school: Do deep approaches learning and Holland academic environments matter?
Rocconi, L. M., Ribera, A. K., & Nelson Laird, T. F.
Research in Higher Education, 56(2, Special Forum Issue), 178–201, 2015.
This study examines the extent to which college seniors‘ plans for graduate school are related to their tendency to engage in deep approaches to learning (DAL) and their academic environments (majors) as classified by Holland type. Using data from the National Survey of Student Engagement, we analyzed responses from over 116,000 seniors attending 499 four-year institutions. Findings revealed a significant positive relationship between seniors‘ uses of DAL and plans for earning a graduate degree. Further, seniors majoring in Investigative and Social environments were more likely to hold higher degree expectations. Significant interaction effects by DAL and Holland academic environment were also found. The impact of DAL on graduate degree expectations was greater for seniors majoring in Artistic environments than otherwise similar students in Investigative, Enterprising, or Social environments. In addition, the impact of DAL on degree expectations was greater for seniors in Enterprising environments than otherwise similar students in Social environments.
Full version
Living with smartphones: Does completion device affect survey responses?
Lambert, A. D., & Miller, A. L.
Research in Higher Education, 56(2, Special Forum Issue), 166–177, 2015.
With the growing reliance on tablets and smartphones for internet access, understanding the effects of completion device on online survey responses becomes increasing important. This study uses data from the Strategic National Arts Alumni Project, a multi-institution online alumni survey designed to obtain knowledge of arts education, to explore the effects of what type of device (PC, Mac, tablet, or smartphone) a respondent uses has on his/her responses. Differences by device type in the characteristics of survey respondents, survey completion, time spent responding, willingness to answer complex and open-ended questions, and lengths of open-ended responses are discussed.
Full version
Reflections on the state of student engagement data use and strategies for action
Kinzie, J., Cogswell, C. A., & Wheatle, K. I. E.
Assessment Update, 27(2), 1–2, 14–15, 2015.
Although the National Survey of Student Engagement (NSSE) collects responses from hundreds of participating colleges and universities every year, its ultimate goal is not to collect data but to catalyze improvement in undergraduate education. Launched in 2000 by the Pew Charitable Trusts in response to growing national and local pressures for higher education to focus on measures of education quality and for colleges and universities to engage in meaningful improvement, the NSSE has become a leader in a campaign to focus attention on a number of relatively clear characteristics of effective environments for teaching and learning. The NSSE‘s process indicators related to good practices in undergraduate education provide diagnostic information about concrete activities that can guide interventions to promote improvement. By 2014, more than 1,500 institutions had participated in the NSSE, and over 4.5 million students had completed the questionnaire. In addition, the launch of two complementary instruments, the Faculty Survey of Student Engagement (FSSE) and the Beginning College Survey of Student Engagement (BCSSE), have furthered efforts to encourage the use of data for improvement by equipping institutions with information about faculty perceptions and entering students‘ expectations for engagement. Given these noble goals and all the student engagement data, what impact has the NSSE had on the use of data for improvement on campuses? And what lessons does this work suggest for the improvement agenda in higher education?
Full version
Development of the quantitative reasoning items on the National Survey of Student Engagement
Dumford, A. D., & Rocconi, L. M.
Numeracy, 8(1), Article 5, 2015.
As society‘s needs for quantitative skills become more prevalent, college graduates require quantitative skills regardless of their career choices. Therefore, it is important that institutions assess students‘ engagement in quantitative activities during college. This study chronicles the process taken by the National Survey of Student Engagement (NSSE) to develop items that measure students‘ participation in quantitative reasoning (QR) activities. On the whole, findings across the quantitative and qualitative analyses suggest good overall properties for the developed QR items. The items show great promise to explore and evaluate the frequency with which college students participate in QR-related activities. Each year, hundreds of institutions across the United States and Canada participate in NSSE, and, with the addition of these new items on the core survey, every participating institution will have information on this topic. Our hope is that these items will spur conversations on campuses about students‘ use of quantitative reasoning activities.
Full version
Are those rose-colored glasses you are wearing? Student and alumni survey responses
Dumford, A. D., & Miller, A. L.
Research and Practice in Assessment, 10, 5-14, 2015.
Lessons from the field—Volume 3: Using data to catalyze change on campus
National Survey of Student Engagement
Bloomington, IN: Center for Postsecondary Research, Indiana University School of Education, 2015.
Volume 3 of Lessons from the Field builds on insights from the earlier volumes illustrating the benefits of using NSSE results. Specifically, the highlighted institutional examples predominately feature the use of NSSE‘s updated measures and redesigned reports introduced with the survey‘s 14th administration in 2013. After more than three years of collaborative analysis, evidence-based item refinement, pilot testing, and student interviews, NSSE was revised to
incorporate content enhancements and customization
options that sustain the survey‘s relevance and value to participating institutions. The 25 institutional accounts featured in this volume illustrate how institutions are using results from the updated NSSE in assessment and improvement activities and in a variety of efforts
to address important campus needs and priorities.
Indeed, enlisting campus constituencies in the use
of assessment results is essential during a time of heightened demands for accountability and pressures to increase student persistence and completion, support diversity, and ensure high-quality learning for all students. Even more, improvement efforts at colleges and universities are more likely to succeed when they emerge from a shared understanding of the evidence and of the priorities for action.
Full version
Participation in undergraduate research at minority-serving institutions
Haeger, H., BrckaLorenz, A., & Webber, K.
Perspectives on Undergraduate Research and Mentoring, 4(1), 1-22, 2015.
This research used a national dataset to examine factors associated with participation for underrepresented minority (URM) students, benefits of participation at minority-serving institutions, and examples of programs that work to decrease barriers for URM participation in UR. Findings showed that Latino and first-generation students participated in UR less than White peers, but students at Minority Serving Institutions who participated in research with a faculty member reported using more learning strategies, increased collaboration, and having more experience with quantitative reasoning than students not participating in an UR experience.
Full version
Using National Survey of Student Engagement data and methods to assess teaching in first-year composition and writing across the curriculum
Paine, C., Anson, C., Gonyea, R. M., & Anderson, P.
In A. E. Dayton (Ed.) Assessing the teaching of writing: Twenty-first century trends and technologies Boulder, CO: University Press of Colorado, 2015.
In this chapter, we describe the origins, aims, and general structure of the NSSE (student engagement) and the Consortium for the Study of Writing in College (CSWC) (writing instruction) surveys. We describe how the CSWC was developed and offered and provide a brief overview of major findings of the national study. We describe how WPAs can adopt and adapt both the CSWC questions and the general approach to local needs. Finally, we describe some best practices (what to do and what to avoid) for using this approach, and we provide a few ideas for sharing results and making improvements.
Creative cognitive processes in higher education
Miller, A. L., & Dumford, A. D.
The Journal of Creative Behavior, 50(4), pp. 282–293, 2014.
This paper explores whether or not students in higher education settings are using creative cognitive processes, how these processes are related to deep approaches to learning, and in what types of settings and students these processes are most prevalent. Data collected from 8,724 students at 17 institutions participating in the 2010 National Survey of Student Engagement suggests that first-year and senior students employ several different creative cognitive processes in their everyday activities. Results from exploratory and confirmatory factor analyses suggest two distinct types of processes: deliberate creative processes and intuitive cognitive processes. Additional analyses indicate significant positive relationships between both types of creative processes and deep approaches to learning, as well as statistically significant differences in the use of creative processes based on gender, enrollment type, and type of institution. Potential reasons for and implications of these findings are discussed.
A survey of college-bound high school graduates regarding circadian preference, caffeine use, and academic performance
Cole, J. S.
Sleep and Breathing, 19, 123–127, 2014.
Background: This study examines the relationships between circadian preference and caffeine use with academic performance and hours spent studying for recent high school graduates entering their first year of college.
Method: Entering first-year college students enrolled at 90 baccalaureate-level institutions across the USA were invited to complete the Beginning College Survey of Student Engagement (BCSSE) and the Composite Scale of Morningness (CSM) as well as answer questions regarding caffeine consumption. Surveys were administered on each campus during the summer months of 2013. Only those that graduated from a US high school in the spring of 2013 were included in this study. The final sample for this study included 25,200 students that completed the BCSSE, CSM, and questions regarding caffeine consumption.
Results: Evening types (E-types) were significantly less likely to report earning A/A?‘s in high school and less likely to study 16 or more hours per week compared to intermediate or morning types (M-types) (p<0.05). Overall, entering first year students reported an average of 1.1 servings of caffeine per day, with 39 % reporting no caffeine consumption. M-types were more likely to consume no caffeine (54 %) compared to E-types that also indicated no daily caffeine (31 %) (p<0.05). However, E-types were approximately 2.5 times more likely to consume three or more daily servings of caffeine (18 %) compared to M-types that consume the same amount (7 %) (p<0.05). M-types that consumed no caffeine reported the highest grades with nearly 64 % reporting they earned mostly A‘s or A-‘s in high school. However, the apparent advantage that morning types had over evening types regarding high school grades was completely ameliorated once three or more servings of caffeine were consumed per day.
Conclusions: This study provides additional information to educators and health professionals to create programs and provide resource to help adolescents better understand the
impact of their sleep behaviors and use of caffeine on their academic performance.
Do good assessment practices measure up to the principles of assessment?
Kinzie, J., Jankowski, N., & Provezis, S.
Assessment Update, 26(3), 1–2, 14–16, 2014.
The American Association for Higher Education's Nine Principles of Good Practice for Assessing Student Learning (AAHE 1992) have appeared to stand the test of time, as evidenced by the fact that they are often referred to within the pages of Assessment Update and appear on various assessment websites and in texts (see Banta, Jones, and Black 2009). In fact, Hutchings, Ewell, and Banta (n.d.) reviewed the principles in 2010, declaring that they had ?aged nicely.? Looking back to 1992, the principles were conceived as a way to codify the responsible and effective conduct of assessment, advance assessment for educational improvement, and assist campuses to develop approaches that make a difference for students and their learning. The principles serve as a foundation for assessment practice. Guidelines for assessment continue to be promulgated, such as the New Leadership Alliance‘s Committing to Quality: Guidelines for Assessment and Accountability in Higher Education (2012), which intended to help institutions evaluate their assessment practices and to establish shared commitments among sectors of higher education; and the Principles for Effective Assessment of Student Achievement (Western Association for Schools and Colleges 2013), endorsed in July 2013 by six higher education associations and all regional accreditors, which succinctly expressed the value of assessment. The newer statements share tenets of the AAHE principles and also reflect specific organizational commitments. Similar to the AAHE Assessment Forum, the National Institute for Learning Outcomes Assessment (NILOA) has sought to move the needle on assessment efforts by surveying the landscape of assessment in higher education and by assisting institutions and others in discovering and adopting promising practices in the assessment of undergraduate student learning outcomes. Toward these ends, this article considers the most widely cited guidelines for effective assessment, namely, the AAHE Principles against the backdrop of NILOA‘s collection of accounts of good assessment practice. Simply put, how well do institutions‘ assessment activities align with stated principles for effectiveness?
High-impact practices and the first-year student
Tukibayeva, M., & Gonyea, R. M.
New Directions for Institutional Research, 2013(160, Special Issue), 19–35, 2014.
High-impact practices?programs and activities in which students commit considerable time and effort in different settings?can help to define the first-year college experience and are likely to increase success in areas like persistence, deep learning, and self-reported gains.
One size does not fit all: Traditional and innovative models of student affairs practice
Manning, K. M., Kinzie, J., & Schuh, J. H.
New York, NY: Routledge, 2014.
In the day-to-day work of higher education administration, student affairs professionals know that different institutional types, whether a small liberal arts college, a doctoral intensive institution, or a large private university, require different practical approaches. Despite this, most student affairs literature emphasizes a "one size fits all" approach to practice, giving little attention to the differing models of student affairs practice and their diversity across institutions. In the second edition of this influential book, leading scholars Kathleen Manning, Jillian Kinzie, and John H. Schuh advocate an original approach by presenting 11 models of student affairs practice, including both traditional and innovative programs. Based on a qualitative, multi-institutional research project, One Size Does Not Fit All explores a variety of policies, practices, and programs that contribute to increased student engagement, success, and learning.
New to this revised edition:
Refinement of models in light of recent NSSE data and current developments in higher education, including budget cuts and the economic crisis;
updated information throughout about model assessment and techniques to renew divisions of student affairs;
a deeper analysis of how models of student affairs practice relate to institutional mission and purposes;
end-of-chapter discussion questions to guide thinking about ways to incorporate models in one‘s own context;
an entirely new Part IV, including chapters on "Catalysts and Tools for Change" and "Redesigning Your Student Affairs Division."
Reconsidering the inclusion of diversity in the curriculum
Nelson Laird, T. F.
Diversity & Democracy, 17(4), 12–14, 2014.
As institutions seek to improve all students' success, the inclusion of people with diverse backgrounds, ideas, and methods of teaching and learning is an educational imperative. Such inclusion simultaneously (1) creates more equitable opportunities for students from marginalized groups to participate in higher education and (2) promotes the kinds of outcomes for all students that employers and society need, such as complex thinking skills, the ability to work across difference, increased civic participation, and decreased prejudice (see, for example, National Leadership Council 2007).
Faculty members often recognize that inclusion is a key to learning. Even among students who have access to an educational experience, those who feel excluded from the full experience struggle to learn as well as those who feel included (Hurtado et al. 1999). To create an inclusive learning environment throughout the curriculum and in all fields, all faculty members should consider how they are incorporating diversity into their courses and how they can be more inclusive in their teaching. Incorporating diversity into one's teaching takes time and depends on the specifics of the situation (who is teaching which students, and in what context). Faculty members do not need simple solutions that may not work for their circumstances. Therefore, I offer the framework described below not as a prescription, but as a guide for faculty seeking their own ways of including diversity in their courses.
Refocusing the quality discourse: The United States National Survey of Student Engagement
McCormick, A. C., & Kinzie, J.
In H. B. Coates & A. C. McCormick (Eds.) Engaging university students: International insights from system-wide studies Singapore: Springer, 2014.
This chapter reports on work conducted with nearly 1,500 bachelor's degree-granting colleges and universities in the USA to assess the extent to which their undergraduates are exposed to and participate in empirically proven effective educational activities. The chapter begins with a discussion of the prevailing quality discourse in the USA. It then explores the conceptual and empirical foundations of student engagement and the origins of NSSE as both a response to the quality problem and as a diagnostic tool to facilitate improvement. The chapter also discusses tensions between internal improvement and external accountability efforts, and NSSE‘s role in the assessment and accountability movements. It concludes with a discussion of challenges that confront the project going forward.
Research on successful learning practices
Kinzie, J.
In B. Tobolowsky (Ed.) Paths to learning: Teaching for engagement in college Columbia, SC: National Resource Center, 2014.
Survey page length and progress indicators: What are their relationships to item nonresponse?
Sarraf, S., & Tukibayeva, M.
New Directions for Institutional Research, 2014(161, Special Issue), 83–97, 2014.
The popularity of online student surveys has been associated with greater item nonresponse. This chapter presents research aimed at exploring what factors might help minimize item nonresponse, such
as altering online survey page length and using progress indicators.
Using NSSE to understand student success: A multi-year analysis
Fiorini, S., Shepard, L, Liu, T., & Ouimet, J.
Norman, OK: University of Oklahoma, 2014.
This research focuses on using NSSE (National Survey of Student Engagement) responses to predict student academic success. The analysis is based on 16,630 Indiana University Bloomington first-year beginner students and seniors who completed the NSSE survey administered from 2006 to 2012. Logistic regression and linear regression on student background and pre-college information, financial aid, previous college academic performance, NSSE Benchmarks and individual NSSE items were conducted to predict academic success defined as: 1) first-year
students‘ fall-to-fall retention and end-of-first-year cumulative GPA, 2) seniors number of terms taken to degree completion and 4-year graduation. Results show that certain student characteristics and earlier achievement are indicative of college success with higher levels of student engagement marginally contributing to the models. Analyses also highlighted elements of engagement that go counter to their expected effect on retention and performance.
Full version
Assessing learning spaces: Purpose, possibilities, approaches
Kinzie, J.
In J. L. Narum (Ed.) A guide: Planning for assessing 21st century spaces for 21st century learners Washington, DC: Learning Spaces Collaboratory, 2013.
The deep interest in knowing what would improve the quality of learning is driving assessment into every nook and cranny of colleges and universities. Colleges and universities are more accountable for educational effectiveness and for the performance of their students and graduates. Thus, concern about improving educational quality, coupled with the need for individual
campuses to demonstrate learning outcomes, has made assessment an unavoidable activity on campuses since the 1980s. Renewed efforts to enhance quality and increase persistence and success for all students?particularly under-represented minorities?has made it essential to collect evidence on a regular basis of the extent to which effectiveness has been achieved, evidence intended to mobilize attention to improving educational conditions in light of the findings. Assessment has always been a critical component in teaching and learning. Educators regularly assess at the individual student level, evaluating student work and giving grades, and some aggregate this information to guide improvements efforts at the level of an individual
course. Assessment also moves beyond the course when faculty consider strengths and weaknesses of students‘ work in relation to departmental learning goals. The department can then use these findings and other data, such as a graduating senior survey, to inform decisions about curriculum, pedagogy, and perhaps to prepare
for a specialized accreditation review or an institutional review. The demand for information from assessment has broadened its definition and purpose, now embracing the collection and analysis of student learning outcomes and other institutional outcomes, including cost-effectiveness, satisfaction, and the achievement of standards?all to determine the impact of educational programs, practices, and policies.
Good information in the right hands can be a vitally important lever for change. When done well, assessment can provide a foundation for wise planning, budgeting, improvements to the curriculum, pedagogy, staffing, programming, and ensuring that resources are dedicated to what is most effective.
NSSE benchmarks and institutional outcomes: A note on the importance of considering the intended uses of a measure in validity studies
Pike, G.
Research in Higher Education, 54(2), 149–170, 2013.
Surveys play a prominent role in assessment and institutional research, and the NSSE College Student Report is one of the most popular surveys of enrolled undergraduates. Recent studies have raised questions about the validity of the NSSE survey. Although these studies have themselves been criticized, documenting the validity of an instrument requires an affirmative finding regarding the adequacy and appropriateness of score interpretation and use. Using national data from NSSE 2008, the present study found that the NSSE benchmarks provided dependable means for 50 or more students and were significantly related to important institutional outcomes such as retention and graduation rates.
Student and faculty member engagement in undergraduate research
Webber, K., Nelson Laird, T. F., & BrckaLorenz, A.
Research in Higher Education, 54(2), 227–249, 2013.
Undergraduate research (UR) is a valued co-curricular activity that has involved an increasing number of students and faculty members in recent years. While there is a growing body of research on student participation in UR, there is less research available examining faculty perceptions of, participation in UR, and how those factors influence student participation in UR. This study examined approximately 110,000 responses to the National Survey of Student Engagement and 40,000 responses to the Faculty Survey of Student Engagement at over 450 four-year institutions. Findings revealed that individual and institutional characteristics predicted student and faculty member involvement and that the majority of faculty members perceived UR to be of importance. Implications for fostering faculty involvement, student success, and viewing UR as an institutional asset are discussed.
Advancing the study of a movement: The status of methods and measures in first-year experience and student transition research
Kinzie, J.
The Journal of the First-Year Experience and Students in Transition, 25(2), 39–52, 2013.
The essay examines the variety of research methods and measures used in the first-year experience and students-in-transition field over the past 25 years. Interrogating the extant research, Kinzie explores whether the methods and analytic processes most commonly employed are adequate to advance our understanding of complex issues in the field. The author concludes with four recommendations for broadening understanding of the conditions that contribute to student learning and success: (a) adopting more varied and sophisticated research methods; (b) identifying more refined outcomes, especially outcomes focused on student learning; (c) expanding the populations of interest and selecting relevant methods and measures for examining their unique experiences; and (d) designing studies that help us understand more about the characteristics and structures of proven educational initiatives that contribute to positive student outcomes.
Estimating college student behavior frequencies: Do vague and enumerated estimation strategies yield similar results?
Cole, J. S., & Korkmaz, A.
Journal of Applied Research in Higher Education, 5(1), 58–71, 2013.
Purpose. Surveys that collect data regarding behavior estimates are found in many fields including, but not limited to, those that conduct consumer research, health studies, sexual behavior, drug use, political polls, and many types of education studies. These studies typically use either vague behavioral quantifiers as the response set, or enumerated response sets where the respondent needs to select or tally the target behavior, or a combination of both types. This study aimed to investigate the relationship between these two methods of estimating educationally related behaviors.
Design/methodology/approach. Data for this study was taken from the 2010 administration of Beginning College Survey of Student Engagement (BCSSE), which is administered to incoming first?year students. Respondents included 30,964 first?year entering students from 81 higher education institutions in the USA. Data analysis was then carried out.
Findings. This study found that the more frequent the behavior, the shorter the time frame the respondent uses when estimating the behavior using enumerated strategies. In addition, this study showed that for many educationally relevant behaviors vague quantifiers are associated with increasing enumerated responses for the same behavior showing that two behavioral estimates are providing consistent estimations of the same behavior. Another equally important finding is that there were few meaningful group differences regarding these estimates.
Originality/value. Overall, the results from this study shed new light on interpreting behavior estimations using vague and enumerated responses.
First-year students’ psychological well-being and need for cognition: Are they important predictors of academic engagement?
Cole, J. S., & Korkmaz, A.
Journal of College Student Development, 54, 557–569, 2013.
This study focused on the dispositions of entering
first-year students, their perceptions of classroom and institutional environments, and their subsequent academic engagement. Total variance explained by variables included in the path model for academic engagement was 30%. The
results of this study found evidence to support
the theoretical model that environment does
mediate the relationship between two personality
constructs (Need for Cognition and Psychological
Well-Being) and academic engagement. Results
of this study provide additional evidence that the
environment matters and that institutions should
continue to focus on creating supportive, positive
environments that foster engagement.
Linking the assessment of student engagement to student success
Gonyea, R. M., BrckaLorenz, A., & Ribera, T.
In G. McLaughlin, R. Howard, J. McLaughlin, & W. E. Knight (Eds.) Building bridges for student success: A sourcebook for colleges and universities Norman, OK: Consortium for Student Retention Data Exchange, 2013.
In this chapter, we explore the conceptual foundations and measurement of student engagement and share studies that link student engagement to student success. We also provide examples from several institutions that use student engagement measures in formative assessment to improve their students‘ learning experiences. Finally, we look at the researcher‘s role in effectively using engagement data to create a culture of evidence that documents student success.
Making college count: An examination of quantitative reasoning activities in higher education
Rocconi, L. M., Lambert, A. D., McCormick, A. C., & Sarraf, S. A.
Numeracy, 6(2), Article 10, 2013.
Findings from national studies along with more frequent calls from those who employ college graduates suggest an urgent need for colleges and universities to increase opportunities for students to develop quantitative reasoning (QR) skills. To address this issue, the current study examines the relationship between the frequency of QR activities during college and student and institutional characteristics, as well as whether students at institutions with an emphasis on QR (at least one QR course requirement for all students) report more QR activity. Results show that gender, race-ethnicity, major, full-time status, first-generation status, age, institutional enrollment size, and institutional control are related to the frequency of QR activities. Findings also suggest that such activities are indeed more common among institutions that emphasize QR.
Full version
Refreshing engagement: NSSE at 13
McCormick, A. C., Gonyea, R. M., & Kinzie, J.
Change: The Magazine of Higher Learning, 45(3), 6–15, 2013.
Thirteen years ago, 276 bachelor's-granting colleges and universities inaugurated a new approach to assessing college quality by participating in the first national administration of the National Survey of Student Engagement (NSSE). The timing was right. Policymakers were growing increasingly impatient with an ongoing yet unsustainable pattern of cost escalation, skepticism was building about how much students were learning in college, and regional accreditors were ratcheting up their demands on colleges and universities to adopt assessment for purposes of improvement.
Meanwhile, higher education's leaders were frustrated by the crude metrics dominating the discourse about college quality. It's been said that a dean at one of those early-adopting institutions enthusiastically proclaimed: ?Finally, a test I actually want to teach to!?NSSE introduced a simple yet effective reframing of the quality question: ask undergraduates about their educationally purposeful experiences. It incorporated several important design principles: emphasize behaviors that prior research found to be positively related to desired learning outcomes; emphasize actionable information?behaviors and experiences that institutions can influence; standardize survey sampling and administration to ensure comparability between institutions; provide participating institutions with comprehensive reports detailing their own students' responses relative to those at comparison institutions, plus an identified student data file to permit further analysis by the institution. NSSE was administered to first-year students and seniors, opening a window on quality at these ?bookends? of the undergraduate experience. In addition to reporting item-by-item results, the project created summary measures in the form of five ?Benchmarks of Effective Educational Practice? that focused attention on key dimensions of quality in undergraduate education: level of academic challenge, active and collaborative learning, student-faculty interaction, enriching educational experiences, and supportive campus environment. The new survey caught on fast. Annual participation now numbers 600?700 institutions, for a cumulative total of more than 1,500 colleges and universities in the US and Canada. What started as a bold experiment in changing the discourse about quality and improvement in undergraduate education?and providing metrics to inform that discourse?is now a trusted fixture in higher education's assessment landscape. High rates of repeat participation offer compelling testimony of the project's value. Of the first group of 276, 93 percent administered the survey in NSSE's tenth year or later. The Web-based survey is now offered as a census of first-year students and seniors, permitting disaggregated analyses by academic unit or demographic subgroup. In 2013, some 1.6 million undergraduates were invited to complete the survey, providing both valuable information for more than 620 participating campuses and a comprehensive look at student engagement across a wide variety of institutions. The 2013 administration marks the first major update of the survey since its inception. In the following pages, we summarize what we've learned over NSSE's first 13 years, why we're updating the survey, and new insights and diagnostic possibilities represented by these changes. Although NSSE's companion surveys, the Faculty Survey of Student Engagement (FSSE) and the Beginning College Survey of Student Engagement (BCSSE), are incorporating parallel changes, here we focus on the changes to NSSE.
Full version
Student engagement: Bridging research and practice to improve the quality of undergraduate education
McCormick, A. C., Kinzie, J., & Gonyea, R. M.
In M. B. Paulsen (Ed.) Higher education: Handbook of theory and research, Vol. 28 Dordrecht, The Netherlands: Springer, 2013.
This chapter traces the development of student engagement as a research-informed intervention to shift the discourse on quality in higher education to emphasize matters of teaching and learning while providing colleges and universities with diagnostic, actionable information that can inform improvement efforts. The conceptual lineage of student engagement blends a set of related theoretical propositions (quality of effort, involvement, and integration) with practice-focused prescriptions for good practice in undergraduate education. The development of survey-based approaches to measuring student engagement is reviewed, including a treatment of recent criticisms of these approaches. Next, we summarize important empirical findings, including validation research, typological research, and research on institutional improvement. Because student engagement emerged as an intervention to inform educational improvement, we also present examples of how engagement data are being used at colleges and universities. The chapter concludes with a discussion of challenges and opportunities going forward.
Full version
The Degree Qualifications Profile: What it is and why we need it now
Jankowski, N., Hutchings, P., Ewell, P. T., Kinzie, J., & Kuh, G. D.
Change: The Magazine of Higher Learning, 45(6), 6–14, 2013.
There is no shortage of challenges facing postsecondary institutions in the US. One that cuts to the core of the enterprise is whether they are preparing their graduates to live productive, civically responsible lives in a dynamic global marketplace mapped onto diverse, yet increasingly interdependent, social and cultural systems. Much of the evidence presented in recent Change articles suggests that what undergraduate students know and are able to do falls well short of what employers, policymakers, and educational leaders say is needed.
Whether one accepts the available evidence as sufficient to draw such a sweeping conclusion ultimately rests on resolving two non-trivial issues. First, key stakeholders?those mentioned above and others, including students?must agree on the constellation of knowledge, skills, competencies, and dispositions that need to be signaled by postsecondary degrees and credentials if they are to be attuned to the demands of the times.
Various individuals and groups representing business and education have issued sets of preferred outcomes. Perhaps best known are the Essential Learning Outcomes promulgated by the Association of American Colleges and Universities' (AAC&U) Liberal Education and America's Promise (LEAP) campaign. But while there is considerable overlap in the attributes that various groups deem desirable, there is less agreement as to the expected level of proficiency associated with a given credential or degree (associate's, baccalaureate, and post-baccalaureate). Second, what evidence do we have that students have achieved the desired levels of proficiency in the respective outcome areas? Countries throughout the world?in Europe, Australasia, and Central and South America?have made considerable progress in addressing these challenges by developing degree qualifications frameworks that articulate what outcomes graduates of their colleges and universities should have, along with behaviorally anchored indicators and other measures that mark the extent to which students have acquired them. A handful of institutions in the US?such as Alverno College, the military academies, and Western Governor's University?have done something akin to this. But it is only recently that concerted efforts have been mounted to bring greater clarity and more widespread agreement about what credentials and degrees should represent by more precisely defining what college students in this country need to know and be able to do and at what level of proficiency. This paper is about the status and aspirations of one such effort, Lumina Foundation's Degree Qualifications Profile (DQP).Over the past 18 months, the staff of the National Institute for Learning Outcomes Assessment (NILOA) and their colleagues at Public Agenda and Lumina Foundation have collected information from faculty and staff at scores of colleges and universities across the country, as well as from participants at various conferences and convenings, about how the DQP is being used. The DQP authors will take this information into account as they prepare a revised iteration of the document, which should be available in 2014. Drawing from our work as members of the NILOA team and on the perspective of Peter Ewell as one of the DQP authors, what follows is a brief overview of the DQP's defining features, a summary of general trends in its use, brief descriptions of several projects, and an analysis of the DQP's implications for assessment. We conclude with some comments about the promise of the DQP for both individual institutions and for higher education writ large.
Examining effective faculty practice: Teaching clarity and student engagement
BrckaLorenz, A., Ribera, T., Kinzie, J., & Cole, E. R.
To Improve the Academy, 31, 149–160, 2012.
As colleges and universities shift to a learning-
centered paradigm, a growing emphasis is being placed on understanding which teaching practices are effective in promoting student learning (Barr & Tagg, 1995). Reviewing the literature, there are varying ideas on what constitutes effective teaching; however, one that is often referenced when discussing the characteristics of effective teaching is teaching clarity (Feldman, 1989; Hativa, Barak, & Simhi, 2001; Sherman et al., 1987). Teaching clarity can be thought of as a teaching method where faculty demonstrate a level of transparency in their approach to instruction and goal setting in an effort to help students better understand expectations and comprehend subject matter (Ginsberg, 2007b). This includes providing examples and summarizing key points of lectures (Chesebro & McCroskey, 2001; Myers & Knox, 2001). Teaching clarity has been shown to have a positive effect on key outcomes of an undergraduate education (see Chesebro & McCroskey, 2001; Myers & Knox, 2001; Pascarella, Edison, Nora, Hagedorn, & Braxton, 1996). Unfortunately, little is known about the extent to which students are exposed to specific teaching clarity behaviors and the relationship to other important elements of an undergraduate education, such as student engagement, deep learning, and self-reported gains.
An engagement-based student typology and its relationship to college outcomes
Hu, S., & McCormick, A. C.
Research in Higher Education, 53, 738–754, 2012.
Using data from the 2006 cohort of the Wabash National Study of Liberal Arts Education, we developed a student typology based on student responses to survey items on the National Survey of Student Engagement. We then examined the utility of this typology in understanding direct-assessment learning outcomes, self-reported gains, grade-point average, and persistence from the first to second year of college. Results from linear and logistic regression models indicated there were relationships between student types and the various outcomes, and that an engagement-based student typology could help deepen our understanding of the college student experience and college outcomes.
Examining the relationship between student learning and persistence
Hu, S., McCormick, A. C., & Gonyea, R. M.
Innovative Higher Education, 37, 387–395, 2012.
Using data from the 2006 cohort of the Wabash National Study of Liberal Arts Education, we developed a student typology based on student responses to survey items on the National Survey of Student Engagement. We then examined the utility of this typology in understanding direct-assessment learning outcomes, self-reported gains, grade-point average, and persistence from the first to second year of college. Results from linear and logistic regression models indicated there were relationships between student types and the various outcomes, and that an engagement-based student typology could help deepen our understanding of the college student experience and college outcomes.
Financial stress affects academics for college students, survey finds
National Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2012.
Findings illuminate how financial challenges affect college students. A majority of students surveyed worry about paying for college, and as many as one in three frequently opt not to purchase required academic materials due to cost. Full-time students working more than 20 hours per week face the greatest financial stress: three in five said that their job interfered with their academic performance, yet just as many had considered working more hours.
Full version
Going deep into mechanisms for moral reasoning growth: How deep learning approaches affect moral reasoning development for first-year students
Mayhew, M. J., Seifert, T. A., Pascarella, E. T., Nelson Laird, T. F., & Blaich, C. F.
Research in Higher Education, 53, 26–46, 2012.
The purpose of this paper was to determine the effects of deep approaches to learning on the moral reasoning development of 1,457 first-year students across 19 institutions. Results showed a modest positive relationship between our measures of deep approaches to learning and moral reasoning at the end of the first year of college even after controlling for precollege moral reasoning. After accounting for a host of demographic and relevant student characteristics and for the natural clustering of students, we found that the integrative learning subscale, which captures students' participation in activities designed to integrate information from varied sources and diverse perspectives, positively affected moral reasoning among first-year students. Implications for researchers and practitioners are discussed.
High-impact practices: Promoting participation for all students
Kinzie, J.
Diversity & Democracy, 15(3), 13–14, 2012.
Certain educational activities, such as learning communities, undergraduate research, study abroad, and service learning, have been identified as high-impact practices (HIPs) because they engage students in active learning that elevates their performance on desired outcomes (NSSE 2007; Kuh 2008). When done well, these practices require students to make their own discoveries and connections, grapple with challenging real-world questions, and address complex problems?all necessary skills if students are to become engaged and effective members of their communities. The strong positive effects of several HIPs are well-documented in extant research about programs that support student learning. Brownell and Swaner conclude that high-impact practices ?live up to their name,? noting a wide range of benefits for participants (2009, 30). Participation in HIPs, including those that emphasize civic engagement, has powerful educational benefits for all students. These kinds of educational experiences are especially powerful for students who may be the first in their family to attend college, and those who are historically underserved in postsecondary education. This article briefly introduces the benefits of HIPs, examines participation in them, and suggests approaches to making these valuable practices more widespread to advance educational equity and social justice goals.
Investigating social desirability bias in student self-report surveys
Miller, A. L.
Educational Research Quarterly, 36(1), 30-47, 2012.
The frequent use of student self-report surveys in higher education calls into question the possibility of social desirability having an unwanted influence on responses. This research explores the potential presence of social desirability bias with the National Survey of Student Engagement (NSSE), a widely used assessment of student behaviors. Correlations between a short social desirability scale and NSSE benchmarks, subscales, and selected items suggest that the majority of scores have no significant relationship with a measure of social desirability. A series of regression models controlling for demographic variables produce similar results. Effect sizes and estimates of explained variance are also discussed.
Lessons from the field—Volume 2: Moving from data to action
National Survey of Student Engagement
Bloomington, IN: Center for Postsecondary Research, Indiana University School of Education, 2012.
In this publication we highlight approaches different types of institutions have taken to improve the undergraduate experience. Because NSSE focuses on student behavior and effective educational practice, colleges and universities have found many productive ways to use survey results: accreditation self-studies, benchmarking, curricular reform, faculty and staff development, grant writing, institutional research, retention, and state system comparisons.
The stories about data use illustrate various ways that assessment can be a worthwhile undertaking when meaningful data are generated and discussed with a wide campus audience, and results are used to inform efforts to improve educational effectiveness. Understanding how colleges and universities use results and achieve
improvements in undergraduate education is important.
to advancing systemic improvement in higher
education. The examples in this volume provide ample
inspiration for encouraging institutions to move from
collecting data to taking action.
Full version
Optimizing high-impact educational practices in the senior year
Kinzie, J.
In M. S. Hunter, J. R. Keup, J. Kinzie, & H. Maietta (Eds.) The senior year: Culminating experiences and transitions Columbia, SC: National Resource Center for the First-Year Experience Students in Transition, 2012.
This chapter addresses how high-impact practices can be used to improve institutional efforts in supporting seniors.
Understanding undergraduate students’ experience: A content analysis using NSSE open-ended comments as an example
Chambers, T., & Chiang, C.-H.
Quality & Quantity, 46, 1113–1123, 2012.
This study demonstrates how a qualitative content analysis method may be used to help understand undergraduate students‘ experience. We examine and rationalize the methodological concerns regarding content analysis of open-ended comments in the qualitative study. We describe a data analysis technique, using qualitative responses from National Survey of Student Engagement (NSSE) as an example, and highlight the findings in a thematic way to convey how undergraduate students perceive issues that challenge them to develop skills, awareness, and confidence, as well as the potential factors that influence student engagement and future success. Finally, we provide potentials of how these findings can be utilized to improve student experience, limitations of this study as well as suggestions for future research.
Full version
Will these trees ever bear fruit? A response to the special issue on student engagement
McCormick, A. C., & McClenney, K.
The Review of Higher Education, 35(2), 307–333, 2012.
There is broad consensus that U.S. higher education needs to do better. Researchers, policymakers, and practitioners have called attention to a range of challenges: too many students enter college unprepared for college-level work, yet many developmental programs are little more than revolving doors; too many students who begin college never graduate, often accumulating considerable debt; the most rapid enrollment growth is among the groups that higher education has historically served least well?so institutions have to do more to ensure their students‘ success; students‘ development of generalized critical-thinking and problem-solving skills falls short of what we want and need; we are not producing enough graduates in science, technology, engineering, and math; cost escalation is unsustainable, with most of the growth occurring outside of core educational functions; and the United States is losing ground to other countries with regard to postsecondary degree attainment. And as we confront these challenges, the national understanding of college quality is dominated by beauty contests that privilege reputation and resources over teaching and learning. The higher education research community has the capacity to contribute to our understanding of and response to these challenges. Indeed, scholars have engaged with many of them. Any could justifiably serve as the organizing theme for a special issue of one of the field‘s leading scholarly journals. Given the range of important topics where systematic, focused scholarly treatment could advance both research and practice, we find it curious that student engagement trumps these subjects as meriting a special issue of the Association for the Study of Higher Education‘s signature scholarly journal. We might be flattered that our work is seen as deserving such attention, but we are instead dismayed that the ?special issue on student engagement? was in fact devoted to critiques focused exclusively on the two university-based research and service projects that we direct; that it included no contributions from scholars with a record of inquiry on student engagement; and that we had no opportunity to respond to the critique in the special issue itself so as to better advance scholarly discourse and professional practice. While our projects have always welcomed reasoned critique (continuous improvement based on feedback is a hallmark of both projects), we find these precedents worrisome. We are nevertheless grateful for the opportunity to submit this response after the fact. In the following pages, we situate our response relative to the long-decried disconnect between higher education research and practice, a gap that our respective projects attempt to bridge. We offer brief comments about the Olivas preface, mostly to correct factual errors and omissions, and then provide more detailed responses to the substantive critiques in the articles by Porter; Dowd, Sawatzky, and Korn; Campbell and Cabrera; and Nora, Crisp, and Matthews (all 2011).
Full version
An investigation of the contingent relationships between learning community participation and student engagement
Pike, G. R., Kuh, G. D., & McCormick, A. C.
Research in Higher Education, 52, 300–322, 2011.
This study examined the contingent relationships between learning community participation and student engagement in educational activities inside and outside the classroom using data from the 2004 administration of the National Survey of Student Engagement (NSSE). Results indicated that learning community participation was positively and significantly related to student engagement, both for first-year students and seniors. For some types of engagement, relationships were significantly stronger for seniors than for first-year students. Analyses also revealed there was substantial variability across institutions in the magnitude of the relationships between learning community participation and first-year students' levels of engagement. Although institutional characteristics accounted for some of the variability across institutions, a substantial amount of the variability in engagement-learning community relationships remained unexplained.
Career and technical education students who transition to four-year institutions: An exploratory study
Qi, W., & Cole, J. S.
The Journal of the First-Year Experience and Students in Transition, 23, 75–92, 2011.
Each year more students with career and technical education (CTE) backgrounds are transitioning to four-year institutions. This exploratory study investigated differences between CTE, community college transfers and native (nontransfer) students at four-year institutions in regard to how they balance their time and their academic engagement patterns. An important finding of this study was that CTE students, when compared to traditional nontransfer students and community college transfers, spent equal amounts of time studying and demonstrated equal or significantly greater levels of academic engagement. The findings also provide the higher education community much needed information regarding the CTE students‘ transition to college.
Full version
Clearing the air about the use of self-reported gains in institutional research
Gonyea, R. M., & Miller, A.
New Directions for Institutional Research, 2011(150), 99–111, 2011.
Correlations between self-reported learning gains and direct, longitudinal measures that ostensibly correspond in content area are generally inadequate. This chapter clarifies that self-reported measures of learning are more properly used and interpreted as evidence of students' perceived learning and affective outcomes. In this context, the authors supply evidence that social desirability bias in such self-assessments does not constitute a significant concern. Recommendations for use of self-reported gains in research and institutional assessment are discussed.
Establishing differences between diversity requirements and other courses with varying degrees of diversity inclusivity
Nelson Laird, T. F., & Engberg, M. E.
The Journal of General Education, 60, 117–137, 2011.
This study examines how diversity requirements differ from courses that are highly inclusive or less inclusive of diversity. Results suggest that instructor characteristics are statistically different and that highly inclusive and less inclusive diversity courses score highest and lowest, respectively, on measures of effective teaching compared with required diversity courses.
Gender gaps in collegiate teaching style: Variations by course characteristics
Nelson Laird, T. F., Garver, A. K., & Niskod-Dossett, A.S.
Research in Higher Education, 52, 261–277, 2011.
Using data from over 9,000 faculty members that participated in the Faculty Survey of Student Engagement (FSSE), this study examined the moderating role a range of course characteristics played on the effects of gender on the percentage of class time spent on various activities, a measure of teaching style. Results revealed gender differences, but that the gaps between men and women in lecturing and active classroom practices varied by disciplinary area, course level, and the number of times a course had been taught by the same instructor. The results confirm that gender effects depend on context, which implies that efforts to improve teaching and learning must also adapt to the instructional context.
If and when money matters: The relationships among educational expenditures, student engagement, and students’ learning outcomes
Pike, G. R., Kuh, G. D., McCormick, A. C., Ethington, C. A., & Smart, J. C.
Research in Higher Education, 52, 81–106, 2011.
Calls for accountability in higher education are prompted in part by questions concerning whether colleges and universities use their resources effectively to promote student learning. Unfortunately, too little is known about whether money matters to desired outcomes of college. Using students‘ responses to the 2004 administration of the National Survey of Student Engagement (NSSE) in concert with institutional data from the Integrated Postsecondary Education Data System (IPEDS) and the College Board, this study examined the relationships between educational expenditures, student engagement and selected student self-reported learning outcomes, controlling for student and institutional characteristics. Results indicated that expenditures were modestly related to student engagement and learning outcomes. However, the nature of these relationships differed, depending on the engagement/outcome measure and student year in school.
Institutional encouragement of and faculty engagement in the scholarship of teaching and learning
Nelson Laird, T. F., & Ribera, T.
To Improve the Academy, 30, 112–125, 2011.
Nelson Laird and Ribera examine institutional encouragement of and faculty engagement in SoTL across forty-nine U.S. colleges and universities. Their results suggest that institutional encouragement of and faculty engagement in the public dissemination of teaching investigations lag behind encouragement and engagement in other aspects of SoTL.
It’s about time: What to make of reported declines in how much college students study
McCormick, A. C.
Liberal Education, 97(1), 30–39, 2011.
A substantial body of research affirms the commonsense notion that involvement in academic work and quality of effort pay off: the more students engage in educationally purposeful activities, the more they learn. An important element is how much time students invest in studying. Yet while time is important, it is increasingly clear that how students spend their study time also matters. Spending many hours memorizing facts in order to perform well on an exam may earn a good grade, but it is not likely to result in long-term retention or the ability to apply what was learned in novel situations. A recent longitudinal analysis of student performance on the open-ended performance task of the Collegiate Learning Assessment, administered to the same students at the beginning of the first year and at the end of the sophomore year, found that hours spent studying alone corresponded to improved performance, but hours spent studying with peers did not. While we should not ignore the importance of how study time is used, this article focuses on the simple question of how much full-time college students study, whether study time has declined, and if so, what may account for the decline.
Full version
Measuring the diversity inclusivity of college courses
Nelson Laird, T. F.
Research in Higher Education, 52, 572–588, 2011.
Most studies of curricular diversity have focused on the effects of participation in diversity courses on student outcomes. Though the results have been positive, these studies have used limited measures of curricular diversity and there is a great need for a complimentary body of research demonstrating what faculty and what types of courses are more likely to include diversity. This study relies on 12 diversity inclusivity items derived from a comprehensive model of how diversity is included into a course to investigate how much diversity is being included in collegiate courses and what predicts diversity inclusivity, as measured by two scales: diverse grounding and inclusive learning. The results, based on 7,101 responses from faculty participating in the 2007 Faculty Survey of Student Engagement, suggest that most faculty are including diversity in their courses in some way, but that women and faculty of color tend to include diversity to a greater extent than their colleagues. Also, courses taught in the soft fields are more likely to be inclusive of diversity.
STEM/non-STEM differences in engagement at U.S. institutions
Nelson Laird, T. F., McCormick, A. C., Sullivan, D. F., & Zimmerman, C. K.
Peer Review, 13(3), 23–26, 2011.
A recent paper by one of us (Nelson Laird) and some colleagues brought some sobering news of differences between STEM (science, technology, engineering, and mathematics) and non-STEM undergraduates with regard to approaches to learning that promote more complex, deeper understanding. Using data from the National Survey of Student Engagement (NSSE) and the Faculty Survey of Student Engagement (FSSE), Nelson Laird and colleagues examined disciplinary differences in the extent to which students are exposed to educational environments that promote deep approaches to learning. These approaches to learning are important because ?[s]tudents who use deep approaches to learning tend to perform better as well as retain, integrate, and transfer information at higher rates than students using surface approaches to student learning? (Nelson Laird, Shoup, Kuh, and Schwarz 2008, 470). Nelson Laird and colleagues found?using models with extensive statistical controls?that, nationally, STEM faculty generally use pedagogies that encourage higher-order, integrative, and reflective learning significantly less than faculty in non-STEM fields and, not coincidently, STEM seniors experience ?deep approaches to learning? less than seniors in non-STEM fields (for descriptions of the three measures, see Nelson Laird et al. 2008). The differences were small for Higher-Order Learning, the scale that is concerned with analysis, synthesis, and judgment regarding evidence?relatively good news?but quite large for the Integrative and Reflective Learning scales. The study by Nelson Laird and colleagues is a part of a larger body of work about students engaging in educationally purposeful activities?those educational practices known to positively influence valued educational outcomes, activities such as active and collaborative learning and those that involve much student?faculty interaction, as noted in many of the articles in this issue of Peer Review. We know of the positive impact of pedagogies of engagement not only on general student learning, but also on STEM learning, from years of research. It is discouraging that, nationally, faculty in STEM fields tend to have lower expectations for integrative and reflective learning relative to other faculty, and that results from seniors reflect those differences. The Integrative Learning scale assesses how often students use ideas from various sources and courses, include diverse perspectives in class discussions or writing assignments, and discuss ideas from readings or classes with faculty members and others outside of class. The Reflective Learning scale is a combination of responses to questions about trying out different perspectives and thinking about one‘s own beliefs. The kinds of intellectual self-reflection skills these questions are about are surely as important in the STEM disciplines as they are in other disciplines, but we see that STEM majors have far fewer opportunities to develop these skills than students in other majors. Indeed, one might argue that it is especially in STEM that students should acquire these skills, given the way empirical evidence tends to be seen as harder in science than in other disciplines. Discovering a bad premise or assumption and being open to other interpretations are just as important in STEM disciplines as elsewhere. These results caused us to want to look more closely at STEM/non-STEM differences and to determine whether there are circumstances where STEM seniors buck the general trends and are as engaged or more engaged than their non-STEM peers.
Student learning in fraternities and sororities: Using NSSE data to describe members’ participation in educationally meaningful activities in college
Bureau, D., Ryan, H. G., Ahren, C., Shoup, R., & Torres, V.
Oracle, 6(1), 1–22, 2011.
The benefits and challenges for college students involved in social fraternities and sororities have long been sources of heated discussion among higher education constituents. A liberal education is meant to incorporate elements of critical thinking, diverse experiences, and challenging and enriching interactions with peers and educators. Past research indicates that involvement in a fraternity or sorority has had some positive effect in these areas, especially as students persist at their chosen institutions. This study uses data from the National Survey of Student Engagement (NSSE) to explore indicators of student learning among senior members of social fraternities and sororities. Regression analyses controlling for conditional variables indicated that students in these groups report higher involvement in critical developmental practices and larger gains in important educational areas than their unaffiliated counterparts. Limitations and implications of the
study are discussed.
Full version
In their own words: Understanding the undergraduate student experience at the University of Toronto
Office of the Vice Provost, Students, & First-Entry Divisions, University of Toronto.
Toronto, ON, Canada: , 2010.
Accuracy of self-reported SAT and ACT test scores: Implications for research
Cole, J. S., & Gonyea, R. M.
Research in Higher Education, 51(4), 305–319, 2010.
Because it is often impractical or impossible to obtain school transcripts or records on subjects, many researchers rely on college students to accurately self-report their academic record as part of their data collection procedures. The purpose of this study is to investigate the validity and reliability of student self-reported academic performance. As expected the study finds overall validity of self-reported test scores to be high. However, correlations between self-reported and actual SAT scores are significantly lower than correlations for self-reported and actual ACT Composite scores. This study also confirms prior research which found that when students are inaccurate in reporting their scores, a disproportionate number of them over-report their scores. Also consistent with other studies, this study finds that lower achieving students for both tests are much less accurate when reporting their scores.
Full version
Student success in college: Creating conditions that matter
Kuh, G. D., Kinzie, J., Schuh, J. H., & Whitt, E. J.
New York, NY: Wiley, 2010.
Student Success in College describes policies, programs, and practices that a diverse set of institutions have used to enhance student achievement. This book clearly shows the benefits to student learning and educational effectiveness that can be realized when these conditions are present. Based on the Documenting Effective Educational Practice (DEEP) project from the Center for Postsecondary Research at Indiana University, this book provides concrete examples from 20 institutions that other colleges and universities can learn from and adapt to help create a success-oriented campus culture and learning environment.
Full version
How effective are the NSSE benchmarks in predicting important educational outcomes?
Pascarella, E. T., Seifert, T. A., & Blaich, C.
Change: The Magazine of Higher Education, 42(1), 16–22, 2010.
Pursuant to a subcontract from the Center of Inquiry in the Liberal Arts at Wabash College, the Center for Research on Undergraduate Education at the University of Iowa analyzed institution-level data from the first year of the Wabash National Study of Liberal Arts Education to estimate the validity of the NSSE benchmarks in predicting seven traits and skills thought to be the outcomes of a general liberal arts education. Our study measured those outcomes directly; it also addressed the limitations of past research on the NSSE by using a longitudinal pre-test-post-test approach. No other investigation of which we are aware provides such a comprehensive validation of the NSSE benchmark scales.
Full version
A comparison of student and faculty academic technology use across disciplines
Guidry, K. R., & BrckaLorenz, A.
EDUCAUSE Quarterly, 33(3), , 2010.
Our study extends the research into faculty and student use of contemporary academic technologies by asking five questions: How often do students report using academic technologies? How often do faculty report using academic technologies? Do students in different disciplines use these technologies more or less than their peers? Do faculty in different disciplines use these technologies more or less than their peers? Are there noticeable differences between how often students and faculty use these technologies? Our study examined responses to a pair of surveys ? the National Survey of Student Engagement (NSSE) and the Faculty Survey of Student Engagement (FSSE) ? administered in the spring of 2009.
Assessment for advancement
McCormick, A. C.
CASE Currents, 36(3), 11–12, 2010.
Comparing the undergraduate experience of engineers to all other majors: Significant differences are programmatic
Lichtenstein, G., McCormick, A. C., Sheppard, S. D., & Puma, J.
Journal of Engineering Education, 99(4), 305–317, 2010.
This paper examines the experiences of students in undergraduate engineering compared to students in other fields, using responses on the National Survey of Student Engagement (NSSE). NSSE is a cross-sectional survey that is widely used by four-year undergraduate institutions in the United States and Canada, with adaptations for use in Australia, China, New Zealand, and South Africa. The data analyzed in this paper reflect responses from a longitudinal sample of nearly 12,000 U.S. students, representing a wide range of majors, who took the NSSE survey as first-year students and then again as seniors. Using NSSE variables, we explored the extent to which the collegiate experiences of engineering majors compared to the collegiate experiences of non-engineering majors with respect to student engagement. We also compared the experiences of those who persisted in engineering, those who left engineering to pursue another major, and those who migrated into engineering from another major. Finally, we developed a predictive model for engineering persistence based on students‘ reported educational experiences and demographic characteristics. We found that, in most ways, the undergraduate experiences of engineering majors are similar to the experiences of students who major in other disciplines. However, in some key areas, the experiences of engineering students are very different.
Foreword
Kinzie, J.
In J. Melius (Ed.) Student engagement as a factor in academic achievement: The case study of undergraduates at Norfolk State University, Virginia New York, NY: The Edwin Mellen Press, 2010.
Here's looking at you: Transparency, institutional self-presentation, and the public interest
McCormick, A. C.
Change: The Magazine of Higher Learning, 42(6), 35–43, 2010.
Accountability figures prominently in the higher education policy discourse these days. Critics of higher education (for instance, members of the Spellings Commission) argue that colleges and universities need to be more ?transparent? to justify support by taxpayers, payers of tuition, and other funders. To better inform prospective students and other stakeholders, we are being asked to go public about our programs, educational processes, and results. But transparency can be about more than consumer information. It can provide an opportunity for a college or university to proclaim its successes while acknowledging that it needs to improve in some areas. Information about results can also document progress toward important goals. For internal audiences, this kind of information focuses attention and signals priorities for improvement, while for external observers it offers evidence that the academy takes its educational mission seriously and practices what it preaches regarding the use of evidence to support assertions, interpretations, conclusions, and prescriptions for action. Such openness is risky for several reasons, though. Revealing shortcomings invites negative consequences, whether from a legislature that may be seeking ways to cut budgets or to demonstrate a hard-nosed commitment to quality, from competitors seeking to exploit vulnerabilities, from alumni or other constituents on the lookout for evidence of a decline in standards, and so on. As a result, ?transparency? is sometimes a euphemism for what might be more accurately described as strategic communication or image management, in which information is carefully selected and presented so as to portray a successful and effective institution. This should come as no surprise. A persistent, paradoxical, and problematic characteristic of accountability systems in general is that they create a powerful incentive for those being held accountable ?to look as good as possible, regardless of the underlying performance? (Ewell, 2009, p. 7). In this article, I examine various forms of public reporting of student engagement information. Some are controlled by third parties and others by the institutions themselves. I look at four third-party efforts: the Community College Survey of Student Engagement (CCSSE), the Voluntary System of Accountability (VSA), Transparency by Design (TbD), and the institutionally authorized online publication of results from the National Survey of Student Engagement (NSSE) by the daily newspaper USA TODAY (USAT). (See Resources for links to these Web sites.) The Center for Community College Student Engagement (which houses CCSSE) recently introduced a new survey focused on the early experience of entering community college students; while this review focuses on CCSSE, it applies equally to the Survey of Entering Student Engagement (SENSE), which uses a comparable reporting framework.
Full version
How gender and race moderate the effect of interactions across difference on student perceptions of the campus environment
Nelson Laird, T. F., & Niskod-Dossett, A. S.
The Review of Higher Education, 33(3), 333–356, 2010.
Relying on data from 37,122 first-year students and 42,285 seniors who participated in the 2006 administration of the National Survey of Student Engagement, this study illustrates how student interactions across difference positively affect student perceptions of the campus environment. The magnitude of the effect of these interactions varies meaningfully by racial/ethnic group, but not by gender.
Perspectives from campus leaders on the current state of student learning outcomes assessment.
Kinzie, J.
Assessment Update, 22(5), 1–2, 14–15, 2010.
The assessment of student learning outcomes is of keen interest to the federal government, accrediting bodies, and education associations and policymakers. Colleges and universities have been under increased pressured to demonstrate accountability for student learning and be more transparent about dimensions of educational quality. Although institutions are responding to these demands, it is not altogether clear where learning outcomes assessment ranks in importance on institutions‘ action agenda, or the extent to which colleges and universities are using assessment results to make real improvements in the quality of student learning. The National Institute for Learning Outcomes Assessment (NILOA) is a multiyear effort to understand and further the student learning outcomes agenda nationally. One of NILOA‘s primary activities is tracking the journey of higher education institutions responding to the challenge of outcomes assessment. To this end, NILOA conducts surveys, focus groups, and case studies to learn more about what colleges and universities are doing to assess student learning and how they are using the results. This paper highlights lessons from four focus group sessions with campus leaders ? presidents, provosts, academic deans and directors of institutional research from a variety of two- and four-year institutions ? regarding their perspectives on the state of learning assessment practices on their campuses. The perceptions are considered in relation to findings from the 2009 NILOA survey report, More Than You Think, Less than We Need: Learning Outcomes Assessment in Higher Education. The perspectives of campus leaders provide first-hand accounts of a range of student learning outcomes activities on campus and help contextualize results from the 2009 NILOA survey. Focus group findings illustrate the extent to which assessment has taken hold on campus, explicate the role of accreditation and the responsibility of faculty in student learning outcomes assessment, and showcase how assessment has been furthered on campuses. The institutional examples of innovative assessment practices, particularly those that involve faculty in meaningful ways and lead to institutional improvements, and the promising ways that assessment has been woven into administrative structures and processes, are instructive for advancing understanding of what is happening on the ground at colleges and universities. The paper concludes by articulating questions and challenges raised by campus leaders including reservations about identifying and using assessment measures, issues of transparency and communicating results, and concerns about financing assessment. As the demand for greater emphasis on student learning outcomes assessment intensifies, it is important to document both the successes and challenges associated with campus efforts to respond. Campus leaders provide an important perspective on what is most likely to help assessment efforts grow and deepen in institutions.
Research and discovery across the curriculum
Elrod, S., Kinzie, J., & Husic, D.
Peer Review, 12(2), 4–8, 2010.
The national conversation on undergraduate research is gaining momentum, in part because of its identification as one of the ten high-impact educational practices identified in an analysis of data from the National Survey of Student Engagement (NSSE), published by the Association of American Colleges and Universities (Kuh 2008). However, the trend is not new; the Council on Undergraduate Research (CUR) has been a leading proponent of undergraduate research for the past thirty years. According to CUR, undergraduate research is ?an inquiry or investigation conducted by an undergraduate student that makes an original intellectual or creative contribution to the discipline.? Ramirez and Hoagland (2003) state that faculty and students should be encouraged to ??collaborate as partners in their explorations of uncharted intellectual terrain. The symbiosis established between the faculty member and undergraduate collaborator energizes and informs the faculty member‘s teaching and research while simultaneously introducing the student to the joys of discovery as well as to lessons in persistence, problem-solving and critical thinking.? Thus, it is as much a matter of effective teaching and learning as it is a matter of research and scholarship. In STEM (science, technology, engineering, and mathematics) disciplines, Project Kaleidoscope, working over the past twenty years to advance effective STEM education, has also played a role. The National Science Foundation‘s Research Experience for Undergraduates (REU) and Research in Undergraduate Institutions (RUI) programs and various scientific societies have also helped to promote, support, and highlight the work of undergraduate researchers. Many funding agencies, philanthropic foundations and other organizations have also touted and supported the educational benefits of undergraduate research across all disciplines for decades, including the National Humanities Alliance, which holds an annual Humanities Advocacy Day. Undergraduate research experiences are also held in high regard by faculty members: more than 50 percent of faculty members reported on the Faculty Survey of Student Engagement (FSSE) that participation in a research project with a faculty member is important for students (National Survey of Student Engagement 2008). Students in all disciplines are also increasingly calling for such experiences (Society of Physics Students 2008). In this article, we provide an analysis of the value of undergraduate research and suggest that its essence be used to infuse a pedagogy of research and discovery into courses across the curriculum for a more relevant, real-world, research-rich educational experience.
Student engagement and a culture of assessment
Kinzie, J.
In G. Kramer & R. Swing (Eds.) Higher education assessments: Leadership matters Lanham, MD: Rowman Littlefield, 2010.
The author asserts that many campuses have made significant advances in assessment practices that drive improvements in student learning and success. This chapter introduces a framework for assessment based on student engagement and success, then highlights nine characteristics of campus assessment activities associated with improvements to student learning. For convenience, characteristics are grouped according to their focus on 1. strong leadership, 2. inclusive involvement, or 3. outcomes-based program function. Most institutions still find it hard to use evidence for systematic improvement, and few report having well-developed assessment plans to sustain a culture of assessment. Fortunately, effective and inspirational models have been developed by many institutions that have adopted an effective student engagement framework for assessing and improving the conditions for students' success leading to improvements in their learning. In this chapter, the lessons learned from 20 educationally effective institutions are reexamined in light of information from additional institutions that have advanced a framework for student engagement and success.
Student engagement and learning: Experiences that matter
Kinzie, J.
In J. C. Hughes & J. Mighty (Eds.) Taking stock: Research on teaching and learning in higher education Montreal, Quebec/Kingston, ON, Canada: McGill-Queen?s University Press, 2010.
The author presents an overview of the current research on student engagement and learning. Taking into account decades of work on the subject, she concludes that ?engagement is . . . a robust proxy? for learning. More specifically, in a ?host of studies,? measures of student engagement correlate positively with measures of student learning. More plainly, when students are engaged, they are usually learning?and vice versa. The obvious pedagogical takeaway: We are encouraged to engage students more and to engage them more deeply. In other words, ?Engaging pedagogies matter . . .? (p. 151). In addition to this broad affirmation of efforts to engage students in the learning process, Kinzie proposes four specific propositions for how we should apply the research on student engagement and learning: 1. Expectations matter to student learning and success, particularly in the first year of university; 2. Stimulating educational experiences and certain ?high-impact? practices raise student learning and impart greater benefit to all students; 3. What faculty emphasize and think is important to learning and influences what students do; and 4. Educators must be concerned with the total learning environment, inside and outside the classroom.
The effect of teaching general education courses on deep approaches to learning: How disciplinary context matters
Nelson Laird, T. F., & Garver, A. K.
Research in Higher Education, 51, 248–265, 2010.
Building on work examining differences in the emphasis faculty place on effective educational practices, this study uses data from nearly 8,000 faculty members from the 2007 Faculty Survey of Student Engagement to explore how disciplinary area moderates the effect of teaching a general education course (GEC) on the emphasis faculty place on deep approaches to learning. Results showed that the GEC effect was strongest in hard-applied-life fields and weakest in hard-pure-life and soft-applied-life fields, suggesting that proponents of general education reform need to temper their efforts by a clearer understanding of disciplinary differences.
Using longitudinal data to improve the experiences and engagement of first-year students
Cole, J. S., & Korkmaz, A.
New Directions for Institutional Research, 2010(Assessment Supplement), 43–52, 2010.
This chapter describes how campuses can use longitudinal data to investigate and improve the experiences and engagement patterns of their first-year students. The chapter has two goals. The first is to briefly describe the relationship between precollege student characteristics such as students‘ high school engagement and their engagement expectations for the first year of college with students‘ subsequent first-year engagement and experiences. The second is to present concrete examples of how campuses can use longitudinal data to better understand the experiences and engagement patterns of their first-year students.
Full version
What I hear you saying is... : Analysis of student comments from the NSSE
Chambers, T.
College Student Journal, 44(1), 3–24, 2010.
A major challenge of assessing students' experiences in postsecondary education is collecting an array of information that inform institutions about what students do and how they make meaning of their experiences during their time in particular educational environments. While the National Survey of Student Engagement (NSSE) is highly respected and broadly administered throughout higher education, most, if not all, of the analyses of NSSE data have been conducted on the quantitative responses to its survey items. Very little attention is given to students' responses to the open-ended question at the end of the NSSE survey, "Do you have any other comments?" This study explored the open-ended responses undergraduate students provided on the NSSE regarding their engagement with educationally purposeful activities at a large urban research institution. Content analyses were conducted on 739 coded responses from students, yielding 10 thematic categories organized into 4 experience domains. Additionally the study explored the distinctions among the categorical and domain responses across and among the nine colleges/faculties within the study institution. Potential implications, limitations and opportunities related to the study findings are discussed as well. (Contains 2 tables.)
Work during college: Its relationship to student engagement and education outcomes
McCormick, A. C., Moore, J. V. III, & Kuh, G. D.
In In L. W. Perna (Ed.) Understanding the working college student: New research and its implications for policy and practice Sterling, VA: Stylus, 2010.
Research discussed in this chapter found that working either on campus or off campus is positively connected to several proportions of student engagement, particularly for full-time students. Specifically, students working more than 20 hours per week had the biggest gains on student engagement. First-year students were more likely to work longer hours and to work off campus more frequently than other students. Compared to students who had a parent with a bachelor‘s degree, a significant share of first-generation students worked more than 20 hours per week (e.g., among freshmen, 20% of first-generation students versus 10% second- or older-generation students worked and among seniors, 39% of first-generation students versus 25%second- or older-generation). Furthermore, first-generation seniors were twice as likely as their peers with college-educated parents to work at least 30 hours per week (20% versus 10%). Thus, with so many college students working, it is imperative that faculty and staff become more informed about the relationship between employment and both student engagement and educational outcomes.
Analyzing and interpreting NSSE data
Chen, P.-S. D., Gonyea, R. M., Sarraf, S. A., BrckaLorenz, A., Korkmaz, A., Lambert, A. D., Shoup, R., & Williams, J. M.
New Directions for Institutional Research, 2009(141, Special Issue), 35–54, 2009.
Colleges and universities in the United States are being challenged to assess student outcomes and the quality of programs and services (McPherson & Shulenburger, 2006; Commission on the Future of Higher Education, 2006). One of the more widely used sources of evidence is student engagement as measured by a cluster of student engagement surveys administered by the Center for Postsecondary Research at Indiana University. They include the National Survey of Student Engagement (NSSE) and its companion projects: the Beginning College Survey of Student Engagement, Faculty Survey of Student Engagement, and Law School Survey of Student Engagement. The University of Texas?Austin hosts the two-year variation of the NSSE, the Community College Survey of Student Engagement. With more than 1,300 colleges and universities using NSSE, many institutional researchers may benefit from guidance about how to understand and use these data. This chapter shares practical tips and recommendations for the analysis and interpretation of NSSE data. We divided the chapter into three parts. The first offers six overarching tips and recommendations for working with student engagement data. We then discuss considerations for the analysis of multiple years of student engagement data. Finally, we describe how effect sizes can be used and interpreted to make student engagement results more meaningful. Although we use NSSE data and examples throughout the chapter, institutional researchers can almost always extrapolate the suggestions we provide to other student experience surveys. Instead of technical discussions of such topics as scale construction and factor analysis, we focus on practical, concrete data manipulations and applications for the analytical work of the institutional research professional.
Comparing the utility of the 2000 and 2005 Carnegie classification systems in research on students’ college experiences and outcomes.
McCormick, A. C., Pike, G. R., Kuh, G. D., & Chen, P. D.
Research in Higher Education, 50(2), 144–167, 2009.
Full version
Converting engagement results into action
Kinzie, J., & Pennipede, B. S.
New Directions for Institutional Research, 2009(141), 83–96, 2009.
Editor's notes
Gonyea, R. M., & Kuh, G. D.
New Directions for Institutional Research, 2009(141, Special Issue), 1–4, 2009.
Effectively involving faculty in the assessment of student engagement
Nelson Laird, T. F., Smallwood, R., Niskod-Dossett, A. S., & Garver, A. K.
New Directions for Institutional Research, 2009(141), 71–81, 2009.
Independent colleges and student engagement: Descriptive analysis by institutional type
BrckaLorenz, A., Ribera, T., & Gonyea, R. M.
(A 2009 NSSE special analysis update for the Council of Independent Colleges). Bloomington, IN: Indiana University Center for Postsecondary Research, 2009.
Individual and environmental effects of part-time enrollment status on student-faculty interaction and self-reported gains
Nelson Laird, T. F., & Cruce, T. M.
The Journal of Higher Education, 80, 290–314, 2009.
Lessons from the field—Volume 1: Using NSSE to assess and improve undergraduate education
National Survey of Student Engagement
Bloomington, IN: Center for Postsecondary Research, Indiana University School of Education, 2009.
Assessment is a worthwhile undertaking when
meaningful data are generated, evidence-based
improvement initiatives are thoroughly considered and discussed, and results are ultimately used to improve educational effectiveness. NSSE results are oriented toward such practical use. Each year, more campuses use their NSSE results in innovative ways to improve the undergraduate experience. In this publication we highlight the approaches different types of institutions
have taken to move from data to action.
Full version
NSSE, organizational intelligence, and the institutional researcher
Gonyea, R. M., & Kuh, G. D.
New Directions for Institutional Research, 2009(141, Special Issue), 107–113, 2009.
The National Survey of Student Engagement: Conceptual and empirical foundations
Kuh, G. D.
New Directions for Institutional Research, 2009(141), 5–20, 2009.
The role of precollege data in assessing and understanding student engagement in college
Cole, J. S., Kennedy, M., & Ben-Avie, M.
New Directions for Institutional Research, 2009(141, Special Issue), 55–70, 2009.
Full version
The use of engagement data in accreditation, planning, and assessment
Banta, T. W., Pike, G. R., & Hansen, M. J.
New Directions for Institutional Research, 2009(141, Special Issue), 21–34, 2009.
Toward reflective accountability: Using NSSE for accountability and transparency
McCormick, A. C.
New Directions for Higher Education, 2009(141), 97–106, 2009.
Using NSSE in institutional research
Gonyea, R. M., & Kuh, G. D. (Eds.)
New Directions for Institutional Research, 2009(141, Special Issue), , 2009.
Full version
What general education courses contribute to essential learning outcomes
Nelson Laird, T. F., Niskod-Dossett, A. S., & Kuh, G. D.
The Journal of General Education, 58, 65–84, 2009.
Collecting survey data for assessment: A practice brief based on BEAMS project outcomes
Kinzie, J.
Washington, DC: Institute for Higher Education Policy, 2008.
Full version
Classroom practices at institutions with higher-than-expected persistence rates: What student engagement data tells us
Nelson Laird, T. F., Chen, D., & Kuh, G. D.
In J. Braxton (Ed.), The role of the classroom in college student persistence , 2008.
Learning at a distance: Engaged or not?
Chen, P. D., Kuh, G. D., & Gonyea, R. M.
Innovate: Journal of Online Education, 4(3), , 2008.
Full version
Predicting collegiate philanthropy: Student engagement as a correlate of young alumni giving
Moore III, J. V.
Journal of the Indiana University Student Personnel Association, 2008 Edition, , 39–55, 2008.
Full version
Promoting persistence and success of underrepresented students: Lessons for teaching and learning
Kinzie, J., Gonyea, R., Shoup, R., & Kuh, G. D.
New Directions for Teaching and Learning, 2008(115), 21–38, 2008.
Student engagement and student success at Historically Black and Hispanic-Serving Institutions
Bridges, B. K., Kinzie, J., Nelson Laird, T. F., & Kuh, G. D.
In In M. Gasman, B. Baez, & C. Turner (Eds.) Understanding minority-serving institutions San Francisco, CA: Jossey-Bass, 2008.
The effects of discipline on deep approaches to student learning and college outcomes
Nelson Laird, T. F., Shoup, R., Kuh, G. D., & Schwarz, M. J.
Research in Higher Education, 49, 469–494, 2008.
Unmasking the effects of student engagement on first-year college grades and persistence
Kuh, G. D., Cruce, T. M., Shoup, R., Kinzie, J., & Gonyea, R. M.
The Journal of Higher Education, 79(5), 540–563, 2008.
Methodological challenges in multi-investigator multi-institutional research in higher education
Kinzie, J., Magolda, P., Kezar, A., Kuh, G. D., Hinkle, S., & Whitt, E
Higher Education, 54(3), 469–482, 2007.
Full version
Student learning and faculty research: Connecting teaching and scholarship
American Council of Learned Societies
Washington, DC: The Teagle Foundation, 2007.
Full version
Comparative review of British, American, and Australian national surveys of undergraduate students
Higher Education Academy
National survey comparative review York, UK: Author, 2007.
Full version
Connecting the dots: Multi-faceted analyses of the relationships between student engagement results from the NSSE, and the institutional practices and conditions that foster student success
Kuh, G. D., Kinzie, J., Cruce, T., Shoup, R., & Gonyea, R. M.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2007.
Full version
Student engagement in law school: Knowing our students
Law School Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2007.
African American and Hispanic student engagement at minority-serving and predominantly White institutions
Nelson Laird, T. F., Bridges, B. K., Morelon-Quainoo, C. L., Williams, J. M., & Salinas Holmes, M.
Journal of College Student Development, 48(1), 1–18, 2007.
Built to engage: Liberal arts colleges and effective educational practice
Kuh, G. D.
In F. Oakely (Ed.) Liberal arts colleges in American higher education New York, NY: American Council of Learned Societies, 2007.
Full version
Contextualizing NSSE effect sizes: Empirical analysis and interpretation of benchmark comparisons
National Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2007.
Full version
Engaging students in the first college year: Why librarians matter
Kuh, G. D., Boruff-Jones, P. D., & Mark, A. E.
In L. Hardesty (Ed.) The role of the library in the first college year Columbia, SC: University of South Carolina, National Resource Center for the First-Year Experience and Students in Transition, 2007.
Engaging undergraduate students in research activities: Are research universities doing a better job?
Hu, S., Kuh, G.D., & Gaston Gayles, J.
Innovative Higher Education, , , 2007.
Full version
Evaluating the rationale for affirmative action in college admissions: Direct and indirect relationships between campus diversity and gains in understanding diverse groups
Pike, G. R., Kuh, G. D., & Gonyea, R. M.
Journal of College Student Development, 48(2), 1–17, 2007.
Full version
Risky business
Kuh, G. D
Change: The Magazine of Higher Learning, 39(5), 31–35, 2007.
Full version
Student engagement in the first year of college
Kuh, G. D
In M. L. Upcraft, J. N. Gardner, & B. O. Barefoot (Eds.) Challenging and supporting the first-year student: A handbook for improving the first year of college San Francisco, CA: Jossey-Bass, 2007.
What student engagement data tell us about college readiness
Kuh, G. D.
Peer Review, 9(1), 4–8, 2007.
Full version
Who flourishes in college? Using positive psychology and student involvement theory to explore mental health among traditionally aged undergraduates
Ambler, G.
Williamsburg, VA: The College of William and Mary, 2007.
Why teacher-scholars matter: Some insights from FSSE and NSSE
Kuh, G. D., Chen, D., & Nelson Laird, T. F.
Liberal Education, 93(4), 40–45, 2007.
Women students at co-educational and women's colleges: How do their experiences compare?
Kinzie, J., Thomas, A. D., Palmer, M. M., Umbach, P. D., & Kuh, G. D.
Journal of College Student Development, 48(2), 145–165, 2007.
Full version
What matters to student success: A review of the literature
Kuh, G. D., Kinzie, J., Buckley, J.A., Bridges, B. K., & Hayek, J. C.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2006.
Full version
Are students ready for college? What student engagement data say
McCarthy, M. M., & Kuh, G. D.
Phi Delta Kappan, 87, 664–669, 2006.
Assessing what matters in law school: The Law School Survey of Student Engagement
O'Day, P. A., & Kuh, G. D.
Indiana Law Journal, 81(1), 401–409, 2006.
Full version
DEEP lessons: Enhanced roles for SSAOs
Schuh, J. H., Kuh, G. D., Kinzie, J., & Manning, K.
Leadership Exchange, 4(1), 5–9, 2006.
Engaging legal education: Moving beyond the status quo
Law School Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2006.
Full version
Expectations and engagement: How liberal arts college students compare with counterparts elsewhere
Gonyea, R. M., Kuh, G. D., Kinzie, J., Cruce, T., & Nelson Laird, T. F.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2006.
To learn more about the relationships between students‘ pre-college educational experiences and
their expectations for and experiences in the first college year, we turned to data collected via the newly developed Beginning College Survey of Engagement (BCSSE) and the National Survey of
Student Engagement (NSSE). The BCSSE, a companion instrument to the NSSE, measures entering
students‘ expectations for college (with a focus on participating in educationally purposeful activities). It also collects information about selected high school experiences. The NSSE assesses the extent to which first-year students in college engage in empirically-derived good educational practices and what they gain from their college experience. Thus, we can match entering students‘ responses to the BCSS with their responses to the NSSE at the end of the first year of college to obtain a more accurate picture of what students are like when they start college and what they expect of themselves and their college or university, and compare these responses to what students actually do during their first year of college. A better understanding of these phenomena will be instructive for revising pre-college socialization, orientation, and first-year experience initiatives as well as other efforts designed to enhance student learning and improve persistence and graduation rates. Because the Center of Inquiry in the Liberal Arts at Wabash College is committed to exploring various facets of and promoting liberal arts educational practices and ensuring that the nature of liberal arts education is better understood, we
concentrate on the expectations and experiences of students at baccalaureate liberal arts colleges
compared to students at other types of colleges and universities.
Three central questions guided this analysis:
(1) What do liberal arts college students expect to do during their first year of study in terms
of academic, social and other activities?
(2) How do the expectations of liberal arts college students compare with their experiences
during the first year?
(3) How do the expectations and experiences of liberal arts college students compare with
those of their peers at other types of institutions?
Full version
Increasing student participation in NSSE: Two success stories
Kinzie, J.
Assessment Update, 18(2), 4–6, 2006.
Full version
Independent colleges and student engagement: Do religious affiliation and institutional type matter?
Gonyea, R. M., & Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2006.
This study extends previous work on the relationships between student engagement in spirituality-enhancing activities during college and selected student and institutional variables. Using the same data set and many of the same dependent variables as an analysis performed for the Teagle Foundation, this study for CIC examined more extensively the influence of
institutional variables including multiple categories of religious affiliation, Carnegie classification, and control (public/private). Block hierarchical regression models were used to estimate the relationships between institutional type characteristics and nine dependent variables. Religious affiliation explained the most variance on three dependent variables ? participating in spiritual activities (worship), gains in spiritual development (gnspirit), and gains in ethical development (gnethics). Students at faith-based institutions scored the highest on these dimensions, followed by Roman Catholic and Other Protestant-affiliated institutions. At the same time, students attending non-affiliated, private institutions did not differ in any appreciable way from their public school peers, with both groups generally engaging least often in spiritual activities. Although the effects were not as strong as with religious affiliation, students attending private institutions scored higher than their public school counterparts in certain areas such as participating in spiritual activities, engaging in deep learning, and in self-reported growth in spirituality, ethical development, personal and social development, and intellectual skills. The findings indicate religiously affiliated colleges and universities are not all alike and that there is more to learn about how institutional mission and environments influence student engagement and learning.
Full version
Intercollegiate athletes and effective educational practices: Winning combinations or losing effort?
Umbach, P. D., Palmer, M. M., Kuh, G. D., & Hannah, S. J.
Research in Higher Education, 47, 709–733, 2006.
Make the most of your NSSE data
Kinzie, J.
Leadership Exchange, 5(2), 31–35, 2006.
Making students matter
Kuh, G. D.
In J. C. Burke (Ed.) Fixing the fragmented university: Decentralization with direction Boston, MA: Jossey-Bass, 2006.
Full version
Nonresponse bias in student assessment surveys: A comparison of respondents and non-respondents of the National Survey of Student Engagement at an independent comprehensive Catholic university
McInnis, E. D.
, 2006.
Relationship among structural diversity, informal peer interactions and the perceptions of the campus environment
Pike, G. R., & Kuh, G. D.
The Review of Higher Education, 29(4), 425–450, 2006.
Full version
Spirituality, liberal learning, and college student engagement
Kuh, G. D., & Gonyea, R. M.
Liberal Education, Winter, 40–47, 2006.
Full version
Student engagement and student learning: Testing the linkages
Carini, R. M., Kuh, G. D., & Klein, S. P
Research in Higher Education, 47(1), 1–32, 2006.
Full version
Student success in college: Why it matters and what institutions can do about it
Kuh, G. D., Kinzie, J., Schuh, J. H., & Whitt, E. J.
, , 2006.
Full version
Taking student expectations seriously: A guide for campus applications
Miller, T., Kuh, G. D., Paine, D., & Associates
Washington, DC: National Association of Student Personnel Administrators, 2006.
The convergent and discriminant validity of NSSE scalelet scores
Pike, G. R.
Journal of College Student Development, 47(5), 551–564, 2006.
Full version
Student engagement: A missing link in improving high schools
McCarthy, M. M., & Kuh, G. D
Teachers College Record, , , 2005.
A typology of student engagement for American colleges and universities
Pike, G. R., & Kuh, G. D.
Research in Higher Education, 46(2), 185–209, 2005.
Full version
Measurement and analysis of student engagement in university classes where varying levels of PBL methods of instruction are in use
Ahlfeldt, S., Mehta, S., & Sellnow, T.
Higher Education Research and Development, 24(1), 5–20, 2005.
Full version
“Never let it rest”: Lessons about student success from high performing colleges and universities
Kuh, G. D., Kinzie, J., Schuh, J. H., & Whitt, E. J.
Change: The Magazine of Higher Learning, 37(4), 42–53, 2005.
A time-honored approach to improving effectiveness is to learn what high-performing organizations within a given industry do and then to determine which of their practices are replicable in other settings. A team of 24 researchers coordinated by the National Survey of Student Engagement (NSSE) Institute for Effective Educational Practice at the Indiana University
Center for Postsecondary Research set out to do just that. The Documenting Effective Educational Practices (DEEP) project was a two-year study of 20 four-year colleges and universities that had both higher-than-predicted graduation rates and higher-than-predicted scores on the NSSE. Graduation is increasingly used in accountability and performance systems as an indicator of institutional effectiveness, and student engagement is important because research shows that it's linked to a host of desirable outcomes of college.
Full version
7 steps for taking student learning seriously
Kuh, G. D
Trusteeship, 13(3), 20–24, 2005.
Full version
A comparison of international student and American student engagement in effective educational practices
Zhao, C. M., Kuh, G. D., & Carini, R. M
The Journal of Higher Education, 76(2), 209–231, 2005.
Full version
An approach to measuring cognitive outcomes across higher-education institutions
Klein, S. P., Kuh, G. D., Chun, M., Shavelson, R., & Benjamin, R
Research in Higher Education, 46(3), 251–276, 2005.
Full version
Assessing conditions to enhance educational effectiveness: The inventory for student engagement and success
Kuh, G. D., Kinzie, J., Schuh, J. H., & Whitt, E. J.
San Francisco, CA: Jossey-Bass, 2005.
Experiencing diversity: What can we learn from liberal arts colleges?
Kuh, G. D., & Umbach, P. D
Liberal Education, 91(1), 14–21, 2005.
Full version
Exploring the relationships between spirituality, liberal learning, and college student
Kuh, G. D., & Gonyea, R. M
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Full version
First- and second-generation college students: A comparison of their engagement and intellectual development
Pike, G. R., & Kuh, G. D.
The Journal of Higher Education, 76, 276–300, 2005.
Full version
Imagine asking the client: Using student and alumni surveys in accountability in higher education
Kuh, G. D.
In In J. Burke (Ed.) Achieving accountability in higher education: Balancing public, academic, and market demands. San Francisco, CA: Jossey-Bass, 2005.
Institutional selectivity and good practices in undergraduate education: How strong is the link?
Pascarella, E. T., Cruce, T., Wolniak, G. C., Kuh, G. D., Umbach, P. D., Hayek, J. C., Carini, R. M., Gonyea, R. M., & Zhao, C. M.
The Journal of Higher Education, 77(2), 251–285, 2005.
Full version
Promoting student success: Creating conditions so every student can learn
Chickering, A. W., & Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Accommodating diverse learning styles of students has long been espoused as a principle of good practice in undergraduate education. Much progress has been made during the past
two decades in using active, collaborative, and problem-based learning, learning communities,
student-faculty research, service learning, internships, and other pedagogical innovations to enrich student learning. Variable time
blocks are more common--from three hours, to all day, to weekends, to six or eight weeks--to fit the desired outcomes, content, and
processes. Peers tutor other students, deepening their own learning in the process. Increasingly
sophisticated communication and information technologies provide students access to a broad range of print and visual resources and to an
expanded range of human expertise. A wider range of assessment tools document what and how well students are learning. Despite all this activity, at too many schools these and other effective educational practices are underutilized. The suggestions offered here are drawn in large part from a study of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and, through the National Survey of Student Engagement, demonstrated that they have effective practices for fostering success among students of differing abilities and aspirations. These institutions clearly communicate that they value high quality undergraduate teaching and learning. They have developed instructional approaches tailored to a wide range of student learning styles, ensuring that students engage with course content and interact in meaningful ways with faculty and peers, inside and outside the classroom.
Full version
Promoting student success: Making place matter to student success
Manning, K., & Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Some campuses have a ?special? feel
about them. Students are quick to mention that they cannot imagine a better place for them personally or--for that matter--any better setting for a college or university. The college has become their home away
from home, the place they‘d rather be than any other. Generations of graduates return for reunion weekends, passing through familiar buildings and pausing at favorite
spots that evoke fond recollections of what was a very meaningful time in their lives. Built structures and memories are inextricably intertwined to form deep emotional ties to the institution and to those with whom they shared this place. Colleges and universities with such a palpable sense of place also have salutary
effects on student success. In a uniquely human way, this powerful connection to something larger than oneself encourages students to engage with faculty, staff, and peers in meaningful ways and compels
graduates to give back to alma mater by contributing their time, talents, and resources. Administrators at other colleges long to understand and create the conditions that bond people so tightly to the institution and to one another during and after graduation.
Full version
Promoting student success: Small steps senior administrators can take
El Khawas, E.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Colleges and universities can increase the number of students who graduate by making a number of small, strategic changes in institutional policies and practices. Some schools have done this by focusing on effective educational practices and empowering faculty, staff and students to work together in new,
productive ways. Others have improved the campus climate for learning by carefully assessing what students are experiencing or by realigning resources to induce students to
participate in activities associated with persistence and other desired outcomes of college. Senior administrators play a key role in such efforts when they speak plainly and consistently about the importance of student success and make decisions congruent with this priority. The suggestions offered here are drawn from a study of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and, through the National
Survey of Student Engagement (NSSE),
demonstrated that they have effective practices for fostering success among students of differing abilities and aspirations. These institutions--called DEEP schools here because
they were studied for the project on
Documenting Effective Educational Practices--clearly communicate that they value high quality undergraduate teaching and learning, and provide effective, well-linked academic
and support services. Despite constraints, they have found ways to create supportive learning
environments, ensuring that students engage with course content, faculty and peers, inside and outside the classroom.
Full version
Promoting student success: The importance of shared leadership and collaboration
Kezar, A.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Collaborative, shared leadership among administrators, students,
faculty, and staff is a key component to creating campus environments that foster student success. Collaborative work groups can be powerful vehicles for launching and institutionalizing
student-friendly policies and practices and for developing complementary programs such as
first-year initiatives, fresh approaches to general education curricular offerings, service-
learning, and student leadership development programs among others. Such initiatives almost always result in richer learning opportunities for students when done collaboratively than when an individual unit
develops them. But collaborative approaches to leadership and
program development do not come naturally within higher education institutions that reward
individualistic endeavors over collaboration. The guiding principles offered here for promoting shared leadership and collaboration are based on an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and, as demonstrated through the National
Survey of Student Engagement (NSSE),
effective policies and practices for engaging their students.
Full version
Promoting student success: Using financial and other resources to enhance student success
Jacobs, B. A., & Schuh, J. H.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Howard Bowen (1996) wryly observed decades ago that colleges and universities raise all the money they can, and then they spend it. His point was that institutions have more good ideas than they can fully fund. As a consequence, they are constantly making choices as to how to best use their finite resources. Where and
how resources are allocated reflect
institutional priorities ideally guided by a deliberate planning process that values and supports student success. The principles that follow for using financial and other resources to enhance student learning are based on an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and, as
demonstrated through the National Survey of Student Engagement (NSSE), effective policies and practices for engaging their students. These institutions illustrate that it
is not necessarily the amount
of resources an institution allocates that is important to student success but how financial
resources, faculty and staff time, and facilities are linked to create powerful, affirming learning environments.
Full version
Promoting student success: What accreditation teams can do
Griego, E.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
The process of accreditation review in the U.S. serves two primary functions: quality assurance and continual improvement. The
experienced educators who voluntarily serve on accreditation teams apply common standards of quality that serve students and meet public
accountability expectations and offer
suggestions and recommendations for
institutional consideration and improvement. In the last decade, regional accreditation
commissions and national professional and specialized accreditation agencies have increasingly focused on student learning results and institutional improvement. There has been a corresponding shift in focus from institutional resources, structures, and inputs as the primary
indicators of institutional quality, toward increased emphasis on student learning results, appropriate to the degree level and mission of the institution. Accreditation review team reports are rich sources for examples of institutional practices that engage student learning. What have not been readily available
to accreditation teams, however, are
compilations of examples of good institutional practice. The suggestions offered here are drawn in large part from a study of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and, through the
National Survey of Student Engagement, demonstrated that they have effective practices for fostering success among students of
differing abilities and aspirations. These institutions?called DEEP schools here because they were studied for the project on Documenting Effective Educational
Practices?clearly communicate that they value high quality undergraduate teaching and learning.
Full version
Promoting student success: What advisors can do
De Sousa, D. J.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Students who are well prepared academically and highly motivated tend to do well in college and persist to graduation. But for various reasons?some of which are beyond their control?many students lack the requisite academic background for college-level work. As a result, most colleges and universities enroll students with a wide range of abilities. Some of these institutions are more effective than others in helping their students succeed in college. These schools recognize that in terms of learning and personal development, what students bring to college is less important than what they do when they get to college. Academic advisors can play an integral role in promoting student success by assisting students in ways that encourage them to engage in the right kinds of activities, inside and outside the classroom. Advisors are especially important because they are among the first people new students encounter and
should see regularly during their first year. The guiding principles offered here are based on an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and demonstrated through the National Survey of Student Engagement (NSSE) that they have effective policies and practices for working with students of differing abilities and aspirations. These institutions are referred to below as either educationally effective schools or high-performing institutions.
Full version
Promoting student success: What business leaders can do
Lovett, C. M.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
More than any other group of
stakeholders, business leaders are
aware that this country‘s ability to
remain competitive in a global,
technology-based economy is ever
more closely tied to its ability to
produce more and better prepared
college graduates. Graduating more
students from various backgrounds who
are well prepared to meet the social,
civic and economic challenges of the
future is a national priority. Every college and university can improve its graduation rates and enhance the quality of its undergraduate programs by creating the conditions that matter to student success. Decades of research studies show that student engagement--the time and effort that students devote to their studies and related activities--is a key factor in student success. The
Documenting Effective Educational
Practice (DEEP) project gathered data
from 20 very different institutions of higher learning whose student scores on the National Survey of Student Engagement (NSSE) were higher than what was predicted on the basis of their student and institutional profile, history, and other factors.
Full version
Promoting student success: What campus leaders can do
Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Graduating more students and increasing the quality of their learning are national priorities. Every college and university can
improve in these areas by focusing on the educational conditions that matter to student success. Decades of research studies show that a key factor is student engagement--the time
and effort students devote to their studies and related activities and how institutions organize learning opportunities and provide services to
induce students to take part in and benefit from such activities. The guiding principles offered here are based on an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and
demonstrated through the National Survey of Student Engagement (NSSE) that they have effective policies and practices for working with students of differing abilities and aspirations. These institutions value high quality undergraduate teaching, diversity and support for all students. They clearly communicate and hold students to high standards, provide timely feedback, and encourage students to actively engage with course content and faculty and peers, inside and outside the classroom. When they complement the institution‘s mission and values, these conditions can create powerful learning environments that lead to desirable learning outcomes that are generally independent of institutional resources or students‘ background.
Full version
Promoting student success: What department chairs can do
Schuh, J. H., & Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Department chairs are in a position to help shape a culture where student learning is the central focus of faculty, staff, and students (Gmelch & Schuh, 2004). They hire, socialize, and evaluate faculty members‘ performance, guide curriculum development, and maintain the quality of academic programs. At the same time, department chairs typically assume the role without any specific preparation for the position; many have little or no experience as academic administrators. Yet, they are expected to lead their peers in establishing and implementing departmental goals and objectives. If improving educational effectiveness and enhancing student learning are priorities, what should the department chair emphasize? The suggestions offered here are based on
an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and higher-than-predicted scores on the National Survey of Student Engagement (NSSE). Taken together, these measures suggest that their policies, programs, practices, and campus climates challenge and support students of differing abilities
and aspirations. How might these ideas be applied to your department?
Full version
Promoting student success: What faculty members can do
Kinzie, J.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
What students do in college matters as much as anything else in terms of their educational success. Educationally effective colleges and universities--those that add value
to the student experience--intentionally craft policies and practices that channel students‘
energy to the activities that matter to student learning. Students who participate in collaborative learning activities such as service-learning, coherent first-year programs, peer
tutoring and senior capstone projects are more likely to persist and succeed--especially when these programs and practices are well
conceived and delivered in an effective, coordinated manner. An essential ingredient is an unwavering, widespread commitment to
enhancing student learning on the part of faculty members. The suggestions offered here are based on an in-depth examination of 20 diverse four-year colleges and universities that have higher-than-predicted graduation rates and demonstrated
through the National Survey of Student Engagement (NSSE) that they have effective policies and practices for working with students of differing abilities and aspirations. These institutions value high quality undergraduate teaching, diversity, and support for all students. They clearly communicate and hold students to high standards, provide timely feedback, and encourage students to actively engage with course content, faculty and peers, inside and outside the classroom. When they complement
the institution‘s mission and values, these conditions can create powerful learning environments that lead to desirable learning outcomes that are generally independent of institutional resources or students‘ background.
Full version
Promoting student success: What new faculty need to know
Cambridge, B. L.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Starting a new position is exhilarating. The key challenge is to make the strange familiar as soon as possible. There are new policies to learn, new colleagues to get to
know, and new surroundings to adapt to. All these aspects and more need to be understood and managed well in order to focus on the primary task at hand--teaching and learning. Of all that is new, to what should you attend first if you are committed to creating the conditions under which students learn best? How can you use your institution‘s resources to help
your students take advantage of opportunities to deepen their learning? The suggestions offered here are based on an in-depth examination of 20 diverse four-year colleges and universities that have
higher-than-predicted graduation rates and demonstrated through the National Survey of Student Engagement (NSSE) that they have effective policies and practices for working with students of differing abilities
and aspirations. Consider adapting some of their approaches to assist new faculty at your institution.
Full version
Promoting student success: What SHEEOs and system heads can do
Ewell, P. T.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
States benefit considerably when their stocks of ?educational capital? grow. From a workforce and tax revenue standpoint, state rates of return on baccalaureate education are
far higher than those associated with any other educational step. Additional benefits attributable to higher education?ranging from
enhancements in citizen participation to improved health and avoidance of public support?are equally easy to document. It is, thus, in every state‘s interest to increase the numbers of its citizens who attain a
baccalaureate degree. And it is equally in every state‘s interest to ensure that those who do earn a degree have experienced the kind of
high quality learning environments that yield levels of knowledge and skills that are nationally and internationally competitive. Every college and university can improve its graduation rates and enhance the quality of its undergraduate programs by creating the conditions that matter to student success. Decades of research studies show that one key
factor is student engagement?the time and effort that students devote to their studies and related activities. Institutions can organize their classes and other learning opportunities so that students put more effort in and benefit more from such activities. SHEEOs and
System Heads can do their part by ensuring that matters of undergraduate quality and student
success remain central to the state‘s approaches to planning, resource allocation, and accountability. And while their direct responsibility remains largely confined to public institutions, they can increasingly
establish policies that affect independent institutions as well.
Full version
Promoting student success: What student affairs can do
Whitt, E. J.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Interest in creating the conditions that enhance student learning and support students in achieving their educational goals is at an all-time high. Four-fifths of high school graduates need some form of postsecondary education to acquire the knowledge, skills, and competencies necessary to address increasingly complex social, economic, and political issues. Student engagement--what students
do during college--generally matters more to what they learn and whether they persist to graduation than who they are or even where they go to college. The contribution of out-of-class experiences to student engagement cannot be overstated. Any institution that wishes to make student achievement, satisfaction,
persistence, and learning a priority must have competent student affairs
professionals whose contributions
complement the academic mission of the institution in ways that help students and the institution realize their goals. The ?lessons‘ for student affairs practice offered here are based on an in-depth
examination of 20 four-year colleges and universities that have higher-than-predicted graduation rates and, as demonstrated through the National Survey of Student Engagement (NSSE), effective policies and practices for engaging their students.
Full version
Promoting student success: What student leaders can do
Magolda, P.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Student leaders reap many benefits and rewards as a result of their involvements with campus organizations. In addition to enjoying
the respect of their peers, they have
opportunities to meet a variety of faculty, staff and students, exposing them to a range of different personalities and cultures. They
typically grow in self confidence and practical competence as they learn how to manage their time, energy, and their group‘s financial resources. In addition, the challenges they
encounter in the course of these and other activities draw them out of their comfortable patterns of thinking and responding to situations, helping them to become more flexible, responsive, and reflective (Kuh, 1995; Kuh & Lund, 1994). In addition to these personal benefits, student leaders can contribute much to the quality of the learning environment, the experiences of their peers, and the larger campus community. Unfortunately, too often these potentially positive effects are not fully realized. Student
governments get sidetracked on trivial issues. Social organizations inadvertently discourage participation by students from diverse backgrounds. Service clubs touch in relevant ways only a small fraction of those who need assistance. Established campus governance structures ignore or limit active, meaningful involvement by students.
Full version
Promoting student success: What the media and the general public need to know
Kuh, G. D., & Kinzie, J.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
After several years of intense public focus on the need to improve K-12 education, more attention has turned recently to what happens when high school graduates move on to college.
Students, parents, and lawmakers are asking whether undergraduates are getting adequate value for their investments of time and money,
particularly as college and university tuition keeps rising. Employers are expressing concern
about whether some graduates are adequately prepared for the world of work. Demographic pressures in some states also mean that institutions have to find places for more students, even though state appropriations to many
public institutions have been cut or are barely increasing. In addition, legislators and policy experts are pressing institutions to make it possible for students to complete degree
requirements in a reasonable period of time and worry that significant dropout rates at some colleges and universities may reflect a waste of
public resources spent on those students.
Full version
Putting student engagement results to use: Lessons from the field
Kuh, G. D
Assessment Update, 17(1), 12–13, 2005.
Full version
Searching for the Peach Blossom Shangri-La: Student engagement of men and women STEM majors
Zhao, C.-M., Carini, R. M., & Kuh, G. D.
The Review of Higher Education, 28, 503–525, 2005.
Full version
Self-reported data in institutional research: Review and recommendations
Gonyea, R. M.
New Directions for Institutional Research, 2005(127), 73–90, 2005.
Seven steps for taking student learning seriously
Kuh, G. D.
Trusteeship, May/June, 20–24, 2005.
Full version
Student engagement at minority-serving institutions: Emerging lessons from the BEAMS project
Bridges, B. K., Cambridge, B., Kuh, G. D., & Leegwater, L. H
In G. H. Gaither (Ed.), What works: Achieving success in minority retention , 2005.
Full version
Student experiences with information technology and their relationship to other aspects of student engagement
Nelson Laird, T. F., & Kuh, G. D
Research in Higher Education, 46(2), 211–233, 2005.
Full version
Student success in college: Creating conditions that matter
Kuh, G. D., Kinzie, J., Schuh, J. H., Whitt, E. J., & Associates
San Francisco, CA: Jossey-Bass, 2005.
The law school years: Probing questions, actionable data
Law School Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2005.
Full version
What students expect from college and what they get
Kuh, G. D., Gonyea, R. M., & Williams, J. M.
In In T. E. Miller, B. E. Bender, J. H. Schuh Associates (Eds.) Promoting reasonable expectations: Aligning student and institutional views of the college experience San Francisco, CA: , 2005.
A study of resource expenditures and allocation at DEEP colleges and universities: Is spending related to student engagement?
Gansemer-Topf, A., Saunders, K., Schuh, J., & Shelley, M
, , 2004.
Full version
Disengaged jocks: Myth or reality?
Umbach, P. D., & Kuh, G. D.
LiberalArtsOnline, 4(4), , 2004.
Full version
"Surfin" with a purpose: Examining how spending time online is related to student engagement
Nelson Laird, T. F.
Students Affairs Online, 5(3), , 2004.
Full version
Adding value: Learning communities and student engagement
Zhao, C., & Kuh, G. D.
Research in Higher Education, 45, 115–138, 2004.
Full version
Aligning faculty and student behavior: Realizing the promise of greater expectations
Kuh, G. D., Nelson Laird, T. F., & Umbach, P. D.
Liberal Education, 90(4), 24–31, 2004.
Full version
College and character: Insights from the National Survey of Student Engagement
Kuh, G. D., & Umbach, P.
New Directions for Institutional Research, 2004(122), 37–54, 2004.
Full version
Do DEEP institutions spend more or differently than their peers?
National Center for Higher Education Management Systems [NCHEMS]
, , 2004.
Full version
Forging a new direction: How UTEP created its own brand of excellence
Kuh, G. D., & Natalicio, D. S.
About Campus, 9(5), 9–15, 2004.
Full version
Gender differences in student engagement among African American undergraduates at Historically Black Colleges and Universities
Harper, S. R., Carini, R. M., Bridges, B. K., & Hayek, J.
Journal of College Student Development, 45(3), 271–284, 2004.
Full version
Going DEEP: Learning from campuses that share responsibility for student success
Kinzie, J., & Kuh, G. D.
About Campus, 9(5), 2–8, 2004.
Full version
Principles for assessing student engagement in the first year of college
Hayek, J. C., & Kuh, G. D.
Assessment Update, 16(2), 11–13, 2004.
Full version
Quality time: An in-depth look at the National Survey of Student Engagement
Kuh, G. D., & Hayek, J. C
Currents, 30(9), 11–12, 2004.
Student engagement in law schools: A first look
Law School Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2004.
Full version
Student engagement: Pathways to collegiate success
National Survey of Student Engagement
Indiana University Center for Postsecondary Research.Bloomington, IN: , 2004.
The contributions of the research university to assessment and innovation in undergraduate education
Kuh, G. D.
W. E. Becker & M. L. Andrews (Eds.)The scholarship of teaching and learning in higher education: The contributions of research universities Bloomington, IN: Indiana University Press, 2004.
Using focus groups to establish the validity and reliability of a college student survey
Ouimet, J. A., Bunnage, J. B., Carini, R. M., Kuh, G. D., & Kennedy, J.
Research in Higher Education, 45, 233–250, 2004.
Full version
What does institutional selectivity tell us about educational quality?
Kuh, G. D., & Pascarella, E. T
Change: The Magazine of Higher Learning, 36(5), 52–58, 2004.
Full version
Nontraditional college students and the role of collaborative learning as a tool for science mastery
Lundberg, C. A.
School Science and Mathematics, 103(1), 8–17, 2003.
Active learning in and out of the classroom: Results from the National Survey of Student Engagement
Belcheir, M. J.
(Report No. BSU-RR-2003-02), , 2003.
Full version
College student responses to web and paper surveys: Does mode matter?
Carini, R. M., Hayek, J. H., Kuh, G. D., Kennedy, J. M., & Ouimet, J. A.
Research in Higher Education, 44(1), 1–19, 2003.
Full version
Cooperative college examinations: More gain, less pain when students share information and grades
Zimbardo, P. G., Butler, L.D., & Wolfe, V. A.
The Journal of Experimental Education, 71 (2) 101-125, , 2003.
Diversity experiences and college student learning and personal development
Hu, S., & Kuh, G. D.
Journal of College Student Development, 44(3), 320–332, 2003.
How are we doing at engaging students? Charles Schroeder talks to George Kuh
Schroeder, C. C., & Kuh, G. D.
About Campus, 8(2), 9–16, 2003.
Full version
Student academic and personal growth while at Boise State: A summary of 2002 National Survey of Student Engagement findings
Belcheir, M. J.
(Report No. BSU-RR-2003-03)., , 2003.
Full version
The campus environment as viewed through the lens of the National Survey of Student Engagement
Belcheir, M. J.
(Report No. BSU-RR-203-01)Boise, ID: Office of Institutional Advancement, 2003.
Full version
The campus visit
Kuh, G. D.
New York, NY: Kaplan, 2003.
The relationship between institutional mission and students’ involvement and educational outcomes
Pike, G. R., Kuh, G. D., & Gonyea, R. M
Research in Higher Education, 44(2), 241–261, 2003.
Full version
The role of the academic library in promoting student engagement in learning
Kuh, G. D., & Gonyea, R. M
College and Research Libraries, 64, 256–282, 2003.
Full version
Tomorrow's teachers: Do they engage in the "right things" during college?
Carini, R. M., & Kuh, G. D.
Phi Delta Kappan, 84(5), 391–398, 2003.
Utilizing the classroom peer group to address children's social needs: An evaluation of the circle of friends intervention approach
Fredrickson, N. & Turner, J.
Journal of Special Education, 36 (4), 234-245, , 2003.
Warts and all: Exposing history to high school students
Stanley, G.
Educational Horizons, 81 (2) 86-91., , 2003.
What we’re learning about student engagement from NSSE
Kuh, G. D
Change: The Magazine of Higher Learning, 35(2), 24–32, 2003.
For years, judgments about the quality of the undergraduate experience have turned on evidence about an institution‘s reputation and resources?students‘ SAT scores, faculty credentials, library holdings, and so on. But students can be surrounded by impressive resources and not routinely encounter classes or take part in activities that engage them in authentic learning. A more meaningful approach to evaluating an institution is to determine how well it fosters student learning. The National Survey of Student Engagement (NSSE) was launched upon the premise that to assess the quality of the undergraduate education at an institution, we need good information about student engagement. This article outlines NSSE‘s evolution, summarizes some of what has been learned so far about engagement patterns of different groups of students, and discusses some of the questions and challenges the NSSE results raise.
Full version
Working and learning: The role of involvement for employed students
Lundberg, C. A.
Ashe National Conference, Sacramento, , 2002.
A profile of Boise State first year and senior students with comparisons to other urban universities
Belcheir, M. J.
Research Report 2002-07. (ERIC ED480930), 2002.
Disciplinary differences and undergraduates' information-seeking behavior
Whitmire, E.
Journal of American Society for Information Science and Technology, 53 (8) 631-638, , 2002.
Kuh, G. D.
Bloomington, IN: The Diversity Education & Exchange Program, 2002.
Kuh, G. D.
Wabash College Colloquium Address, Crawfordsville, IN, 2002.
Academic advising and student success: Lessons from NSSE
Kuh, G. D.
Bloomington, IN: Indiana University, 2002.
Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2002.
Kuh, G. D.
Bloomington, IN: Indiana University Center for Postsecondary Research, 2002.
Being (dis)engaged in educationally purposeful activities: The influence of student and institutional characteristics
Hu, S., & Kuh, G. D
Research in Higher Education, 43(5), 555–576, 2002.
Full version
Comparing the academic engagement of American Indian and White college students
Cole, J. S., & Denzine, G. M.
Journal of American Indiana Education, 41(1), 19–34, 2002.
Higher education's self-reflexive turn: Toward an intercultural theory of student development
Tanaka, G.
The Journal of Higher Education, 73 (2) 263-296, , 2002.
Insights into effective educational practice
Hayek, J. C., & Kuh, G. D.
EDUCAUSE Quarterly, 25(1), 60–61, 2002.
Full version
The impact of college racial composition on African American students' academic and social gains: Additional evidence
Flowers, L. A.
Journal of College Student Development, 43(3), 403–410, 2002.
Triumph or tragedy: Comparing student engagement levels of members of Greek-letter organizations and other students
Hayek, J. C., Carini, R. M., O?Day, P. T., & Kuh, G. D
Journal of College Student Development, 43(5), 643–663, 2002.
Full version
The National Survey of Student Engagement
Bridges, B. K., Kuh, G. D., & O'Day, P.
NetResults, , , 2001.
Full version
The College Student Expectations Questionnaire: Assessing student expectations of their college education [14 paragraphs in online-series]
Gonyea, R. M.
FYA-List Series, , , 2001.
Undergraduate education at the turn of the century: Lessons from NSSE 2000
Kuh, G. D.
College of William & Mary Higher Education Lecture, Williamsburg, VA, 2001.
A longitudinal assessment of college student engagement in good practices in undergraduate education
Kojaltic, M., & Kuh, G. D.
Higher Education, 42, 351–371, 2001.
A report on the National Survey of Student Engagement
Whitfield, C. E.
, , 2001.
Full version
Assessing what really matters to student learning: Inside the National Survey of Student Engagement
Kuh, G. D.
Change: The Magazine of Higher Learning, 33(3), 10–17, 66, 2001.
This article describes the National Survey of Student Engagement (NSSE), one of the scores of efforts underway to assess student learning and improve the quality of undergraduate education, after the release of the project‘s first national report NSSE 2000: National Benchmarks of Effective Educational Practice and while the second round of data collection was nearing an end.
Full version
Computing experience and good practices in undergraduate education: Does the degree of campus "wiredness" matter?
Shouping, H. & Kuh, G.D.
Education Policy Analysis Archives v9 n49, , 2001.
Influences of student goals for college for freshman-year quality of effort and growth
Kaufman, M. A., & Creamer, D. G.
Journal of College Student Development, 32(3), 197–206, 2001.
Is it more than about getting along? The broader educational relevance of reducing students' racial biases
Chang, M.J.
Journal of College Student Development, 42 (2), 93-105, , 2001.
Learning productivity at research universities
Kuh, G. D., & Hu, S.
The Journal of Higher Education, 72(1), 1–28, 2001.
NSSE technical and norms report
Kuh, G. D., Hayek, J. C., Carini, R. M., Ouimet, J.A., Gonyea, R. M., & Kennedy, J.
, , 2001.
Full version
The disengaged commuter student: Fact or fiction?
Kuh, G. D., Gonyea, R. M., & Palmer, M
Commuter Perspectives, 27(1), 2–5, 2001.
Full version
The effects of student-faculty interaction in the 1990s
Kuh, G. D., & Hu, S.
The Review of Higher Education, 24, 309–332, 2001.
The fulfillment of expectations for college and student departure decisions
Helland, P. A., Stallings, H. J., et al.
Journal of College Student Retention, 3(4), 381–396, 2001.
The National Survey of Student Engagement: Conceptual framework and overview of psychometric properties
Kuh, G. D
, , 2001.
Full version
The relationship between undergraduate students' perceived past academic success and perceived academic self-concept
Schlosser, L. Z., & Sedlacek, W. E.
The Journal of the First-Year Experience and Students in Transition, 13(2), 95–105, 2001.
The relationship between undergrads’' background characteristics an college experiences and their academic library use
Whitmite, E.
College & Research Libraries, 62 (6) 528-540, , 2001.
The relationships between computer and information technology use, student learning, and other college experiences
Kuh, G. D., & Hu, S.
Journal of College Student Development, 42(3), 217–232, 2001.
Tools for assessing the first-year student experience
Kuh, G. D.
In R. Swing (Ed.) Proving and improving: Strategies for assessing the first college year Columbia, SC: University of South Carolina, National Resource Center for the First-Year Experience and Students in Transition, 2001.
What predicts perceived gains in learning and in satisfaction?
Belcheir, M. J.
(Report No. BSU-RR-2001-02), , 2001.
Full version
"They shall be known by what they do": An activities-based typology of college students
Kuh, G. D., Hu, S., & Vesper, N.
Journal of College Student Development, 41(2), 228–244, 2000.
Faculty-student affairs collaboration on assessment: Lessons from the field
Kuh, G. D., & Banta, T. W.
About Campus, 4(6), 4-11, 2000.
Improving classroom instruction through "best-of-class" techniques
Blackbourn, J.M., Payne, J.S., Burnham, S., Elrod, F., & Thomas, C.
Journal of Instructional Psychology, 27, , 2000.
The National Survey of Student Engagement: Results from Boise State freshmen and seniors (Report No. BSU-RR-2000-04)
Belcheir, M. J.
Boise, ID: Office of Institutional Advancement: Office of Institutional Advancement, 2000.
Full version
The NSSE 2000 report: National benchmarks of effective educational practice
National Survey of Student Engagement
Bloomington, IN: Indiana University Center for Postsecondary Research, 2000.
Where are the liberal arts?
Pace, C. R., & Connolly, M.
Research in Higher Education, 41(1), 53–65, 2000.
Impact of the number of response categories on frequency scales: An examination of information obtained, reliability, and factor structure
Weems, G.H.
Annual Meeting of the Mid-South Educational Research Association, Point Clear, Alabama, , 1999.
Another look at the fourth edition of the CSEQ
Kuh, G. D.
Assessment Update, 11(2), 13, 16, 1999.
Cognitive effects of college racial composition on African American students after 3 years of college
Flowers, L. & Pascarella, E.T.
Journal of College Student Development, 40 (6), 669-677, , 1999.
Gender, race, and performance expectations of college students
Mayo, M. W., & Christenfeld, N.
Journal of Multicultural Counseling and Development, 27(2), 93–104, 1999.
Increasing expectations for student effort
Schilling, K. M., & Schilling, K. L.
About Campus, 4(2), 4–10, 1999.
Interactions with peers and objective and self-reported cognitive outcomes across 3 years of college
Whitt, E. J., Edison, M., Pascarella, E.T., Nora, A. & Terenzini, P.T.
Journal of College Student Development, 40 (1) 61-78, , 1999.
Racial differences in the academic library experiences of undergraduates
Whitmire, E.
Journal of Academic Librarianship, 25(1), 33-37, 1999.
Setting the bar high to promote student learning
Kuh, G. D.
In G. S. Blimling, E. J. Whitt, & Associates (Eds.) Good practice in student affairs: Principles to foster student learning San Francisco, CA: Jossey-Bass, 1999.
Solving for the x: Aspirations and expectations of college students
Eskilson, A., & Wiley, M. G.
Journal of Youth and Adolescence, 28(1), 51–70, 1999.
The effects of entering characteristics and instructional experiences on student satisfaction and degree completion: An application of the input-environment-outcome assessment model
House, J.
International Journal of Instructional Media 26 no4 423-34, , 1999.
Unraveling the complexity of the increase in college grades from the mid-1980s to the mid-1990s
Kuh, G. D., & Hu, S.
Educational Evaluation and Policy Analysis, 21(3), 1–24, 1999.
Will higher education make a difference? African Americans’ economic expectations and college choice
Freeman, K.
College and University, 75(2), 7–12, 1999.
Women's perceptions of a "chilly climate" and cognitive outcomes in college: Additional evidence
Whitt, E. J., Edison, M. I., Pascarella, E. T., Nora, A., & Terenzini, P. T.
Journal of College Student Development, 40(2), 163–177, 1999.
The constant error of the halo in educational outcomes research
Pike, G. R.
Associtaion for Institional Research, Minneapolis, MN, , 1998.
Student expectations of, and satisfaction with, the university library
Harwood, N. & Bydder, J.
The Journal of Academic Librarianship, 24 (2) 161-171, , 1998.
Development of critical thinking skills: An analysis of academic library experiences and other measures
Whitmire, E.
College & Research Libraries, 59(3), 266–273, 1998.
Does work inhibit cognitive development during college?
Pascarella, E. T., Edison, M. I., Nora, A., Hagedorn, L, S., & Terenzini, P. T.
Educational Evaluation and Policy Analysis, 20(2), 75–93, 1998.
Gender-based differences in perception of experiences in higher education: Gaining a broader perspective
Drew, T. L., & Work, G. G.
The Journal of Higher Education, 69(5), 542–555, 1998.
Shaping student character
Kuh, G. D.
Liberal Education, 84(3), 18–25, 1998.
A comparison of student experiences with good practices in undergraduate education between 1990 and 1994
Kuh, G. D., & Vesper, N.
The Review of Higher Education, 21(1), 43–61, 1997.
A factor analytic model of college student development
Lavelle, E., & Rickord, B.
NASPA Journal, 36(4), 301–315, 1997.
African American men on college campuses: Their needs and their perceptions
Cuyjet, M. J.
New Directions for Student Services, 80, 5–16, 1997.
Engaging students in active learning
Warren, R.
About Campus, 2(1), 16–20, 1997.
Identifying indicators of curricular quality
Ewell, P. T.
Handbook of the undergraduate curriculum San Francisco, CA: Jossey-Bass, 1997.
Organizing for learning - a new imperative
Ewell, P.T.
AAHE Bulletin, , 1997.
Strengthening assessment for academic quality improvement
Ewell, P. T.
In M. W. Peterson, D. D. Dill, L. A. Mets, & Associates Planning and management for a changing environment San Francisco, CA: Jossey-Bass, 1997.
The "chilly climate" for women and cognitive outcomes in the first year of college
Pascarella, E. T., Whitt, E. J., Edison, M. I., Hagedorn, L. S. Nora, A., Yeager, P., & Terenzini, P. T.
Journal of College Student Development, 38(2), 109-124, 1997.
The development of process indicators to estimate student gains associated with good practices in undergraduate education
Kuh, G. D., Pace, C. R., & Vesper, N.
Research in Higher Education, 38(4), 435-454, 1997.
The relations of Holland-typed majors to students' freshman and senior work values
Huang, Y. R., & Healy, C. C.
Research in Higher Education, 38(4), 455-477, 1997.
Using process indicators to estimate student gains associated with good practices in undergraduate education
Kuh, G. D., Vesper, N., & Pace, C. R.
Research in Higher Education, 38, 435–454, 1997.
Additional evidence on the cognitive effects of college racial composition: A research note
Pascarella, E., Edison, M., Nora, A., Hagedorn, L. S., & Terenzini, P.
Journal of College Student Development, 37 (5) 494-501., , 1996.
Assessing student involvement in learning
Froh, R. C.
Using scholarships to improve practice San Francisco, CA: Jossey-Bass, 1996.
Assessment in practice: Putting principles to work on college campuses
Banta, T. W., Lund, J. P., Black, K. E., & Oblander, F. W. (Eds.).
San Francisco, CA: Jossey-Bass, 1996.
Collaboration between general education and the major
Saint Joseph College
Assessment Update, 8(2), , 1996.
Differential impacts of academic and social experiences of college-related outcomes across different ethnic and gender groups at four-year institutions
Nora, A., Cabrerra, A., Hagedorn, L., & Pascarella, E.
Research in Higher Education, 37(4), 427-451, 1996.
Does institutional racial composition make a difference in what Black students gain from college?
DeSousa, D. J., & Kuh, G. D.
Journal of College Student Development, 37(3), 257–267, 1996.
Editor's notes: Bob Pace tells us what students do while in college
Banta, T. W.
Assessment Update, 8(1), 3, 13, 1996.
First-generation college students: Characteristics, experiences and cognitive development
Terenzini, P., Springer, L., Yeager, P., Pascarella, E., & Nora, L.
Research in Higher Education, 37(1), 1-22, 1996.
Gender differences among incoming African American freshmen on academic and social expectations
Kim, S. H., & Sedlacek, W. E.
Journal of the Freshman Year Experience and Students in Transition, 8(1), 25-37, 1996.
How standards-based high school assessment can affect admission to colleges and universities
Griffith, F. A.
Progress, Trends, and Practices in Higher Education, 8 (1), 1-15, , 1996.
Influences on students' internal locus of attribution for academic success in the first year of college
Pascarella, E., & Edison, M.
Research in Higher Education, 37(6), 731–756, 1996.
Influences on students' openness to diversity and challenge in the first year of college
Pascarella, E., & Edison, M.
The Journal of Higher Education, 67(2), 174–195, 1996.
Limitation of using students' self-reports of academic development as proxies for traditional achievement measures
Pike, G. R.
Research in Higher Education, 37(1), 89-113, 1996.
Participation in a racial or cultural awareness workshop and attitudes toward diversity on campus
Springer, L., Palmer, B., Terenzini, P. T., Pascarella, E. T., & Nora, A.
The Review of Higher Education, 20(1), 53–68, 1996.
Relationship between learner attitudes, prior achievement, and performance in a general education course: A multi-institutional study
House, J.D., Keely, E.J., & Hurst, R.S.
International Journal of Institutional Media, 23 (3), 257-271, , 1996.
Resetting expectations
Marchese, T.
Change, pg. 4, , 1996.
Residence hall social climates and student learning
Kerr, K. G.
, , 1996.
The influence of dominant race environment on students' involvement, perceptions, and educational gains: A look at Historically Black and Predominantly White liberal arts institutions
Watson, L. W., & Kuh, G. D.
Journal of College Student Development, 37(4), 415–424, 1996.
What have we learned from the first year of the national study of student learning?
Pascarella, E. T., Whitt, E., Nora, A., Edison, M., Hagedorn, & Terenzini, P. T.
Journal of College Student Development, 37(2), 182-192, 1996.
Academic and out-of-class influences affecting the development of students' intellectual orientations
Terenzini, P., Springer, L., Pascarella, E., & Nora, A.
The Review of Higher Education, 19, 28-44, 1995.
Assessing the immediate and residual effects of the residence hall experience: Validating Pace's 1990 analysis of on-campus and off-campus students
Ballou, R. A., Reavill, L. K., & Schultz, B. L.
Journal of College and University Housing, 25(1), 16-21, 1995.
Expectations for college and student persistence
Braxton, J. M., Vesper, N., et al.
Research in Higher Education, 36(5), 595–612, 1995.
Freshman to senior year gains reported on the college student experiences questionnaire
Bauer, K. W.
NASPA Journal, 32(2), 130-137, 1995.
From teaching to learning - a new paradigm for undergraduate education
Barr, R.B. & Tagg, J.
Change, , 1995.
High expectations or high hopes?: Using high expectations as an indicator for learning
Lund, J.
Unpublished manuscript. Bloomington: Indiana University., , 1995.
Individual and environmental predictors of adjustment during the first year of college
Brooks II, J.H. & DuBois, D.L.
Journal of College Student Development, 36 (4), 347-360, , 1995.
Influences affecting the development of students' critical thinking skills
Terenzini, P., Springer, L., Pascarella, E., & Nora, A.
Research in Higher Education, 36(1), 23-39, 1995.
Influences on college students' orientations toward learning for self-understanding
Springer, L., Terenzini, P., Pascarella, E., & Nora, A.
Journal of College Student Development, 36(1), 5-18, 1995.
Reasonable expectations
Kuh, G. D., Miller, T., Lyons, J., & Trow, J.
Washington, DC: National Association of Student Personnel Administrators, 1995.
The relationships between self-reports of college experiences and achievement test scores
Pike, G. R.
, , 1995.
A comparison of student effort and educational gains of White and African-American students at predominantly White colleges and universities
MacKay, K. A., & Kuh, G. D.
Journal of College Student Development, 35(3), 217-223, 1994.
A preliminary study of the feasibility and utility for national policy of instructional "good practice" indicators in undergraduate education
National Center for Higher Education
, , 1994.
Student learning at metropolitan universities
Kuh, G. D., Vesper, N., & Krehbiel, L.
Handbook of theory and research New York, NY: Agathon, 1994.
A structural model of perceived academic, personal, and vocational gains related to college student responsibility
Davis, T. M., & Murrell, P. H.
Research in Higher Education, 34(3), 267-289, 1993.
An empirical typology of college students
Astin, A. W.
Journal of College Student Development, 34, (36-45, , 1993.
Cognitive impacts of living on campus versus commuting to college
Pascarella, E. T., Bohr, L., Nora, A, Zusman, B., Inman, P., & Desler, M.
Journal of College Student Development, 34(3), 216-220, 1993.
Making a difference: Outcomes of a decade of assessment in higher education
Banta, T. W., & Associates
San Francisco, CA: Jossey-Bass, 1993.
Staying ahead of the curve
Dehne, G. C.
Trusteeship, 1(1), 18-23, 1993.
Student age and enrollment status as determinants of learning and personal development at metropolitan institutions
Arnold, J. A., Kuh, G. D., Vesper, N., & Schuh, J. H.
Journal of College Student Development, 34(1), 11-16, 1993.
The relationship between perceived learning and satisfaction with college: An alternative view
Pike, G. R.
Research in Higher Education, 34(1), 23-40, 1993.
Turning teaching into learning: The role of student responsibility in the collegiate experience (ASHE-ERIC Higher Education Report No. 8)
Davis, T. M., & Murrell, P. H.
Washington, DC: The George Washington University, School of Education and Human Development, 1993.
Test-retest and other repeated use of the college experiences questionnaire
Fidler, P.P.
ASHE Presentation, , 1992.
A comparison of student learning at "involving" and other metropolitan universities
Kuh, G. D. & Vestper, N.
American Educational Research Association, San Francisco, , 1992.
College student experiences questionnaire: Norms for the third edition
Pace, C. R.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1992.
Joint determination of college student achievement and effort
Erekeson, O. H.
Research in Higher Education, 33(4), 433-446, 1992.
Psychometric supplement to the CSEQ third edition, 1990
Pace, C. R., & Swayze, S.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1992.
Self-reported gains in academic and social skills
Bauer, K. W.
Journal of College Student Development, 33(3), 492–498, 1992.
Students at metropolitan universities: Viewing involvement through different lenses
Schuh, J. H., Andreas, R. E., & Strange, C. C.
Metropolitan University, 2(3), 64-74, 1992.
Academic locus of control, self-esteem, and perceived distance from home as predictors of college adjustment
Mooney, S.P, Sherman, M.F., & Lo Priesto, C.T.
Journal of Counseling & Development, 69 445-448., , 1991.
Involving colleges: Successful approaches to fostering student learning and personal development outside the classroom
Kuh, G. D., Schuh, J. S., Whitt, E. J., & Associates
San Francisco, CA: Jossey-Bass, 1991.
Research findings on the seven principles
Sorcinelli, M. D.
New Directions for Teaching and Learning, 47, , 1991.
The role of admissions and orientation in creating appropriate expectations for college life
Kuh, G. D.
College and University, 66(2), , 1991.
Assessing the undergraduate experience
Pace, C. R.
Assessment Update, 2(3), 1, 2, 4, & 5, 1990.
Assessment measures
Pike, G. R.
Assessment Update, 2(1), 8-9, 1990.
College student experiences questionnaire (3rd ed.)
Pace, C. R.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1990.
Joint factor analysis of the college student experiences questionnaire and the ACT Comp objective exam
Davis, T. M., & Murrell, P. H.
Research in Higher Education, 31(5), 425-441, 1990.
The impact of the freshman year on epistemological development: Gender differences
Magolda, M. B.
The Review of Higher Education, 13(3), 259–284, 1990.
The undergraduate experience: Commonalities and differences among colleges
Baird, L. L.
Research in Higher Education, 31(3), 271-278, 1990.
The undergraduates: A report of their activities and progress in college in the 1980s
Pace, C. R.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1990.
Quality of student experiences of freshman intercollegiate athletes
Stone, J. A., & Strange, C. C.
Journal of College Student Development, 30(2), 148-154, 1989.
Review of the College Student Experiences Questionnaire
DeCoster, D. A.
In J. C. Conoley & J. J. Kramer (Eds.) The tenth mental measurements yearbook Lincoln, NE: University of Nebraska Press, 1989.
Review of the College Student Experiences Questionnaire
McCammon, S.
In J. C. Conoley & J. J. Kramer (Eds.) The tenth mental measurements yearbook Lincoln, NE: University of Nebraska Press, 1989.
Accuracy of self-reported activities and accomplishments of college-bound students
Laing, J., Sawyer, R., & Noble, J.
Journal of College Student Development, 29(4), 362-368, 1988.
Assessing institutional effects on retention
Mencke, R. & Sahoo, C.
The Twenty-Eighth Forum of the Association for Institutional Research, , 1988.
College involvement, perceptions, and satisfaction: A study of membership in student organizations
Abrahamowicz, D.
Journal of College Student Development, 29(3), 233-238, 1988.
Contradicting the critics (Report No. 5)
Pace, C. R.
, , 1988.
Extent of involvement, satisfaction with college, and progress toward educational goals
Sanders, J., & Kress, D.
Terre Haute, IN: Indiana State University, Office of Student Research, 1988.
Involvement and growth of students in three academic programs
Ory, J. C., & Braskamp, L. A.
Research in Higher Education, 28(2), 116-129, 1988.
Outcomes, assessment, and academic improvement: In search of usable knowledge
Ewell, P. T.
In J. Smart (Ed.) Higher education: Handbook of theory and research New York, NY: Agathon, 1988.
The college environment revisited: A review of research and theory
Baird, L. L.
In J. C. Smart (Ed.) Higher education: Handbook of theory and research New York, NY: Agathon, 1988.
The impact of college residence on the development of critical thinking skills in college freshmen
Inman, P., & Pascarella, E.
Journal of College Student Development, 39(6), 557-568, 1988.
Comparison of opinions about college between humanities program students and non-humanities program students
Berryman-Miller, S.
The Journal of Negro Education, 56, 162-171, 1987.
CSEQ: Test manual and norms: College student experiences questionnaire
Pace, C. R.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1987.
Good things go together
Pace, C. R.
Los Angeles, CA: University of California, Higher Education Research Institute, 1987.
Achievement and the quality of student effort
Pace, C. R.
In T. M. Tomlinson & H. S. Walberg (Eds.) Academic work and educational excellence: Raising student productivity Berkeley, CA: McCutchan, 1986.
Researching academic programs: An inquiry into an emerging field
Conrad, C., & Pratt, A.
In J. C. Smart (Ed.) Higher education: Handbook of theory and research New York, NY: Agathon, 1986.
Separate paths to separate places
Pace, C. R.
, , 1986.
A conceptual model of nontraditional undergraduate student attrition
Bean, J.P. & Metzner, B.S.
Review of Educational Research, 55 (4), 485-540, , 1985.
Expectation and reality in freshman adjustment to college
Baker, R., McNeil, O. V., & Siryk, B.
Journal of Counseling Psychology, 32 (1), 94-103, , 1985.
Perspectives and problems in student outcomes research
Pace, C. R.
New Directions for Institutional Research, 1985(47), 7-18, 1985.
Program quality in higher education: A review and critique of literature and research
Conrad, C., & Blackburn, R.
In J. C. Smart (Ed.) Higher education: Handbook of theory and research New York, NY: Agathon, 1985.
Review of college student experiences questionnaire
Brown, R. D.
In J. V. Mitchell, Jr. (Ed.) The ninth mental measurements yearbook Lincoln, NE: University of Nebraska Press, Buros Institute of Mental Measurements, 1985.
Review of college student experiences questionnaire
Miller, J. K.
In J. V. Mitchell, Jr. (Ed.) The ninth mental measurements yearbook Lincoln, NE: University of Nebraska, Buros Institute of Mental Measurements, 1985.
The college curriculum: Where's the content?
Pace, C. R.
Los Angeles, CA: University of California, Higher Education Research Institute, 1985.
The credibility of student self-reports
Pace, C. R.
Los Angeles, CA: University of California, Center for the Study of Evaluation, 1985.
Historical perspectives on student outcomes assessment with implications for the future
Pace, C. R.
NASPA Journal, 22(2), 10-18, 1984.
Measuring the quality of college student experiences: An account of the development and use of the College Student Experiences Questionnaire
Pace, C. R.
Los Angeles, CA: Higher Education Research Institute, 1984.
Student effort: A new key to assessing quality
Pace, C. R.
Los Angeles, CA: University of California, Higher Education Research Institute, 1984.
Self- and teacher expectancy effects on academic performance of college students enrolled in an academic reinforcement program
Haynes, N.M. & Johnson S.T.
American Education Research Journal, 20 (4), 511-516, , 1983.
Student background and quality of effort correlates of reported grades, opinions about college, and perceptions of magnitudes of cognitive and affective attainment by students in a public comprehensive university
Michael, J. J.
Educational and Psychological Measurement, 43(2), 49, 1983.
Tests in print iii: An index to tests, test reviews, and literature on specific tests
Mitchell, J. V., Jr. (Ed.).
Lincoln, NE: University of Nebraska, Buros Institute of Mental Measurements, 1983.
Faculty expectations of college students
Forsberg, I., & Greenbaum, A.
College Student Journal, 15(4), 387-392, 1981.
Inspiration, aspiration, and expectations of college freshmen at Jackson State University
Nichols, O. C.
College Student Journal, 15(4), 384-386, 1981.
The meaning of response categories: How often is 'occasionally,' 'often,' and 'very often'?
Pace, C. R., & Friedlander, J.
Research in Higher Education, 17(3), 269-281, 1981.
Measuring the quality of student effort
Pace, C. R.
Improving teaching and institutional quality Washington, DC: American Association for Higher Education, 1980.
Educational expectations and college attrition
Muskat, H.
NASPA Journal, 17(1), 17-22, 1979.
Measuring outcomes of college: Fifty years of findings and recommendations for the future
Pace, C. R.
San Francisco, CA: Jossey-Bass, 1979.
Perceptions of the university climate among students in different academic majors at two colleges of arts and sciences
Pascarella, E.T.
Research in Higher Education, 4 165-176., , 1976.
Perceptions of the university climate among students in different academic majors at two colleges of arts and sciences
Pascarella, E.T.
Research in Higher Education, 4 165-176., , 1976.
Student expectations of college: Some implications for student personnel administrators
Karman, T. A.
NASPA Journal, 11(4), 52-59, 1974.
The characteristics of subject matter in different academic areas
Biglan, A.
Journal of Applied Psychology, 57 (3), 195-203., , 1973.
Change in environmental expectations and perceptions
King, H. & Walsh, W.B.
Journal of College Student Personnel, 331-337, , 1972.
Relationship between the psychosocial maturity of entering college freshmen and their expectations about college
Waterman, A. S.
Journal of Counseling Psychology, 19(1), 42-46, 1972.
Characteristics of students who make accurate and inaccurate self-predictions of college achievement
Keefer, K. E.
The Journal of Educational Research, 64 (9), 401-404, , 1971.
The role of the faculty in the accrediting of colleges and universities
American Association of University Professors
Policy documents and reports Washington, DC: Author, 1968.
Diversity experiences and college student learning and personal development
Hu S. & Kuh, G.D.
Journal of College Student Development, , 0.
Education disrupted: Students beginning college during the COVID-19 pandemic
Kinzie, J. & Cole, J.S.
New Directions for Higher EducationNew Directions for Higher Education, Perspectives From the COVID-19 Pandemic: Students and Academic Life, 199, 27-40, 0.
In the second year of the COVID-19 pandemic, students entering college in fall 2021 had an unprecedented culmination to high school and transition to college. This chapter explores the experience of entering college students following these unprecedented circumstances, examining high school disruptions, including changes in the learning environment and its relationship to instructional mode preferences in college, and documenting students?? sense of optimism for college, their mental and emotional health, and perceptions of academic difficulty. Results show that the educational impact of the pandemic was not uniform across student groups and will remain an important factor in these students?? educational journey.
Full version
High-impact practices and student-faculty interactions for gender-variant students
BrckaLorenz, A., Garvey, J. C., Hurtado, S. S., & Latopolski, K.
Journal of Diversity in Higher Education, , , 0.
The vast amount of research on student success and engagement in college focuses on a narrative for majority student populations that does not account for unique experiences across social identities. This article examines the experiences of gender-variant students (i.e., students who do not identify as either cisgender men or women) regarding engagement in high-impact practices and student?faculty interactions using a large-scale, multi-institution quantitative data set collected from the 2014 administration of the National Survey of Student Engagement. Although high-impact practice participation was similar for gender-variant and cisgender students, positive student-faculty interaction was found to be a significant predictor for increased high-impact practice participation for gender-variant students. Results from this study may also point to chillier climates of certain major fields for gender-variant students. Implications for these findings focus on investigating major choice as a mediating factor for high-impact practice participation and advocating for the inclusion of different gender identities in surveys, institutional data, and higher-education research.
Successful student outcomes assessment: Six institutional case studies including the role of student affairs
Beeler, K. J., Benedict, L. & Hyman, R.
(Available from the National Association of Student Personnel Administrators, 1875 Connecticut Avenue NW, Suite 418, Washington, DC 20009), , 0.
The use of student engagement findings as a case of evidence-based practice
Kinzie, J.
New Directions for Higher Education, 2017 Summer(178), 47–56, 0.
The chapter considers student engagement to discuss the use of assessment evidence to advance evidence-based practice and to illustrate a scholarship of practice.
Full version
The use of student engagement findings as a case of evidence-based practice
Kinzie, J.
New Directions for Higher Education, 2017 Summer(178), 47–56, 0.
The chapter considers student engagement to discuss the use of assessment evidence to advance evidence-based practice and to illustrate a scholarship of practice.
Full version
Worth The Squeeze: What Learning Improvement Is and Why It Matters
, , 0.
Full version
Worth The Squeeze: What Learning Improvement Is and Why It Matters
Kern, J.A. Kinzie, J & Fulcher, K.H.
, 0.
Full version
Scholarly Papers
Am I a professional? A quantitative study of faculty professional identity
Chamis, Ella; Braught, Emily; BrckaLorenz, Allison
Association for the Study of Higher Education Annual Conference, Minneapolis, MN, 2024, November.
The field often takes the professional identities of its faculty for granted, and faculty professional identity development is largely understudied. In this person-centered quantitative study, we explore the importance of faculty professional identity and consider its influencing factors for development. Our findings provide clarity and guidance in developing faculty professional identity.
Full version
Examining the relationship between faculty identity and their civically engaged teaching practices
Jin, Seonmi; Zhang, Xiaoxia; BrckaLorenz, Allison
Association for the Study of Higher Education Annual Conference, Minneapolis, MN, 2024, November.
This study explores the relationship between faculty??s identity and their civically engaged teaching practices, applying the Diversity Learning Environment model (Hurtado et al., 2012). We used the Faculty Survey of Student Engagement (FSSE), which included 13,531 faculty responses from 65 participating institutions, and conducted a multi-level modeling analysis.
Full version
A Multi-Institutional Examination of Mind and Body Well-being for First-Generation
Yuhas, Bridget; Copeland, Olivia; Feldman, Steven; BrckaLorenz, Allison
American Educational Research Association Annual Meeting, Philadelphia, PA, 2024, April.
First-generation students (FGs) often face unique challenges in navigating collegiate experiences which can impact their well-being. In this study, we examine undergraduate FGs?? mind and body well-being using data from two large-scale multi-institutional data sets. Specifically, we examine relationships between stressors and supports and assess the extent that FGs know how to get help at their institution for a variety of well-being issues. Results imply that FGs generally feel less institutional support for their well-being, that inverse relationships exist for mind and body stressors and institutional supports, and that results for knowing how to get help are mixed. Implications point to continued disaggregation to better understand FGs experiences and recognizing the importance of social capital to FGs success.
Full version
Connecting College Student Civic Engagement and Cultural Center Involvement
Copeland, Olivia; Feldman, Steven; BrckaLorenz, Allison
American Educational Research Association Annual Meeting, Philadelphia, PA, 2024, April.
In this study, we explore the relationship between cultural center involvement and college students?? civic engagement outcomes. We utilize data from a large-scale, multi-institutional data set to run a series of regression analyses. Findings indicate that participating in the activities of a cultural center positively correlates with higher levels of civic engagement skills and abilities as well as frequency of civic engagement. We also used effect coding in our models to explore sub-group differences within gender, sexual, and racial identity categories. Disaggregating by identity, our results indicate some disparities among students prior to considering their cultural center involvement. These findings present a significant counter to the widespread attack on diversity, equity, and inclusion efforts, evidencing the continued relevance and positive influence of cultural centers on all students.
Full version
Faculty Perceptions of Their Disciplinary Cultures: Re-Evaluating Biglan??s Dimensions
Braught, Emily; Hiller, Stephen C.; Nelson Laird, Thomas
American Educational Research Association Annual Meeting, Philadelphia, PA, 2024, April.
Disciplinary cultures are an important part of understanding the faculty experience. For fifty years, the Biglan dimensions have been frequently relied on by researchers interested in considering disciplinary differences as parts of their studies; however, applying a cultural lens draws attention to the possibility that over time, disciplinary cultures may have changed. Through exploring faculty perceptions of their disciplines using an item set derived from key cultural aspects of Biglan??s dimensions, compared to the Biglan dimensions, this exploratory study offers insights into the evolution of disciplinary cultures, highlighting the variation and fluidity of disciplinary cultures that faculty experience in their disciplines today.
Full version
Connecting College Student Civic Engagement and Cultural Center Involvement
Copeland, Oliva M., Feldman, Steven, BrckaLorenz, Allison
ACPA Annual Convention, Chicago, IL, 2024, March.
In this study, we explore the relationship between cultural center involvement and college students?? civic engagement outcomes. We utilize data from a large-scale, multi-institutional data set to run a series of regression analyses. Findings indicate that participating in the activities of a cultural center positively correlates with higher levels of civic engagement skills and abilities as well as frequency of civic engagement. We also used effect coding in our models to explore sub-group differences within gender, sexual, and racial identity categories. Disaggregating by identity, our results indicate some disparities among students prior to considering their cultural center involvement. These findings present a significant counter to the widespread attack on diversity, equity, and inclusion efforts, evidencing the continued relevance and positive influence of cultural centers on all students.
Full version
Investigating the Campus Pride Index??s Relationship to Perceived Student Support
Copeland, Olivia M., Feldman, Steven, BrckaLorenz, Allison
ACPA Annual Convention, Chicago, IL, 2024, March.
The Campus Pride Index (CPI) is often used as a litmus test for assessing the level of LGBTQ+ inclusion and support within higher education institutions. However, little research has explicitly examined the relationship between CPI rating and LGBTQ+ students?? perceptions of supportiveness. To explore this, we analyzed 118,244 student responses about their institution??s support for diverse sexual orientations and gender identities. Results indicate that at top-rated CPI institutions, LGBQ+ students had lower perceptions of support than their peers. We discuss the implications of these results, focusing on how institutions may uncritically utilize CPI as the ceiling for LGBTQ+ support rather than a minimum, with ideas for how student affairs practitioners can utilize CPI while also going beyond CPI??s metrics.
Full version
Examining campus support systems for LGBQ+ college students' mental health and well-being
Feldman, Steven; BrckaLorenz, Allison
Association for the Study of Higher Education Annual Conference, Minneapolis, MN, 2023, November.
In this study, we explore LGBQ+ college students?? experiences related to mental health and wellbeing, using the Proud & Thriving Framework. Our research utilizes a large scale, multi-institutional, quantitative and qualitative data set that includes a variety of institutional types and geographic locations across the United States. We use a series of OLS regression analyses and descriptive analyses to explore LGBQ+ students?? difficulties, support networks, knowledge about institution-provided supports, and student-suggested ways that their institution has supported their mental health and well-being. We find that large portions of LGBQ+ students do not know how to get help with various difficulties and that students within the LGBQ+ community had differing relationships with risks and supports depending on their specific LGBQ+ identity such as asexual students struggling less with workload-related issues and pansexual students struggling more with health-related issues than their LGBQ+ peers. We conclude with suggestions for campus staff, faculty, and higher education researchers on tangible ways that they can work to improve campus environments and experiences for LGBQ+ college students.
Full version
Somewhere to Stay and Thrive: Relationships between Persistence and Environments for Diverse Faculty
BrckaLorenz, Allison; Christiaens, Roman; Feldman, Steven; Russell, Alethia; Wenger, Kevin
Association for the Study of Higher Education Annual Conference, Minneapolis, MN, 2023, November.
As colleges and universities invest in efforts to cultivate diverse learning environments, a primary focus has been hiring and retaining faculty with underrepresented and marginalized backgrounds. Using data from a large-scale, multi-institution quantitative data set, we explore how faculty persistence relates to aspects of a faculty member??s environment. We found that faculty perceptions of work-life balance and within-work balance were the strongest indicators of a faculty member??s intentions to persist. Relationships between persistence and aspects of environment tended to be strongest for LGBQ+ faculty. Institutions interested in supporting and retaining diverse faculty can use these findings to better understand their institution??s environment for faculty and pinpoint areas to implement change.
Full version
Exploring Relationships Between Faculty Values for and Practice in Developing Student Quantitative Reasoning
Hu, Tien-Ling & BrckaLorenz, Allison
American Educational Research Association Annual Meeting, Chicago, IL, 2023, April.
The American Association of Colleges and Universities listed quantitative literacy as an essential practical skill. Colleges and universities play a key role in preparing students with career skills. Building on two critical perspectives: the importance of quality teaching to quality learning and the importance of quantitative reasoning in workforce success, the study explores the relationship between faculty values for quantitative reasoning, how much faculty structure their courses to help develop students?? real-world skills, and to what extent faculty encourage students to participate in career-related activities. The findings show that faculty values for the importance of quantitative reasoning significantly predicted how they structure their courses to help develop students?? numerical skills and how they encourage students to participate in career-related activities.
Full version
Faculty Feelings Matter: Environmental Experiences of Queer Faculty of Color
BrckaLorenz, Allison; Chamis, Ella; Feldman, Steven
American Educational Research Association Annual Meeting, Chicago, IL, 2023, April.
Despite an emphasis on diversifying the professoriate, higher education has failed to make significant progress in recruiting and retaining diverse faculty in the academy. Literature points to issues of campus climate, discrimination, and workplace stress as common reasons for diverse faculty to leave their positions. Using the College + University Teaching Environment framework, Quare Theory, critical methodological philosophies, and a large-scale multi-institution quantitative dataset, this study examines affective components of a faculty environment for queer faculty, faculty of color, and queer faculty of color. Results indicate strong relationships between perceptions of support, sense of belonging, mental health, and stress with faculty persistence in their role as well as additional stress for LGBQ+ faculty of color.
Full version
Institutional Environments for Diverse and Inclusive College Teaching: Exploring Disciplinary Variation
Hiller, Stephen C.; Hu, Tien-Ling; Nelson Laird, Thomas; BrckaLorenz, Allison
Association for the Study of Higher Education Conference, Las Vegas, NV, 2022, November.
This study examines the relationships of disciplinary cultures with three aspects of teaching environments: diversity in the curriculum, the use of inclusive pedagogies, and teaching autonomy. Using data from the College + University Teaching Environment survey, we found significant differences across disciplinary areas and Biglan dimensions.
Full version
Intersectionality and Sense of Belonging: Unpacking the Student Veteran Experience
Morris, Phillip Allen; BrckaLorenz, Allison; Burke, Jim; Chamis, Ella; Russell, Alethia; Weiss, Jennifer
Association for the Study of Higher Education Conference, Las Vegas, NV, 2022, November.
Military veterans are increasingly diverse students with multiple identity intersections. Using variable- and person-centered analyses with data from NSSE (n= 12,668), we examined impacts of veterans?? diverse identities on the multi-item factors Sense of Belonging, Collaborative Learning, Student-Faculty Interaction, and Quality of Interactions. Policy and practice implications are discussed.
Full version
Advising during the pandemic: What we learned from research and educational practice
Cole, James and Kinzie, Jillian
NACADA, Portland, Oregon, 2022, October.
The pandemic created new challenges for students and campuses alike. Students experienced major disruptions in their educational experiences resulting in heightened mental health and academic concerns that contributed to an increasing equity gap. Campuses realized that they needed to re-align, prioritize, and develop new approaches to advising to be meet the needs of these students. Much of what was learned since 2020 is now part of the new normal. This presentation will highlight the academic and mental health challenges faced by thousands of entering fall 2022 students, focusing on first-year and transfer students, students of color, and first-generation. The presentation will describe how two institutions responded to this challenge. An important component of this presentation will be participants learning from each other and sharing how their campuses responded.
Full version
Environments that Motivate Teaching Excellence: The College + University Teaching Environment Framework
BrckaLorenz, Allison; Brandon, Josclynn; Nelson Laird, Tom
Association for the Study of Higher Education, 2021, November.
Inequities and discrimination built into the systems and structures of higher education prevent faculty from doing and receiving recognition for their best work. The framework proposed here guides our understanding of faculty needs, motivations, and supports that are necessary for healthy teaching environments and the wellbeing of diverse faculty.
Full version
Teaching during the Pandemic: A Spectrum of Faculty Perspectives
Fassett, Kyle T.; BrckaLorenz, Allison; Hu, Tien-Ling
Association for the Study of Higher Education, 2021, November.
In this study, we holistically investigated the ways the pandemic altered how faculty navigated their roles. We examined how faculty adapted course reparation and teaching practices while considering faculty teaching needs and personal relationships. Findings from two national surveys show differences in faculty experiences by race, gender, sexual orientation, rank, and discipline. One finding showed White faculty tended to be less flexible regarding changes to their courses while Asian faculty tended to be more flexible in comparison to the average faculty response. We discuss both broad and specific implications for institutions and faculty for comprehending faculty teaching practices as well as understanding faculty holistically.
Full version
College Students Responding to Sexuality-Based Items: A Differential Test Function Analysis
Fassett, Kyle T.; BrckaLorenz, Allison
American Educational Research Association Annual Meeting, 2021, April.
Surveys are often intended to collect data across a swath of individuals yet sometimes the items favor certain respondents over others. Differential test functioning (DTF) analysis helps us understand if there are underlying latent characteristics that may affect the way a group of individuals responds to items. This study sought to examine if differences existed in the responses to items pertaining to college students?? feeling safe and supported regarding their sexual orientation. Results indicate that there appears to be differences in an item for queer first year respondents, but no differences when looking at senior students. More research is needed to precisely understand which items are functioning differently.
Full version
Disciplinary Differences in Faculty Emphasis on Deep Approaches to Learning
Hiller, Stephen C.; Nelson Laird, Thomas F.
American Educational Research Association Annual Meeting, 2021, April.
This large-scale study compares how Biglan and Holland conceptualizations of academic disciplines in their ability to explain differences in faculty emphasis on deep approaches to learning in their courses. To examine these differences, several multiple regressions models are conducted 6,500 faculty and instructor responses to the Faculty Survey of Student Engagement (FSSE), using effect coding to better compare disciplinary categories. Analyses examining disciplines using Biglan??s three dimensions or Holland??s theory suggest differences within each conceptualization that largely align with previous research. Comparisons between these two conceptualizations, while showing some overlap, indicate that Biglan??s dimensions explain slightly more variation, with a slightly greater range of magnitude in some effect sizes. These findings underscore for researchers, faculty, and educational developers the need to examine disciplinary effects on teaching practices while also suggesting for researchers the need to appropriately align disciplinary conceptualizations with their area of study.
Full version
Higher Learning Commission Annual Meeting 2021: National Survey of Student Engagement (NSSE) Showcase Presentation
Kinzie, Jillian
Higher Learning Commission Annual Meeting, 2021, April.
In 2020, NSSE celebrated two decades of focused attention on student engagement and quality in undergraduate education. This session will showcase findings about high-impact practices, collaborative learning, and academic advising, and lessons learned from institutions that have made productive use of their results to inform improvements for student persistence and success.
Full version
A Quasi-Experimental Multilevel Study Examining High-Impact Practices and Deep Approaches to Learning
Fassett, Kyle T.; Haeger, Heather; BrckaLorenz, Allison
Association for the Study of Higher Education, 2020, November.
High-impact practice research often focuses on improving student persistence and academic achievement with less of an emphasis on the development of student learning processes. Further, many studies historically center majority populations in research due to sample size restrictions or methodological procedures. This study uses national survey data to examine over 347,000 seniors? experiences at more than 1,100 four-year colleges and universities with high-impact practices and students? reported learning processes. A hierarchical linear model with propensity scores and effect codes show the relationship between six high impact practices and students? learning processes while de-centering motivating factors and majority populations. Findings indicate both service-learning and learning communities promoted the outcomes under investigation with mixed results among the others. Differences emerged by race/ethnicity, gender identity, sexual orientation, and ability status. We broadly discuss implications for higher education and future research.
Full version
Difficult Discourse and Critical Pedagogies: A Large-Scale Mixed-Methods Exploration of Faculty Practice
Hurtado, Sarah; BrckaLorenz, Allison; Sisaket, Lesley; Washington, Sylvia
Association for the Study of Higher Education, 2020, November.
Using critical pedagogy as our framework, this study?s purpose is to explore faculty members? ability to engage in difficult discourse with their students and their use of related critical pedagogies. The findings come from a large-scale multi-institution mixed-methods study to provide guidance for faculty to participate in this work.
Full version
Trial and Error: Socialization?s Failure to Teach Us How to Teach
BrckaLorenz, Allison; Hurtado, Sarah; Palmer, Dajanae; McCoy-Simmons, Casey
Association for the Study of Higher Education, 2020, November.
Socialization is a major component to faculty development, but without intentional direction it can fail to produce effective educators. The purpose of this large-scale mixed-methods study is to explore teaching influences, missed opportunities to prepare faculty for handling challenging teaching situations, and ways we can improve the socialization process. Results highlight the importance of faculty experiences as undergraduate and graduate students, the value of professional associations and conference participation, and the great range in faculty desires for professional development as educators. Potential implications include a focus on early socialization experiences, encouraging the Scholarship of Teaching and Learning, and providing equitable opportunities to support vulnerable populations.
Full version
A multi-institutional study of teaching development opportunities and faculty practice
Fassett, K.; BrckaLorenz, A.; Hiller, S.; Nelson Laird, T.
American Educational Research Association Annual Meeting, 2020, April.
Research on faculty teaching development is robust, with small-scale research studies on specific teaching development experiences or practices in particular fields. To contextualize the myriad of teaching development efforts available to faculty, this large-scale multi-institution study of nearly 4,500 faculty seeks to broaden our understandings of who participates in teaching development practices, how their participation relates to their institutional environments, and how their participation connects to use of effective teaching practices. Results show there are some notable trends by field, identity, the type of courses taught, and institutional characteristics. The overview of professional development participation in this study gives strength to positive findings from smaller-scale research studies and provides a solid base for more specific studies of these practices.
Full version
Are Black women faculty and Women of Color faculty synonymous?
Priddie, C.; Palmer, D.; Silberstein, S.; BrckaLorenz, A.
American Educational Research Association Annual Meeting, 2020, April.
Black women faculty in the professoriate are often lumped into broader women of color categories when examining their experiences in academia. However, women of color are not a monolith and their experiences should be examined with disaggregation. The current study examined the time allocation of Black women faculty in relation to other women of color faculty to assess whether narratives compiling all women of color faculty together are appropriate. Results showed that Black women faculty differ in how they allocate their time in relation to their women of color counterparts. Our findings suggest that studies conducted aggregating the stories of women of color are not portraying the unique experience Black women faculty are facing.
Full version
Classifying higher education institutions by their general education requirements
Holcombe, E.; Nelson Laird, T.; Kwon, J.; BrckaLorenz, A.
American Educational Research Association Annual Meeting, 2020, April.
General Education (GE) curricula specify requirements, most often fulfilled through coursework, that undergraduate students need to satisfy in addition to and often preceding a specialized major or program. Due to the decentralized nature of the American higher education system and lack of national requirements or guidelines, however, GE requirements vary from one institution to another. This exploratory study investigates patterns of GE requirements among a selection of 154 institutions and determines whether and how institutions could be grouped or classified by their GE requirements. Our five-dimension typology is parsimonious and meaningfully distinguishes between GE patterns giving us insightful information about the values and goals of institutions that are not communicated through our traditional categorizations.
Full version
Developing transferable skills for the public good
Kirnbauer, T.; BrckaLorenz, A.
American Educational Research Association Annual Meeting, 2020, April.
Transferable skills are crucial for undergraduates to be prepared to enter the workforce after college. Previous research has shown how effective educational approaches enhance student learning. There is, however, limited research that understands how the emphasis on transferable skills relates to the value of deep approaches to student learning. This paper analyzes how faculty emphasis of transferable skills, through analytical writing and problem-solving, is related to deep approaches to learning in higher education. Data come from a large-scale, multi-institutional study that surveys faculty at four-year institutions. Findings indicate that the intentional development of transferable skills has a positive relationship with emphases on deep approaches to learning. The study reinforces the importance of collaboration between multiple stakeholders to foster student learning.
Full version
Examining the relationship between faculty development opportunities and teaching practices
Fassett, K.; BrckaLorenz, A.
American Educational Research Association Annual Meeting, 2020, April.
Teaching is arguably the lifeblood of higher education as students enroll in higher education institutions to learn new information. Faculty often partake in developmental opportunities that seek to improve their pedagogical practices and the student experience. Seeing the importance in understanding teaching, this study uses a multi-institution data set to examine the relationship between development opportunities and faculty use of effective teaching practices and course goals. Findings indicate that informal practices including discussing teaching with colleagues, speaking with students beyond course evaluations about classroom practices, and reading pedagogy books increased use of effective teaching practices. These findings have implications for faculty developers coordinating teaching development opportunities, administrators investing funding in development, and faculty who are looking to change their practices.
Full version
Student Living Arrangements: An Exploration of Marginalized Identities
Fassett, Kyle T.; Gonyea, Robert M.; Graham, Polly A.; Fosnacht, Kevin
ACPA-College Student Affairs Educators International Convention, Nashville, TN, 2020, March.
While past research found on-campus living to benefit student success, recent studies find mixed support, particularly for marginalized groups. This study focuses on first-year and sophomore students of color, LGBQ+ students, gender non-binary students, and students with disabilities, analyzing where they live as related to a variety of outcomes. Data come from 76 residential colleges and universities that participated in NSSE during 2018. Results show differences in where students report living and students? engagement and perceptions of belongingness and safety in their living communities.
Full version
Culturally engaging courses and campuses for LGBQ+ issues
BrckaLorenz, A., Duran, A., Haeger, H. & Duenaz, U.
Association for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This study examined student perceptions of how open their institution is to integrating LGBQ+ topics in curricula and how this relates to other forms of engagement. We found differences by major and sexuality, and that relationships between engagement and LGBQ+ topic inclusion are strong for LGBQ+ and non-LGBQ+ students.
Full version
Examining the relationship between living environments and sense of community: A multi-institution study
Hurtado, S., Fassett, K., & BrckaLorenz, A.
Association for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This study seeks to expand the often-mixed results about college living arrangements. We examine differences between various on-campus and off-campus options as they relate to students sense of community and belonging. We specifically focus on students from marginalized backgrounds who have been historically underrepresented in college environment studies.
Full version
Exploring interactions of race and discipline in teaching practices: Focusing on faculty of color in STEM
Hiller, S., BrckaLorenz, A., Priddie, C., & Nelson Laird, T.
Association for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This study seeks to center the experiences of minoritized faculty to better understand how diverse faculty approach teaching in different disciplines. Findings suggest that students in STEM courses taught by faculty of color may experience deeper and more meaningful learning than in STEM courses taught by White faculty.
Full version
Top college choice among students? sexual orientations
Fassett, K. T., & Pike, G. R.
ssociation for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This paper aims to examine college enrollment trends of queer students using Perna?s (2006) conceptual model of student college choice focusing on aspects of capital and the recruitment of these students. The research questions of the study are: what differences exist between students selecting their top institution by sexual orientation, and how do social factors influence queer students selecting these institutions? Data from the Beginning College Survey of Student Engagement (BCSSE) paired with the National Survey of Student Engagement (NSSE) for students entering college in 2017 and 2018.
Full version
Top college choice differences among students' sexual orientations
Fassett, K., & Pike, G.
Association for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This paper aims to examine college enrollment trends of queer students using Perna??s (2006) conceptual model of student college choice focusing on aspects of capital and the recruitment of these students. The research questions of the study are: what differences exist between students selecting their top institution by sexual orientation, and how do social factors influence queer students selecting these institutions? Data from the Beginning College Survey of Student Engagement (BCSSE) paired with the National Survey of Student Engagement (NSSE) for students entering college in 2017 and 2018.
Full version
What's your threshold? How international students use vague quantifiers of behavioral frequency in student surveys
McCormick, A., Rocconi, L., & Dumford, A.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Many student surveys on the undergraduate experience ask respondents to quantify various aspects of their collegiate experiences. Studies of the survey response process have shown that enumeration is cognitively challenging and subject to various forms of error. As an alternative to enumeration, many surveys use vague quantifiers (VQs) such as ?very often,? ?often,? ?sometimes,? ?rarely,? or ?never.? Previous research findings generally support the use of VQs from a concurrent validity standpoint. One important area that has gone unexplored involves international students?how they interpret and use VQs and whether these interpretations and uses differ from those of domestic students. A related concern involves heterogeneity within the international student population. To the extent that the use of VQs differs between international and domestic students, or differs among international student populations, users of student survey data should be aware of these differences and their implications for the validity and interpretation of results. Informed by these concerns, we ask the following research questions: 1. To what extent do domestic and international students interpret VQs differently? 2. Among international students, to what extent do students from Western and non-Western countries interpret VQs differently?
Full version
Advancing truth: Expanding our knowledge of LGBQ+ faculty
BrckaLorenz, A., Fassett, K., & Merckle, R.
American Educational Research Association Annual Meeting, Toronto, Ontario, Canada, 2019, April.
Most research about queerness at colleges and universities has been aimed at examining the student experience. Research on queer faculty often has quantitative limitations, has grown outdated, or is qualitative in nature. From this, we know that the experiences of queer faculty are often difficult. Through a large-scale, multi-institution, multi-year investigation of LGBQ+ faculty, this study aims to give an overview of the academic lives of these understudied academics. We investigate who they are, at what kinds of institutions are they employed, and different ways they contribute to undergraduate education. With this story, we hope to strengthen the voices of qualitative studies and encourage higher education to think more broadly about notions of diversity and identity.
Full version
An examination of inclusivity and support for diversity in STEM fields
BrckaLorenz, A., Haeger, H., & Priddie, C.
American Educational Research Association Annual Meeting, Toronto, Ontario, Canada, 2019, April.
The lack of diversity in STEM professions is an ongoing concern for the US both in terms of social justice and in having a globally competitive workforce. This study provides information for campus leaders to be proactive in considering a wide array of identities to meet the needs of students beyond attending to structural forms of diversity. Data from a large-scale, multi-institution study of students‘ perceptions of inclusive coursework and institutional commitment to diversity in STEM fields furthers what we know about diversity in these majors. Results encourage campus leaders to additionally consider sexual orientation and disability status in conversations about diversity and to think about how culturally engaging and inclusive courses go beyond the content of the course.
Full version
Centering Black women faculty: Magnifying powerful voices
Priddie, C., Palmer, D., Silberstein, S., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Toronto, Ontario, Canada, 2019, April.
While much of the quantitative research Black women faculty, has taken a comparative approach to understanding their experiences, this study provides a counternarrative, centering their experiences as faculty. This large-scale, multi-institution glance at Black women faculty helps to give us an overview of these women across the country, looking at who they are, where they are, how they spend their time, and what they value in undergraduate education. This study allows us to strengthen various arguments made in qualitative studies of Black women faculty and give voice to a community that can be invisible. This study reaffirms and reinvigorates the need to continue to create avenues for recruitment, hiring, support, promotion, and retention of Black women across all disciplines.
Full version
Does enjoyment, guilt, and/or rewards motivate faculty research productivity? A large-scale test of Self-Determination Theory
Stupnisky, R., BrckaLorenz, A., & Nelson Laird, T. F.
American Educational Research Association Annual Meeting, Toronto, Ontario, Canada, 2019, April.
What motivates faculty to be productive researchers is largely unknown as institutional, demographic, and social-environmental factors explain limited variance. The current study tested the extent to which self-determined motivation served as a predictor of university faculty member‘s research productivity. Analysis of a large-scale USA sample of 1,980 faculty from 21 institutions using structural equation modeling found autonomous motivation (enjoyment, value) positively related to self-reported research productivity and number of publications, beyond time spent on research. The basic needs of autonomy and competence predicted autonomous motivation, and indirectly predicted achievement. External motivation (rewards) had a relatively small positive relationship with research productivity, while introjected motivation (guilt) had no relationship. The results contribute to both the faculty development and motivation research literatures.
Full version
Employing differential item function analysis in survey research
Paulsen, J., Merckle, R., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Toronto, Ontario, Canada, 2019, April.
One of the key assumptions involved in using any survey or measurement is that the instrument works consistently across groups. This is particularly important in survey research where group comparisons are ubiquitous. Differential item functioning analysis examines whether the instrument systematically biases in favor of one group. The findings from such an analysis are unattainable in traditional approaches to examining instrument validity, and yet, it is rare to find DIF analysis in surveys. This process illustrates DIF analysis with logistic regression using the Faculty Survey of Student Engagement. We find FSSE items did not show the presence of DIF. This provides confidence to users of this instrument that it measures the same constructs in the same way across different groups.
Full version
Examining students’ use of, preferences for, and learning with e-textbooks
Abaci, S., BrckaLorenz, A., & Quick, J.
American Educational Research Association Annual Meeting, Toronto, ON, Canada, 2019, April.
E-textbooks (e-texts) are becoming more available in higher education as they offer a cost advantage
and features that are intended to enhance teaching and learning. Although previous studies speak to
student experiences and preferences for e-texts, these studies are often limited in scope. The purpose
of this study is to understand student experiences with e-texts and the factors that drive their
preferences for textbook medium with a large-scale multi-institution data set. Findings indicate that e-text
use and preferences differ by a variety of student characteristics, most notably students‘ class level
and major field. In general, students who more frequently used the interactive features of e-texts felt
that their use of these tools contributed to their learning and interactions with others.
Full version
Time well spent: Flipped classrooms and effective teaching practices
Fassett, K. T., BrckaLorenz, A., Strickland, J., & Ribera, A.
American Educational Research Association Annual Meeting, Toronto, Canada, 2019, April.
Good teaching practices are the crux of student education and require constant evaluation to meet current generations‘ learning needs. Flipped classrooms have sought a foothold in higher education to provide opportunities for deep learning through the delivery of content online prior to attending class while having activities related to processing and applying the information during class. Using a large-scale, multi-institution study of faculty teaching flipped courses, this study empirically links flipped procedures to other forms of effective educational practice and additionally focuses on the motivations and impacts on the faculty side of this pedagogical practice. Findings indicate numerous learning and development benefits for students with implications for supporting and motivating faculty across disciplines, faculty identities, and course types.
Full version
The relationship between residential learning communities and student engagement
Hurtado, S., Gonyea, R. M., Graham, P. A., & Fosnacht, K.
American College Personnel Association Annual Convention, Boston, MA, 2019, March.
Residential learning communities (RLCs) are residence hall environments designed to deliver
academic and social benefits. For decades, RLCs have been touted as an effective means to
increase student success. Yet, substantial changes in the defining characteristics of campus
housing and student diversity have led to new questions about the impact of living on campus
and the benefits of RLCs in particular. Consequently, we investigated the continued efficacy of
RLCs as an effective educational practice. Using data from a diverse, multi-institution sample of
first-year and sophomore students, this study provides insight into the relationships between
RLC participation, student engagement, and perceived gains in learning.
Full version
Bringing their perspective to campus: Students’ experiences with inclusive courses and diverse environments
Kinzie, J., & BrckaLorenz, A.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
How much do students experience courses that emphasize sharing their own perspectives or respecting diverse ideas? This study uses data from a multi-institution survey to explore student experiences with inclusive courses and perceptions of institutional commitment to diversity and discuss a dozen campus responses to their institutional assessment results.
Full version
International students' reflective-integrative learning: Variation by geographical regions of origin
Oktafiga, D. A., BrckaLorenz, A., & Nelson Laird, T. F.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
International students are an important and growing population at colleges and universities in the United States. Although some is known about the behaviors of these students in higher education, more information about how these students engage in reflective-integrative learning activities can help institutions create spaces for these students to thrive both academically and interpersonally. Using a large-scale, multi-institution survey of over three thousand international seniors, this study moves away from the common practice of grouping international students together and begins to disaggregate by exploring senior international students' reflective-integrative learning participation by the students' geographic region of origin. Findings indicate that there are differences in participation in reflective-integrative learning activities among international students from different regions as well as between international and domestic students, with notable differences from Asian students.
Full version
The effects of the first-year residence hall roommate assignment policy on interactional diversity and perceptions of the campus environment
Fosnacht, K., Gonyea, R. M., Graham, P. A., & Hurtado, S.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
A heterogenous student body is valued in part because diverse interactions among students help create educated and competent citizens and promotes student learning and development. Campus housing is a primary area for diverse interactions as students navigate living with individuals who differ from themselves. This study investigates how the roommate
assignment process influences interactional diversity and perceptions of the campus environment
for first-year students living on campus, and if these relationships differ by race/ethnicity. On
average, students whose roommates were assigned by the institution (as opposed to choosing their own roommates) had a trivial increase in interactional diversity, but perceived a less supportive campus environment. However, the latter relationship differed by race. In particular, Asian, Black, and multiracial students who were assigned roommates by the institution perceived a less welcoming campus environment than their same-race peers who chose their roommates.
This difference was not observed for White students.
Full version
The intersections of race and sexuality in LGBQ+ college students’ belongingness, institutional commitment, and outness
BrckaLorenz, A., Duran, A., Fassett, K., & Palmer, D.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
The purpose of this quantitative study was to investigate how student subgroups within the LGBQ+ community differed in their perceptions of belongingness, institutional commitment, and outness. Findings from this study revealed how professionals can create targeted initiatives to support collegians who identify with specific racial or sexual minority groups
Full version
The time is now: A study promoting STEM faculty use of culturally inclusive teaching
Ribera, A., Priddie, C., & BrckaLorenz, A.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
This study aims to inform the conversation of inclusion in STEM. We analyzed nearly 3,000 faculty who shared their experiences with using culturally inclusive teaching in their selected undergraduate course. Our study serves as tool to promote discussions about strategies campus leaders may adopt to reinforce inclusion for all students.
Full version
Wake up, institutions! Understanding the social and political causes of student activists
BrckaLorenz, A., Palmer, D., Kirnbauer, T., Miller, D., & Wright, A.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
The purpose of this large-scale quantitative study was to better understand the social and political causes in which students are active. Through our findings, we encourage colleges and universities to #wakeup and adopt a more proactive philosophy for their engagement with and support of students surrounding activism.
Full version
Creative coursework exposure: Enhancing college student engagement across disciplines
Miller, A. L.
Southern Oregon University Creativity Conference, 2018, August.
Previous research suggests that creativity training can be effective in academic settings and that teachers, in particular, can have an impact on creativity (Scott et al., 2004). Furthermore, incorporating creativity into classroom activities and assignments can encourage student engagement in the educational process (Halpern, 2010). This study extends research on creativity and student engagement in higher education, using data from the ?Senior Transitions? topical module of the National Survey of Student Engagement (NSSE). Responses from over 61,000 seniors at 266 different U.S colleges and universities were used to explore how exposure to creative coursework can predict student engagement in a variety of areas. NSSE‘s measure of creative coursework includes items on generating new ideas, taking risks without fear of penalty, evaluating multiple approaches to problems, and inventing new methods. Ordinary least squares regression models were conducted to determine the effect of creative coursework exposure on NSSE‘s established measures of student engagement: reflective and integrative learning, higher-order learning, use of learning strategies, collaborative learning, diverse discussions, student-faculty interaction, effective teaching practices, quality of interactions, and supportive environment. The results suggest that creative coursework is a significant positive predictor of student engagement, even after controlling for sex, transfer status, enrollment status, first-generation status, age, SAT/ACT, race/ethnicity, major, grades, percentage of online courses, control (private/public) and size. Potential reasons for these patterns of results will be discussed. These findings can help to inform curricular and programming enhancements for college students across all major fields, enriching their educational experiences through exposure to creative coursework.
Full version
Dimensions of expectations: How it breaks freshman myth
Mu, L., & Cole, J.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
First-year college students often arrive with unrealistic academic and engagement expectations that typically result in many of their expectations going unmet. This phenomenon is referred to as freshman myth. Due to the gap between the expected and actual engagement, investigations about their association at the average level may conceal the true relationship. In the current study, we used longitudinal student survey data from a national sample to explore how the variation in expectations influences the association of the expected and actual engagement of first-year college students. The results revealed that, at the same expectation level, entering college students who had more varied expectations were more likely to fulfill their expected engagement in the first academic year. An institution‘s environment did not show significant mediation on the association of expected and actual engagement.
Full version
Examining faculty burn-out, well-being, and job performance
Stupnisky, R. H., BrckaLorenz, A., Yuhas, B., & Guay, F.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
This study tested a conceptual model based on self-determination theory to examine how university faculty members‘ motivation for teaching predicts their utilization of teaching best practices and explored if faculty at various higher education institution types are differentially motivated for teaching. Data from a national online survey of 1,671 faculty from 19 universities were analyzed using structural equation modeling. Support for the overall model showed faculty autonomy, competence, and relatedness positively predicted autonomous (intrinsic, identified) motivation but not controlled (introjected, external) motivation. Autonomous motivation, in turn, predicted greater incorporation of effective teaching strategies, namely instructional clarity, higher-order learning, reflective and integrative learning, and collaborative learning. There were no differences found across faculty at doctoral, master‘s, and bachelor‘s institutions in terms of autonomous motivation mean levels nor for the predictive effects of autonomous motivation on teaching best practices. The findings have implications for the faculty motivation and teaching research literatures as well as for faculty development initiatives aimed at improving teaching effectiveness.
Full version
Exploring perspectives on culturally inclusive practice: Institutional emphasis of diversity, inclusive coursework, and student gains
BrckaLorenz, A., Kinzie, J., Hurtado, S., & Sanchez, B.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
In the last few decades, diversity, inclusion, and equity goals have proliferated across institutions in the US, and decades of research point to the benefits of culturally inclusive content and pedagogy on student outcomes. Despite these findings, it is not sufficient simply to know if students are exposed to these experiences; rather, we must understand how students interpret and perceive them as they relate to the institution‘s commitment to inclusion. Using data from undergraduates and faculty in a large-scale, multi-institution quantitative study, this paper presents findings regarding the ways students engage in culturally inclusive content and pedagogy, faculty practices for inclusivity, and how these influence students‘ educational gains and perceptions of institutional commitment to diversity, inclusion, and equity goals.
Full version
Faculty types and effective teaching: A cautionary exploration of how faculty spend their time
BrckaLorenz, A., Nelson Laird, T. F., Yuhas, B., Strickland, J., & Fassett, K.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
Most research on faculty time focuses on research productivity, leaving the time they spend on other activities largely unexplored. Time spent teaching is certainly as core to institutional missions as research and is more likely to shape students‘ experiences and learning. This large-scale, multi-institution study of over 16,000 full-time faculty examines how much time they spend on teaching, research, and service. Five distinct groups, based on time use, are described. Additionally, the relationships between the groupings and the use of effective educational practices are explored. Surprising results, such as teaching-heavy faculty scoring the lowest on measures of teaching effectiveness, raise questions about faculty roles and autonomy and what conditions inspire the use of best practices in teaching.
Full version
Measuring the diversity inclusivity of college courses: An update
Nelson Laird, T. F., Hurtado, S. S., & Yuhas, B.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
In our current educational and national contexts, few things matter more than finding ways to facilitate learning across differences. Including diversity in the college curriculum is one well-established way to promote this learning. In this update to Nelson Laird‘s (2011) work, we use questionnaire responses from 4,468 faculty at 42 colleges and universities to show that all types of faculty are including diversity in some aspects of their courses, while certain faculty?such as women, faculty of color, and those who perceive a strong commitment to diversity among the people at their institutions?are more likely to include diversity than their colleagues. We discuss implications for faculty, faculty development, and students in the paper.
Full version
Student and faculty perspectives on the emphasis of inclusive and culturally engaging coursework
Silberstein, S. & BrckaLorenz, A.
American Educational Research Association Annual Meeting, New York, NY, 2018, April.
Higher education provides opportunities for students from homogeneous backgrounds to be introduced to new concepts and experiences, and it has the potential to create environments that engage and include students from marginalized backgrounds. It is not enough to strive for structural diversity; institutions should intentionally create formal diversity experiences, such as coursework focused on inclusive and culturally engaging activities. This large-scale, multi-institution study of undergraduate and faculty perceptions of inclusive and culturally engaging coursework gives insight into the ways faculty create supportive environments in their classrooms and the students who are participating in these activities. This paper focuses on areas in which campuses are succeeding in creating more inclusive and culturally engaging classroom environments and areas that need improvement.
Full version
Undergraduate financial knowledge and the role of financial education programming
Fosnacht, K., & Dugan, B. J.
NASPA Annual Conference, Philadelphia, PA, 2018, March.
College is an increasingly risky investment for students due to increased cost burden placed on students and their families and the associated student debt. In response, colleges and universities have increased their financial education programming hoping to mitigate some of the deleterious effects of this change. Therefore, we conducted an exploratory analysis of financial education programming by examining its relationship with financial knowledge. After holding other characteristics constant, we found little efficacy of many types of financial education programming. The single program with a significant and positive relationship was student loan counseling, which had a small to trivial influence on financial knowledge. Consequently, colleges and universities should reevaluate their financial education efforts to examine if these resources are being spent wisely.
Full version
Biracial students’ collegiate interactions and perceptions of the campus environment
BrckaLorenz, A., Harris, J., & Nelson Laird, T.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
The purpose of this research is to focus on the amount of and relationship between biracial students‘ collegiate interactions and their perceptions of the campus environment. Findings from this research explore an often understudied biracial student population and complicate the assumption that biracial students are a monolithic group.
Full version
High-impact practices: Is the impact positive or negative for students of color?
McCormick, A. C., Kinzie, J., & Gonyea, R. M.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
Although high-impact practices are promoted as mechanisms to improve the quality of undergraduate education for all students, it has been suggested that they may create the opportunity for distinctly negative, harmful experiences for students of color. This study examines the impact of HIP participation within racial/ethnic groups, finding generally positive effects.
Full version
Marginalization at the crossroads: Exploring the experiences of queer students of color
BrckaLorenz, A., & Clark, J.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
Queer students of color present a unique combination of marginalized racial and sexual identities. In this large-scale multi-institutional study, we explore the engagement, perceptions of campus environment, and satisfaction of thousands of queer students of color. Results highlight some of the struggles and successes of this often-silenced group of students.
Full version
Peering into the box of grit: How does grit influence the engagement of undergraduates?
Fosnacht, K., Copridge, K., & Sarraf, S.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
Angela Duckworth‘s concept of grit has become a popular way for admissions leaders to incorporate non-cognitive traits into admissions decisions. Despite this popularity, the validity of grit has been questioned by numerous scholars. This study investigated the construct and concurrent validity of the Short Grit Scale (Grit-S) using a large multi-institutional sample of first year and senior students. It also examined the measurement invariance of Grit-S to examine if the scale varied across populations. The results indicate that the criterion validity of Grit-S is not suitable for usage in high-stakes situations. However, the scale seems to be relatively invariant across important subgroups. The concurrent validity analyses revealed that one dimension of grit, perseverance of effort, was significantly and positively correlated to the NSSE Engagement Indicators, a perceived gains scale, time spent studying, and GPA. However, the second dimension of grit was frequently negatively related to the same measures.
Full version
Religious intolerance on campus: A multi-institutional study
Broderick, C., & Fosnacht, K.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
Incidents of religious intolerance and discrimination have become too common in American society and today‘s college campuses are not immune to these incidents. Previous research has shown the negative influence of perceived hostile campus cultures on students‘ overall learning and development. This study investigated the religious and spiritual discrimination experiences of college and university students. With particular attention paid to students‘ self-identified religious/spiritual identities, the study found that students who identify with a non-Christian, World faith tradition experienced a greater number of discriminatory acts than their Christian peers. Additionally, the results show that a greater respect for beliefs on campus was negatively correlated with experiencing acts of religious intolerance. In contrast, increased comfort in expressing religious and spirituality beliefs on campus was positively related to greater incidents of religious intolerance.
Full version
Viewing higher education as a sea of islands: The impact of student engagement on cultural validation of Native Hawai'ian and Pacific Islander students
Saelua, N., Ribera, A., BrckaLorenz, A., & Museus, S. D.
Association for the Study of Higher Education Annual Conference, Houston, TX, 2017, November.
Knowing that culturally diverse students find validation to be a motivating factor for their success on college and university campuses, this large-scale multi-institution study of Native Hawaiian and Pacific Islander (NHPI) students examines their views on cultural validation and specific forms of engagement that can help NHPI students feel valued.
Full version
The role of religion and spirituality in promoting a positive campus culture: A multi-institutional study
Fosnacht, K., & Broderick, C.
American Educational Research Association Annual Meeting, San Antonio, TX, 2017, May.
Discriminatory acts against religious minorities at our nation‘s college campuses has been too common. Previous research has linked discrimination to perceptions of a hostile campus climate, which negatively influences students learning and development. This study investigated the correlates of two measures that capture students‘ perception of the campus climate. It pays particular attention to the role of religious identity and attending a religiously affiliated institution to assess how these factors influence students‘ perception of the respect for their beliefs and comfort in expressing their views on campus. The results indicate few differences by religious identity in students‘ perception of the respect for their beliefs, but significant differences by religion in their comfort in expressing their views. Additionally, attending a religiously affiliated institution was positively correlated with students‘ comfort in expressing their beliefs, even for religious minorities.
Full version
Typology of students: A view from student transition from high school to college
Mu, L., & Cole, J.
American Educational Research Association Annual Meeting, San Antonio, TX, 2017, May.
Several recent studies have successfully identified several college student types. One limitation of past studies has been their reliance on one-time cross sectional assessments. As a result, we are left to ponder the stability or consistency of student behaviors as the academic year progresses. This study uses longitudinal data of student engagement to investigate the stability of student engagement typology. Guided by behavioral consistency theory, this study explores the supportive elements of educational settings in order to find those under which students‘ behavior-based types are more likely to change. Results showed that there are generally four student types based on their engagement in a variety of activities. In higher education settings, most students stick to a pattern of behaviors while a small portion changed compared with their engagement types in high school. Students‘ background characteristics and institutional environment showed association with these shifts.
Full version
A comparison of international students’ engagement and faculty perceptions of international student engagement
Wang, R., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, San Antonio, TX, 2017, April.
With the exponential growth of international students pursing degrees at U.S. colleges and universities, an increasing number of faculty and staff have brought up questions and concerns about supporting international students‘ academic engagement and success. Although prior studies have explored the educational experiences of international students in the US, only a small number of them have investigated international student engagement at four-year institutions. Little is known about faculty‘s approaches to international student engagement and how they may differ from international students‘ self-reported engagement. Using large-scale and multi-institutional survey datasets, this quantitative study aims to explore international student engagement in learning strategies, collaborative learning, and student-faculty interaction, and to compare international student engagement from the perspectives of faculty and students. Recommendations on supporting international student engagement from an individual faculty level, department level, and institutional level are discussed in the end.
Full version
Applying item response theory to examine extreme survey response style
Wang, X., Ribera, A. K., & Gonyea, R. M.
American Educational Research Association Annual Meeting, San Antonio, TX, 2017, April.
Response style effect is a well-known survey limitation. By applying a generalized item response theory (IRT) model to the Global Perspective Inventory data from the 2014 National Survey of Student Engagement (NSSE), this study provides estimates of college students‘ extreme response style (ERS) tendency. Furthermore, findings reveal significant group differences in ERS tendency by two student characteristics?first-generation status and major choice (STEM vs non-STEM).
Full version
Social desirability bias and faculty respondents: Is ?good behavior? harming survey results?
Miller, A. L., & Dumford, A. D.
American Educational Research Association Annual Meeting, San Antonio, TX, 2017, April.
Social desirability bias has long been a concern for survey researchers, with mixed findings for student self-reports in higher education. To extend this research, the current study investigates the potential presence of social desirability bias in faculty surveys. In addition to the core Faculty Survey of Student Engagement, this study used responses from a social desirability measure given to 1,574 faculty members at 18 institutions. A series of 10 step-wise OLS regression analyses looking at engagement indicators (while controlling for other faculty and institutional characteristics) suggest that in all cases, social desirability bias does not seem to be a major factor in faculty survey responses. However, it is also important to consider how some items are ?sensitive? for specific populations.
Full version
The role of religion/spirituality in promoting a positive campus culture
Fosnacht, K., & Broderick, C.
American College Personnel Association Annual Convention, Columbus, OH, 2017, March.
Postsecondary institutions are frequently forced to respond to discriminatory acts, including those against religious minorities. Such acts can create the perception of a hostile campus climate for students, which impinges on their learning and development. Campus climate research has traditionally focused on race and sex, but has largely neglected other important aspects of students' identities like religion and spirituality. In this study, we investigated how the religious/spiritual aspects of the campus climate influenced students' perceptions of the overall campus climate using data from a multi-institutional sample of first-year and senior undergraduates. Our multivariate results show that the religious/spiritual dimensions of the campus climate account for a significant proportion of the variance in students' campus climate perceptions.
Full version
Found my place: The importance of faculty relationships for seniors’ sense of belonging
Miller, A. L., Williams, L. M., & Silberstein, S. M.
John C. Dalton Institute on College Student Values, Tallahassee, FL, 2017, February.
The current study sought to explore whether senior students‘ faculty-related engagement influences their sense of belonging, particularly their feelings of institutional acceptance. This study utilizes data from the National Survey of Student Engagement (NSSE) to explore these relationships. Results suggest that increased student-faculty interaction, use of effective teaching practices, and participation in research with faculty have a positive impact on feelings of institutional acceptance for seniors. Furthermore, certain student demographics, college experiences, and institutional characteristics also play a role in this aspect of belongingness. Institutions can use this information to increase programming and resources directed at improving student engagement with faculty.
Full version
Employing quasi-experimental methods to relate first-year student participation in research with faculty to desired outcomes
Fosnacht, K., & Zilvinskis, J.
Association for the Study of Higher Education Annual Conference, Columbus, IN, 2016, November.
Undergraduate research opportunities with faculty are becoming increasingly common and previously been found to positively influence student learning. However, the literature on this activity is generally weak methodologically and/or is not generalizable. This study uses quasi-experimental
methods to examine the influence of research with faculty using a large national sample. We found that research with faculty experiences had significant and positive effects on
multiple aspects of student engagement for a sample of first-year students, particularly student-faculty
interaction. Additionally, we found differential effects of undergraduate research participation between STEM and non-STEM majors. Implications for policy and practice are discussed.
Full version
Examining student-faculty interaction among Black/African American female undergraduates: An in-depth analysis of NSSE 2008&ndash2012 data
Wheatle, K. I. E., Davis, L. P., & BrckaLorenz, A.
Association for the Study of Higher Education Annual Conference, Columbus, OH, 2016, November.
The current study examines student-faculty interaction by employing OLS regression models on a large-scale sample of student engagement survey data to compare Black female interaction with faculty to their Black male, White female, and White male peers. Within-group analyses will reveal impact of various student characteristics among Black women students.
Full version
First-year students' time use in college: A latent profile analysis
Fosnacht, K., McCormick, A. C., & Lerma, R.
Association for the Study of Higher Education Annual Conference, Columbus, OH, 2016, November.
Students‘ time expenditures influence their learning and development. This study used latent profile analysis to identify a typology of how first-year students spend their time using a large, comprehensive sample. It identified four time usage patterns by first-year students titled balanced, involved, partiers, and parents. Sex, expected major field, on-campus residency, age, Greek-life membership, and standardized test scores were predictive of students‘ time use patterns. Implications for policy and practice are discussed.
Full version
Effective advising: How academic advising influences student learning outcomes in different institutional contexts
Mu, L., & Fosnacht, K.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
Using survey data from 156 bachelor‘s-granting institutions, this study explored the relationship between academic advising services and senior‘s grades and self-perceived gains. We found advising experiences has a positive relationship with students‘ grades and self-perceived learning gains. Additionally, our results indicate that the institutional advising climate is positively correlated with perceived learning gains, but not grades. The results also showed that the relationships of advising and students‘ learning and development varied across institutions. Implications for policy and practice are discussed.
Full version
High-impact practices and student-faculty interactions for gender variant students
BrckaLorenz, A., Garvey, J. C., Hurtado, S. S., & Latopolski, K.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
The vast amount of research on student success and engagement in college focuses on a narrative for majority student populations that does not account for unique experiences across social identities. This paper examines the experiences of gender variant students (i.e., students who do not identify as either cisgender men or women) regarding engagement in high-impact practices and student-faculty interactions using a large-scale, multi-institution quantitative data set. Although high-impact practice participation was similar for gender variant and cisgender students, positive student-faculty interaction was found to be a significant predictor for increased high-impact practice participation for gender variant students. Results from this study may also point to chillier climates of certain major fields for gender variant students. Implications for these findings focus on increasing gender variant students‘ participation in high-impact practices, creating more safe and positive learning environments for gender variant students, and advocating for the inclusion of different gender identities in surveys, institutional data, and higher education research.
Full version
Maintaining inequality: An analysis of college pathways among women at large public institutions
Tukibayeva, M., Ribera, A. K., Nelson Laird, T. F., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
Armstrong and Hamilton (2013) proposed a framework of three college pathways?party, professional, and mobility?that lead to economically unequal postgraduation outcomes and vastly different college experiences for female students. Using data from the National Survey of Student Engagement (NSSE), we examined the responses from 42,504 women seniors at 183 four-year large public institutions to identify how the potential income of their college major choice relate to the pathways. We found that the economic advantage of major choice is not equally distributed among students: party pathway students selected the least lucrative college majors, professional pathway students selected the most lucrative majors, and first-generation students on all pathways tended to select majors with less potential income than their peers with college-educated parents. Students on the three pathways also engaged differently in three measures of academic engagement (three of the ten NSSE Engagement Indicators): Reflective and Integrative Learning, Learning Strategies, and Student-Faculty Interaction.
Full version
Moving students to read: Unpacking the relationship with reflective and integrative learning
Wang, R., & Ribera, A. K.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
College students‘ reading motivation and reflective and integrative learning play a significant role in influencing students‘ academic performance and engagement. Understanding students‘ reading motivation will help faculty members adjust their course design and provide sufficient support and resources in order to accommodate student learning. Using data collected in 2013 from 47 four-year colleges and universities located in the U.S., this study explores individual characteristics of students who tend to be intrinsically motivated to read. This study also explores the relationship between intrinsic reading motivation and students‘ level of engagement in reflective and integrative learning. Recommendations for enhancing students‘ reading motivation and reflective and integrative learning are provided.
Full version
The teaching practices and time allocation of faculty and graduate student instructors
Wang, R., BrckaLorenz, A., & Nelson Laird, T.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
Few studies have compared teaching behaviors between faculty and graduate student instructors (GSIs). Using a large-scale multi-institution dataset, this study takes a closer examination of the variation of effective teaching practices, proportion of time spent on in-class activities, and time commitment on teaching-related activates of faculty and GSIs with different demographic and course characteristics. Results suggest that faculty utilize more effective teaching practices than GSIs across all demographic, course characteristics, and disciplines. Faculty spent a greater proportion of time in lecture and discussion, whereas GSIs spent more time in small-group activities. GSIs spent less time than faculty at different academic ranks in all teaching-related activities. This study recommends more resources and support should be provided to GSIs to enhance effective teaching practices and time management in teaching.
Full version
Understanding faculty experiences with discrimination: The role of intersecting identity and institutional characteristics
Hurtado, S., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Washington, DC, 2016, April.
Understanding the experience of faculty members has been an important focus of higher education literature, particularly the prevalence of discrimination for underrepresented populations. Experiences with discrimination have the potential to negatively impact aspects of faculty overall experience, including satisfaction and retention and perceptions of campus climate. Most previous literature focuses on one or two specific identity characteristics (e.g. gender and race/ethnicity) and less attention has been paid to ways in which various identity characteristics intersect in one‘s experience. Using a large-scale multi-institution data set, this quantitative study examines faculty experiences with discrimination by identity and institutional characteristics, its impact on faculty ability to work, and perceptions of institutional support. Findings indicate nearly half of faculty who experienced discrimination indicated it was based on two or more identities and of the identities provided, academic rank was the highest reported reason for discrimination.
Full version
Livin' on a prayer: A quasi-experimental investigation into the efficacy of learning communities
Fosnacht, K., & Graham, P. A.
American College Personnel Association Annual Convention, Montreal, QC, Canada, 2016, March.
With the increasing adoption of learning communities by post-secondary institutions, it is imperative to document their effectiveness, as the existing research is not definitive. In this study, we found that learning communities have a positive impact on students‘ engagement and perceived gains using a quasi-experimental approach, confirming previous research; however, learning communities do not appear to drastically alter the student experience on average. Additionally, we found that the estimated effect of learning communities varies widely across institutions on a variety of measures. Consequently, it appears that while some learning communities are extremely impactful, others have a negligible impact on students.
Full version
Living on campus: Does it still make a difference?
Graham, P. A., Hurtado, S. S., & Gonyea, R. M.
American College Personnel Association Annual Convention, Montreal, QC, Canada, 2016, March.
While the benefits of living on campus have been well documented, the changing landscape of living arrangements, programming efforts, and other factors underline the need to reexamine its impact. Using national survey data from first-year students, this study investigates the relationship of residential status with engagement and perceived gains in learning and development. Results indicate, after controlling for student and institution characteristics, that student residence has an inconsequential effect on the dependent variables. Implications for practice and additional research are discussed.
Full version
Looking across high-impact practices: First-year student democratic awareness & democratic participation
Weiss, H. A., & Fosnacht, K. J.
NASPA Annual Conference, Indianapolis, IN, 2016, March.
Creating educated and informed citizens for our diverse democracy has long been one of the objectives of the U.S. educational system. Traditionally, service-learning has been the primary tool for colleges and universities to promote civic outcomes; however, other practices also hold the potential to improve civic outcomes. In this study, we find that service-learning, learning communities, and research with faculty are positively and significantly correlated to two measures of democratic engagement for a multi-institutional sample of first-year students. The results have important implications for how postsecondary institutions promote civic outcomes.
Full version
Learning online: Unintended consequences for engagement?
Dumford, A. D., & Miller, A. L.
Hawaii International Conference on Education, Honolulu, HI, 2016, January.
A rapidly increasing number of colleges and universities are looking for ways to deliver course content online. This paper investigates the effects of taking courses through an online medium on students‘ engagement using data from the 2015 administration of the National Survey of Student Engagement (NSSE). A series of 10 OLS regression analyses, controlling for certain student and institutional characteristics, suggested several significant effects of taking online courses for first-year students as well as seniors. Students taking more courses using an online medium showed higher use of learning strategies and quantitative reasoning yet lower collaborative learning, student-faculty interactions, effective teaching practices, discussions with diverse others, and quality of interactions. The change in these engagement indicators based on the percentage of classes taken online reveals that the online environment might encourage certain types of engagement but not others.
Full version
Focus on the finish line: Does high-impact practice participation influence career plans and job attainment?
Miller, A. L., Rocconi, L. M., & Dumford, A. D.
Association for the Study of Higher Education Annual Conference, Denver, CO, 2015, November.
High-impact practices (HIPs) are an important component of student engagement in higher education, as they promote learning, development, and persistence among students. The goal of this study was to extend the research on HIPs to explore potential connections with HIP participation and career outcomes. Using data from the National Survey of Student Engagement, this study explores whether high-impact practice (HIP) participation influences plans for career and further education for graduating seniors, and whether HIP participation has a positive impact on job attainment for these students. The results of logistic and multinomial regression analyses suggest that even after controlling for a variety of other demographic and institutional factors, HIP participation is a significant predictor of future career plans and attainment. The findings are discussed in the context of the Chaos Theory of Careers (Pryor & Bright, 2003), which emphasizes the role of multiple influences and chance, as well as acknowledging nonlinear paths in career advising and development. HIP participation can give students a career-related advantage through transferable skill development, engaging in learning opportunities, and generating ?stories? for potential employers.
Full version
Graduate student instructors, their courses, and the support they need
BrckaLorenz, A., Wang, R., & Nelson Laird, T. F.
Association for the Study of Higher Education Annual Conference, Denver, CO, 2015, November.
While some existing literature exposes graduate students instructor‘s (GSIs) various approaches
to teaching, and the importance of professional development, there is little research on the ways
in which GSI characteristics may impact their needs and preferences for professional
development (Boman, 2013). Led by these gaps in the literature, this study explores the diverse
characteristics of GSIs employed at eight research universities in the U.S. and investigates the
ways in which these characteristics impact GSI needs for professional development and support
in teaching. The results of this study offer implications for practice and recommendations for
future research that enhance GSIs teaching and learning, as well as their overall graduate
education and preparation.
Full version
Undermatching and the first-year experience: Examining effect heterogeneity
Fosnacht, K.
Association for the Study of Higher Education Annual Conference, Denver, CO, 2015, November.
Academic undermatching, which occurs when a student with the academic credentials to compete for admission to a selective school enrolls at a substantially less-selective institution, has increasingly gained the attention of policymakers and researchers as a potential reason for the nation‘s lower-than-desired college completion rate. The relationship between undermatching and college outcomes, however, is not well understood. Following up on a previous study that found undermatching had mixed effects on outcomes in first-year students‘ engagement, perceived gains, and satisfaction, this study examines if these relationships vary by race/ethnicity, parental education, and gender. Results indicate that the relationship between undermatching and the aforementioned outcomes differed by race/ethnicity and gender but not by parental education. Implications for policy and practice are discussed.
Full version
An alternative approach: Using survey panels to inform assessment
Sarraf, S., Fernandez, S., Houlemarde, M., & Wang, X.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
As an experiment, eight mini-surveys based on selected items from the National Survey of Student Engagement (NSSE) were administered to 500 college students over an eight-week period. NSSE staff recruited participants from five diverse colleges and universities in order to investigate this alternative survey panel approach to see what impact it would have on various data quality indicators. Results indicate a dramatic increase in student participation rates and less missing data from those who responded.
Full version
Barriers in returning to learning: Engagement and support of adult learners
Rabourn, K. E., Shoup, R., & BrckaLorenz, A.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
Adult learners are a growing population in the U.S. postsecondary education system that experiences distinct barriers to academic success. However, higher education institutions continue to create and adhere to policies that favor traditional-age college students. Given that adult learners are becoming more common across the higher education landscape, it is important to better understand their experiences to ensure this population is supported to success. This study used data from the 2013 and 2014 administrations of the National Survey of Student Engagement to identify the characteristics of today‘s adult learners and to assess how their engagement differs from that of traditional-age students. We found that adult learners are more likely to take all of their classes online, begin their education at another institution, and enroll part time. Compared to their traditional-age peers, adult learners are more engaged academically and have more positive perceptions of teaching practices and interactions with others, but they interact less with peers and faculty and find their campuses to be less supportive.
Full version
Contextualizing student engagement effect sizes: An empirical analysis
Rocconi, L., & Gonyea, R. M.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
The concept of effect size?a measure of the strength of association between two variables?plays a crucial role in assessment, institutional research, and scholarly inquiry, where it is common with large sample sizes to find small or even trivial relationships or differences that are statistically significant. Using the distributions of effect sizes from the results of 984 institutions that participated in the National Survey of Student Engagement (NSSE) in 2013 and 2014, the authors empirically derived new recommendations for the interpretation of effect sizes which were grounded within the context of the survey. We argue for the adoption of new values for interpreting small, medium, and large effect sizes from statistical comparisons of NSSE Engagement Indicators, High-Impact Practices, and student engagement data more generally.
Full version
Does use of survey incentives degrade data quality?
Cole, J. S., Sarraf, S. A., & Wang, X.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
Overall, this study found little evidence that survey incentives negatively affect data quality. Our analyses showed minimal differences between incentive and non-incentive groups with regard to straight-lining, item skipping, total missing items, and survey completion. Contradicting Barge and Gehlbach‘s finding, we found, in fact, that incentive respondents actually had better data quality than non-incentive respondents. Measurement invariance analysis also demonstrated that the presence of an incentive did not compromise the validity of NSSE Engagement Indicator scores or the underlying factor structures. The current study‘s findings with such a robust sample should allay any serious concerns NSSE users may have about incentives undermining data quality.
Full version
Item nonresponse bias on the Faculty Survey of Student Engagement
Chiang, Y.-C., & BrckaLorenz, A.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
Survey researchers often wonder about the impact of missing data and whether a sample with missing data is representative of a larger population. This study investigates the prevalence of item nonresponse bias among participants in the FSSE survey and its impact on the estimates of ten FSSE scale scores by comparing item nonresponse patterns across faculty-level characteristics such as gender identity, racial or ethnic identification, citizenship, employment status, academic rank, and the number of undergraduate or graduate courses taught. These analyses examined a set of FSSE items that comprise ten FSSE scales.
Full version
Mining text data for useful information
Zilvinskis, J.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
Text mining presents an efficient way to access the extensive amount of data found in written records by converting words into numbers and using algorithms to detect relevant patterns. This presentation focuses on the fundamentals of text mining, including an overview of key concepts, prevalent methodologies, and popular software packages. The utility of text mining is demonstrated through two examples: (1) using text to create a learning analytics system at a premier community college (CUNY Guttman), and (2) refining survey items on the National Survey of Student Engagement (NSSE).
Full version
Optimizing long surveys for smartphones: Why it’s important
Sarraf, S., & Cole, J.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
This discussion group addressed various questions related to optimizing a relatively long survey instrument for smartphones based on a National Survey of Student Engagement experimental administration. Colleges and universities across the country administer many surveys to their students, but optimizing them for smartphones may not be receiving the necessary attention it deserves. With this in mind, the following questions were addressed based on a paper: Why should survey developers consider optimizing their instruments for smartphones? What impact can smartphone optimization have on various survey data quality indicators? What does a smartphone-optimized survey format look like?
Full version
Using canonical correlation analysis to examine student engagement and learning
Zilvinskis, J., Masseria, A., & Pike, G. R.
Association for Institutional Research Annual Forum, Denver, CO, 2015, May.
Using canonical correlation analysis, this study examines the relationships between measures of student engagement from NSSE and perceived gains in learning. The study draws on institution-level data from NSSE participants in 2011 and 2013. Several significant relationships were found between engagement and learning. For example, learning outcomes associated with application, like acquiring job-related skills, were positively associated with the engagement indicators of quantitative reasoning and collaborative learning. This presentation also provides attendees with an introduction to the logic and methods underlying canonical correlation analysis.
Full version
What is the impact of smartphone optimization on long surveys?
Sarraf, S., Brooks, J., Cole, J., & Wang, X.
American Association for Public Opinion Research Annual Conference, Hollywood, FL, 2015, May.
Using results from a ten-institution experiment that used the 2015 National Survey of Student Engagement (NSSE), this study details the impact that smartphone optimization has on a survey with over 100 questions. The study's research questions center on how optimizing a survey for smartphones affects various data quality indicators including early abandonment, missing data, item nonresponse, duration, straight-lining, and subjective student evaluations. The study also investigates scale measurement invariance for NSSE's ten Engagement Indicators. Results indicate that the smartphone-optimized survey format outperforms both smartphone-unoptimized and desktop survey formats in several ways.
Full version
Civic engagement, service-learning, and faculty engagement: A profile of Black women faculty
Wheatle, K., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
Existent research on African American (or Black) women faculty suggests that they are disproportionately overlooked during the tenure and promotion process, largely due to the academy‘s overvaluing of research activities and undervaluing of service-based and teaching activities. These studies largely utilize qualitative inquiry to develop a narrative about the experiences of Black women faculty. The current study seeks to test this narrative quantitatively by using a large-scale sample of faculty engagement survey data to compare Black women faculty‘s encouragement of civic engagement and use of service-learning to that of their Black male, White female, and White male counterparts. Findings suggest that Black women faculty are more encouraging of civic engagement among their students and include more service-learning within their courses than others.
Full version
Global perspectives in curricula and deep approaches to learning: Examining faculty practices for engagement
Peck, L., Chiang, Y.-C., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
Many higher education institutions today are placing a high level of importance on internationalization. One of the most popular means of providing students with a global perspective is through internationalizing a course curriculum. Global learning experiences in the classroom are seen as a way to expose students to multiple points of view on issues and foster cross-cultural understanding. Using results from the 2014 administration of the Faculty Survey of Student Engagement (FSSE), this study compared faculty use of global perspectives in student learning to their use of reflective and integrative learning and higher order learning practices?to see how the two are related. The influences of faculty characteristics, such as gender and academic rank, as well as institutional characteristics, will also be explored.
Full version
Revisiting the relationship between institutional rank and student engagement
Zilvinskis, J., & Rocconi, L. M.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
Using data from the 2013 administration of the National Survey of Student Engagement (NSSE),
multilevel models were employed to explore the relationship between student engagement and
three institutional ranking schemes: U.S. News, Forbes, and Washington Monthly. Findings
reveal few relationships exist between NSSE‘s measures of student engagement and the three
institutional ranking schemes, except for a negative relationship between the three ranking
schemes and student-faculty interactions; implications of these findings are included.
Full version
Seeking advice: An exploratory analysis of how often first-year students meet with advisors
Fosnacht, K., McCormick, A. C., Nailos, J., & Ribera, A. K.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
While it is well understood that academic advising helps students adjust to and deal with the challenges of college, little is known about what influences the extent of their interactions with advisors. Using data from 52,546 full-time, first-year students at a diverse set of 209 institutions, we examined how often students met with academic advisors, and how this varies by student and institutional characteristics. We find that the typical first-year student met with an advisor one to three times during their first college year. However, the number of meetings varied across student subpopulations and institution types. Findings aim to inform wider discussions about academic advising and student support on college campuses.
Full version
Social media: An opportunity for engaging undergraduates
Yuhas, B., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
The rise of online social media within the past decade has had a profound influence on the way we connect with others and will likely continue to be a meaningful component of students‘ lives, campus culture, and the college experience. This large-scale study of students at four-year colleges and universities examines the engaging and disengaging use of social media sites (SMS) on campuses. Additionally, this study examines how SMS use varies by student characteristics and relates to other forms of educationally effective engagement. Results indicate that SMS use cuts equally across many, but not all, student characteristics. In addition, SMS use can be both a substantive distraction from engagement as well as a tool for increased positive engagement.
Full version
What characteristics predict student-faculty interaction and important relationships with effective educational practice
Wang, R., BrckaLorenz, A., & Chiang, Y.-C.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
Student-faculty interaction is significantly beneficial to college students‘ engagement and success. Past studies of student-faculty interaction (SFI) have focused on the relationship between student characteristics and SFI or between faculty members‘ qualities, skills, or approaches and SFI. This study uses a large-scale multi-institution data set to take a closer examination of the relationships between faculty characteristics, course characteristics, institutional characteristics, faculty course goals, and faculty values for campus support with SFI. Results suggest that several faculty, course, and institution characteristics predict increased SFI. Additionally, results also indicate that faculty who do more to structure their courses for student growth and development and more strongly value a supportive campus environment for students interact with students more frequently.
Full version
What influences end-of-course evaluations? Teaching and learning vs. instrumental factors
McCormick, A., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Chicago, IL, 2015, April.
Student evaluations of courses and teaching in the form of end-of-course surveys are ubiquitous in higher education, and at many institutions they serve as the primary basis for evaluating teaching effectiveness in the promotion and tenure process. Course evaluations of teaching are also controversial. It is often asserted that students use them to reward professors for easy courses and punish them for demanding ones, and many faculty believe that students‘ evaluations are influenced by their expected grade. This study investigates the relative influence of teaching and learning versus instrumental influences in students‘ overall course evaluation ratings using data from a diverse sample of 44 four-year institutions.
Full version
Don’t put baby in the corner alone: Where and with whom students live can impact their peer belonging and institutional acceptance
Dumford, A. D., Ribera, A. K., & Miller, A. L.
NASPA Annual Conference, New Orleans, LA, 2015, March.
With current concerns about graduation rates, it is crucial that students feel a sense of belonging during their transition to college and throughout their college experience. The purpose of this study is to explore the effects of where students live and with whom they share their living space on how students perceive their integration with peers as well as with their institution. Data from the 2014 administration of the National Survey of Student Engagement are used to explore the benefits and disadvantages of different living situations. Implications for these results are also discussed.
Full version
Information use during the first college year: Findings from the NSSE Experiences with Information Literacy module
Fosnacht, K.
Association of College & Research Libraries Annual Conference, Portland, OR, 2015, March.
Using data collected from over 17,000 first-year students attending 76 bachelor‘s-granting U.S. institutions, this study investigated how often students engage in activities associated with developing information literacy skills. It found that most students frequently used information sources in their coursework, but substantially fewer students critically and effectively used information sources. It conducted a latent class analysis which identified four distinct ways or types first-year students engaged with information sources. The study also conducted a multinomial logistics regression analysis to investigate which student and institutional characteristics were correlated with the four latent classes identified.
Full version
Promoting democratic engagement during college: Looking beyond service-learning
Howe, E. C., & Fosnacht, K.
NASPA Annual Conference, New Orleans, LA, 2015, March.
Preparing students to be engaged participants in our democratic society has long been an important college outcome. Over the past few decades, postsecondary institutions have primarily attempted to improve civic outcomes by integrating service activities into their curricula. While research on the impacts of service learing is plentiful, research on how other educationally beneficial activities influences democratic outcomes is scarce. In this study, we find that service-learning may not be a panacea for promoting democratic outcomes, as other high-inpact practices, most prominently learning communities, had greater or equivalent relationship to two dimensions of democratic engagement.
Sense of peer belonging and institutional acceptance in the first year: The role of high-impact practices
Ribera, A. K., Miller, A. L., & Dumford, A. D.
American College Personnel Association Annual Convention, Tampa, FL, 2015, March.
This study examines the role that high-impact practices play in shaping first-year students' sense of belonging as it relates to peers and institutional acceptance. Using data from the National Survey of Student Engagement (n=9,371), results reveal troublesome gaps for historically underrepresented populations in their sense of belonging among their peers and affiliation with the institution. Yet, when students participated in certain high-impact practices (learning communities, service-learning, research with faculty, and campus leadership), positive associations were found, even after controlling for other institutional and student-level characteristics. Implications for first-year programming are discussed.
Engaging in the margins: Exploring differences in biracial students' engagement by racial/ethnic makeup
Harris, J., BrckaLorenz, A., & Nelson Laird, T.
Association for the Study of Higher Education Annual Conference, Washington, DC, 2014, November.
Due to socio-historical understandings of race in America and traditional methods of data collection and analysis, biracial undergraduate students‘ engagement in college remains unexplored. This research utilizes a national data set to shed light on the biracial student population and their engagement on campus. Findings problematize the ideology that biracial individuals are a monolithic group, fostering an overdue conversation concerning biraciality in higher education and providing critical implications for future research and practice.
Full version
Exploring the effects of a HIP culture on campus: Measuring the relationship between the importance faculty place on high-impact practices and student participation in those practices
Nelson Laird, T., BrckaLorenz, A., Zilvinskis, J., & Lambert, A.
Association for the Study of Higher Education Annual Conference, Washington, DC, 2014, November.
This study explores campus cultures that value high-impact practices by examining the relationship between the importance faculty place on high-impact practices and student participation in six different educationally beneficial high-impact activities. We further explore how faculty and institutional characteristics affect the importance faculty place on undergraduate high-impact practice participation.
Full version
Participation in undergraduate research at minority-serving institutions
Haeger, H., BrckaLorenz, A., & Webber, K.
Association for the Study of Higher Education Annual Conference, Washington, DC, 2014, November.
Despite the prevalence and effectiveness of undergraduate research, there is little information on undergraduate research participation at minority-serving institutions (MSIs), nor how undergraduate research affects educationally effective engagement for underrepresented minority (URM) students. This research examines undergraduate research participation at MSIs, predictors of participation for URM students, and benefits of participation.
Full version
Exploring how course evaluation outcomes are collected, shared, and used
BrckaLorenz, A., McCormick, A., & Peck, L.
Association for Institutional Research Annual Forum, Orlando, FL, 2014, May.
End of course evaluations are a widely used means of assessing student learning experiences and provide opportunities for faculty to refine their teaching and course content. However, the way institutions collect and share those results varies. Using data from the 2013 National Survey of Student Engagement and Faculty Survey of Student Engagement administrations, this presentation examines how different types of institutions collect and distribute course evaluation results, how much students access course evaluation information, and how much faculty use course evaluation information to improve their courses and teaching. Student use of external evaluation sources (e.g., ratemyprofessor.com) to select courses is also be examined.
Full version
Exploring how course evaluation outcomes are collected, shared, and used
BrckaLorenz, A., McCormick, A., & Peck, L.
Association for Institutional Research Annual Forum, Orlando, FL, 2014, May.
End of course evaluations are a widely used means of assessing student learning experiences and provide opportunities for faculty to refine their teaching and course content. However, the way institutions collect and share those results varies. Using data from the 2013 National Survey of Student Engagement and Faculty Survey of Student Engagement administrations, this presentation examines how different types of institutions collect and distribute course evaluation results, how much students access course evaluation information, and how much faculty use course evaluation information to improve their courses and teaching. Student use of external evaluation sources (e.g., ratemyprofessor.com) to select courses is also be examined.
Full version
Survey lottery incentives and institutional response rates: An exploratory analysis
Sarraf, S., & Cole, J.S.
Association for Institutional Research Annual Forum, Orlando, FL, 2014, May.
Many institutional and educational researchers are well aware that response rates for assessment surveys have been declining over the past few decades (Dey, 1997; Laguilles, Williams, & Saunders, 2011). As a result, many researchers have noted that our ability to adequately assess student academic experiences, satisfaction, engagement, use of campus resources, and other
important topics in higher education are at risk (Pike, 2008). Consequently, use of incentives are one tool that many institutional researchers have come to rely on to boost or hold steady their response rates for various campus student surveys. Though research regarding the efficacy of incentives to boost survey response rates in higher education is scant, the research that does exist suggests that incentives are an effective way to boost institutional response rates (Heerwegh, 2006; Laguilles, Williams, & Saunders, 2011). The purpose of this study is to investigate the efficacy of lottery incentives (the mostfrequently used incentive approach) to boost responses rates for institutions using the National Survey of Student Engagement (NSSE).
Full version
Taking surveys with smartphones: A look at usage among college students
Sarraf, S., Brooks, J., & Cole, J.
American Association for Public Opinion Research Annual Conference, Anaheim, CA, 2014, May.
The widespread adoption of mobile technologies has dramatically impacted the landscape for
survey researchers (Buskirk & Andrus, 2012), and those focusing on college student populations are no exception. The National Survey of Student Engagement (NSSE), one of the largest U.S. college survey assessment projects, annually surveys hundreds of thousands of undergraduate students at college and university campuses throughout the United States and Canada. Internal NSSE analyses show the number of smartphone respondents is increasing each year.1 This analysis showed that in 2011, only about 4% of
NSSSE respondents used a smartphone, but by 2013 that figure had increased to 13%. Preliminary
results from the 2014 administration suggest the percentage continues to increase, with roughly 18% of respondents using smartphones to complete the survey. Using 2013 NSSE data, the purpose of this study is to examine college student demographics and engagement results by smartphone respondent status. The results of this study will provide insights into the prevalence of college?aged survey respondents using smartphones, and the impact this technology has on survey responses.
Full version
Testing the new scales on the Faculty Survey of Student Engagement
BrckaLorenz, A., Chiang, Y.-C., & Nelson Laird, T.
Association for Institutional Research Annual Forum, Orlando, FL, 2014, May.
The Faculty Survey of Student Engagement (FSSE) annually collects information from thousands of faculty at baccalaureate degree-granting colleges and universities about student engagement both in and out of the classroom. With the update to the FSSE instrument in 2013, new scales were rigorously tested to aid in reporting and discussions about student engagement. FSSE staff have documented the array of analyses and tests used to evaluate the quality of these scales, including descriptive analysis and studies of validity and reliability.
Full version
Testing the new scales on the Faculty Survey of Student Engagement
BrckaLorenz, A., Chiang, Y.-C., & Nelson Laird, T.
Association for Institutional Research Annual Forum, Orlando, FL, 2014, May.
The Faculty Survey of Student Engagement (FSSE) annually collects information from thousands of faculty at baccalaureate degree-granting colleges and universities about student engagement both in and out of the classroom. With the update to the FSSE instrument in 2013, new scales were rigorously tested to aid in reporting and discussions about student engagement. FSSE staff have documented the array of analyses and tests used to evaluate the quality of these scales, including descriptive analysis and studies of validity and reliability.
Full version
Bridge or barrier: The impact of social media on engagement for first-generation college students
Haeger, H., Wang, R., & BrckaLorenz, A.
American Educational Research Association Annual Meeting, Philadelphia, PA, 2014, April.
Social media, such as Facebook and Twitter, are an integral part of communication for today‘s college students. This research explores whether this shift in communication functions to create more connections or whether it functions as another avenue for social reproduction of privilege for first-generation college students. Analysis on how first-generation students use social media to build and maintain social connections along with what factors most impact the formation of social capital through social media suggests that first-generation students use social media less than their peers, especially in building new relationships and in learning about events on campus. Despite this, social media use is still an important tool in making connections to peers and faculty on campus for first-generation students.
Full version
Selectivity and the college experience: How undermatching shapes the college experience among high-achieving students
Fosnacht, K.
American Educational Research Association Annual Meeting, Philadelphia, PA, 2014, April.
This study examined how undermatching impacts the college experiences of high achieving first-year students. Using propensity score modeling, it found that undermatching was associated with less academic challenge, but higher levels of student-faculty interaction and active and collaborative learning. The results also indicate that undermatches report fewer gains in their learning and development and less satisfaction with their institution. The implications of undermatching and how to reduce its prevalence are discussed.
Full version
Financial stress and its impact on first-year students’ college experiences
Fosnacht, K., & Dong, Y.
Association for the Study of Higher Education Annual Conference, St. Louis, MO, 2013, November.
This study examined the relationship between undergraduate engagement and financial stress coping strategies. The study found that students who evidenced financial stress perceived a less supportive campus environment, but tended to participate in more academically beneficial activities. The results indicated that magnitude of the impact of financial stress varied by the type of financial stress coping strategy used.
Full version
How important are high response rates for college surveys?
Fosnacht, K., Sarraf, S., Howe, E., & Peck, L.
Association for Institutional Research Annual Forum, Long Beach, CA, 2013, May.
How important are high survey response rates for estimating population statistics related to the college experience? Given a general decline in survey participation rates among college students, the answer to this question has broad implications for institutional researchers who often use surveys. Survey methodologists have found that low response rates do not necessarily bias results. This study tests this proposition using results from about 250 colleges and universities that administered NSSE. Findings indicate that survey population estimates based on simulated low response rates are very similar to those based on actual high response rates.
Full version
Institutional satisfaction and the development of transferable skills
Miller, A., & Fosnacht, K.
Association for Institutional Research Annual Forum, Long Beach, CA, 2013, May.
Transferable skills, such as problem solving and analytical writing, play an important role
in students‘ appeal to prospective employers. This study explores whether senior students‘
development of these transferable skills were related to their perceptions of satisfaction with
their higher education institutions. Using data from the NSSE 2012 administration, regression
analyses suggest that problem solving skills were a significant positive predictor of institutional
satisfaction, even when controlling for other demographic and institutional characteristics.
Analytical writing skills were also a significant positive predictor of institutional satisfaction.
Full version
Senior leaders and teaching environments at Historically Black Colleges and Universities and Predominately White Institutions
Cole, E. R., Nelson Laird, T. F., & Lambert, A.
American Educational Research Association Annual Meeting, San Francisco, CA, 2013, May.
Various scholars have entered the conversation on the educational effectiveness of HBCUs in comparison to PWIs. There is, however, an absence of research that examines the potential relationship between teaching practices and how faculty feel senior leaders (e.g., deans, provosts, presidents) contribute to fostering an environment that enhances their classroom effectiveness. This study uses data from the 2012 administration of the Faculty Survey of Student Engagement (FSSE) to examine the differences between faculty perceptions of senior leaders on HBCU and PWI campuses. The results add to our understanding of how much senior leaders support both faculty teaching practices and teaching-related resources.
Full version
Student perspectives on the importance and use of technology in learning
BrckaLorenz, A., Haeger, H., Nailos, J., & Rabourn, K.
Association for Institutional Research Annual Forum, Long Beach, CA, 2013, May.
Under constant demands to improve the quality of higher education within an increasingly digital world, technology is often seen as a way to increase learning and collaboration on college campuses. The current generation of college students has grown up with technology, and these students are among the earliest adopters of new advances in technology (Jones, 2002; Haney, 2011). Allowing students to connect to their campus community, collaborate with peers, acquire new information, and demonstrate their learning through technology is essential for college campuses seeking to meet the needs of today‘s college students. Though access and use of technology is highest in traditional age college students, disparity still exists in who uses technology and at what age they are exposed to it (Jones et al., 2009; Pew Research Center, 2012; Wilson, Wallin, & Reiser, 2003). Race, gender, age, socioeconomic status, among other factors, can impact the level of technical proficiency students come to college with and should be considered in how technology is implemented on college campuses (Goode, 2010; Hargittai, 2010; Huang, Hood, & Yoo, 2012). In order to effectively use technology to improve education, we must investigate how students are currently using technology, what they want from their colleges in the use of technology, how technology impacts educational outcomes, and how these factors differ for different student populations. How do these perceptions of importance vary by different types of students and students in different institutional settings? To what extent has students‘ technology use enabled them to understand, demonstrate their understanding, or study on their own or with others? How does such uses of technology relate to other important forms of educationally effective engagement? This study uses a large-scale dataset to explore these issues and provide information to institutions of higher education to effectively implement greater technology use among students.
Full version
Exploring the effect of parental education on college students’ deep approaches to learning
Ribera, A. K.
American Educational Research Association Annual Meeting, San Francisco, CA, 2013, April.
This study provides insights into how students‘ deep approaches to learning may be directly and indirectly affected by parental education, a component of SES. Goyette and Mullen (2006) found that students from lower SES families tended to hold lower degree aspirations and favor vocationally-focused majors. Hansen (1997) reported that students from socially disadvantaged backgrounds were less likely to select into degree tracks that are common gateways into graduate school such as fields in the arts and sciences. While it appears students‘ educational aspirations and choice of major is partly influenced by their social upbringing, it is unclear if these decisions also affect how they approach learning. We also do not know if parental education has a direct impact on students‘ engagement in deep approaches to learning (DAL). The following study explores these issues in tandem.
How much effort is needed? The importance of response rates for estimating undergraduate behaviors
Fosnacht, K., Sarraf, S., Howe, E., & Peck, L.
American Educational Research Association Annual Meeting, San Francisco, CA, 2013, April.
Survey methodologists have found that low response rates do not necessarily bias results. This study tests this proposition using results from several hundred colleges that administered a student survey. Findings indicate that survey population estimates based on low response rates are very similar to those based on high response rates.
Full version
Undergraduates in the professional fields: Exploring the impact of institutional characteristics on time spent preparing for class
Ribera, A. K., Rocconi, L. M., & McCormick, A. C.
American Educational Research Association Annual Meeting, San Francisco, CA, 2013, April.
Using data from over 137,000 full time seniors enrolled at 543 four year colleges and universities in 2011, this study explores the relationship between the amount of time students spent preparing for class each week and both institutional context and field of study, with a particular focus on five professional fields (business, education, engineering, nursing, and allied health) relative to arts & sciences. Controlling for student and institutional characteristics, results indicate both systematic
differences in study time related to field of study and a positive relationship between selectivity, Carnegie type, and study time. Moderating effects were found between discipline and institutional selectivity, Carnegie type, and control. Findings promise to inform national and disciplinary discussions about academic rigor, student effort, and learning outcomes.
Full version
Undergraduate coping with financial stress: A latent class analysis
Fosnacht, K.
American College Personnel Association Annual Convention, Las Vegas, NV, 2013, March.
Undergraduates are increasingly caught between three financial realities. First, the sticker and net cost of attending college has outpaced the rate of inflation (Baum & Ma, 2012). These increases result from factors ranging from declining state subsidies (Quintero, 2012), increased enrollments (Bound & Turner, 2007), and effects of the 2008 recession (Baum & Ma, 2012). Second, in the decade between 2001 and 2011, family incomes declined across the entire income distribution after accounting for inflation (Baum & Ma, 2012). Therefore, many parents of undergraduates experienced financial hardship and
Were less able to pay for college costs. Finally, due to their low incomes and assets and lack of financial knowledge, students constitute a financially vulnerable population (Avard, Manton, English, & Walker, 2005; Berkner & Wei, 2006; Chen & Volpe, 1998; Murphy, 2005). Consequently, undergraduates have had difficulty absorbing the additional college cost burden placed upon them over time. The rapidly rising amount of student loans debt incurred per borrower highlights this fact (Baum & Payea, 2012). Due to these financial realities, a significant source of stress for undergraduates is their finances. In one recent national study, approximately a third of students recently described their finances as ?traumatic? or ?very difficult? to handle (American College Health Association, 2012). Another study, focusing specifically on financial stress, found even higher rates among a national sample of undergraduates and recent graduates (Trombitas, 2012).
Approximately a third of the respondents in the latter study stated that financial stress negatively impacted their academic performance or progress. An impression supported by previous research associating financial stress with dropping out of college, lower academic performance, anxiety, and depression (Joo, Durband, & Grable, 2008; McPherson, 2012; Ross, Cleland, & Macleod, 2006). The available evidence clearly indicates that undergraduates frequently experience financial stress; however, less is known about how first-year students react to financial stress and how it varies by demographic groups. To fill in this gap, this study investigated how undergraduates coped with financial stress and how coping strategies correlated with student characteristics.
Full version
Faculty emphasis on diversity conversations and conversations with diverse others
BrckaLorenz, A., Nelson Laird, T., & Shaw, M.
AAC&U Modeling Equity, Engaging Difference Conference, Baltimore, MD, 2012, October.
Using data from the Faculty Survey of Student Engagement (FSSE), this study examines how
often faculty structure class sessions around diverse topics and how often faculty report students having serious conversations with diverse others in their courses. Findings suggest that faculty most often structure course sessions around economic and social inequalities and report students having the most conversations with people of differing economic or social backgrounds. Faculty members‘ gender and race matter in predicting these measures of diversity in the classroom, but disciplinary area was the strongest predictor. Implications for assessment and institutional research are discussed.
Full version
Accuracy of self-reported grades: Implications for research
Cole, J. S., Rocconi, L., & Gonyea, R. M.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Digging deeper into institutional data: Enhancing campus assessment findings with the FSSE report builder
Cole, E. R., Nelson Laird, T. F., & Shaw, M. D.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Exploring the fringe benefits of supplemental instruction
Ribera, A. K., BrckaLorenz, A., & Ribera, T.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Faculty emphasis on diversity topics and conversations with diverse others
Nelson Laird, T. F., Shaw, M. D., Cole, E. R., BrckaLorenz, A., & Cervera, Y.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Using data from the Faculty Survey of Student Engagement (FSSE), this study examines how
often faculty structure class sessions around diverse topics and how often faculty report students having serious conversations with diverse others in their courses. Findings suggest that faculty most often structure course sessions around economic and social inequalities and report students having the most conversations with people of differing economic or social backgrounds. Faculty members‘ gender and race matter in predicting these measures of diversity in the classroom, but disciplinary area was the strongest predictor. Implications for assessment and institutional research are discussed.
Full version
Faculty fostering collaborative learning and personal and social responsibility
Ribera, T., Ribera, A.K., BrckaLorenz, A., & Nelson Laird, T.F.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Faculty lend a helping hand to student success: Measuring student-faculty
Lambert, A. D., Rocconi, L. M., Ribera, A. K., Miller, A. L., & Dong, Y.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
NSSE 2.0 launching in 2013! (NSSE demonstration session)
Kinzie, J., & Gonyea, R.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Playing with numbers: An examination of quantitative reasoning activities in college
Rocconi, L. M., Lambert, A. D., Sarraf, S. A., & McCormick, A. C.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Student and faculty member engagement in undergraduate research
Webber, K., Nelson Laird, T. F., & BrckaLorenz, A.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
The dependability of the NSSE 2012 pilot: A generalizability study
Fosnacht, K. & Gonyea, R. M.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Updating the National Survey of Student Engagement: Analyses of the NSSE 2.0 pilots
BrckaLorenz, A., Gonyea, R., & Miller, A.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Updating a large-scale survey is not a simple task. This paper gives an overview of how the National Survey of Student Engagement (NSSE) used quantitative analyses to update their survey over the course of several years and two survey pilot administrations. A description of the pilot instruments and pilot data will be followed with an overview of the quantitative methods used to analyze both individual items and groupings of items for the improvement of the survey. A brief overview of the results from these analyses gives a picture of how the 2013 NSSE evolved.
Full version
Using cognitive interviews to improve survey instruments
Haeger, H., Lambert, A. D., Kinzie, J., & Gieser, J.
Association for Institutional Research Annual Forum, New Orleans, LA, 2012, June.
Full version
Response quality and demographic characteristics of respondents using a mobile device on a web-based survey
Guidry, K. R.
American Association for Public Opinion Research Annual Conference, Orlando, FL, 2012, May.
Estimation of expected academic engagement behaviors: The use of vague quantifiers versus tallied responses
Cole, J. S., & Korkmaz, A.
American Educational Research Association Annual Meeting, Vancouver, British Columbia, Canada, 2012, April.
Full version
Examining the importance of teaching clarity: Findings from the Faculty Survey of Student Engagement
Ribera, T., BrckaLorenz, A., Cole, E., & Nelson Laird, T.
American Educational Research Association Annual Meeting, Vancouver, British Columbia, Canada, 2012, April.
Patterns in faculty teaching practices on the campuses of historically black colleges and universities and predominantly White institutions
Shaw, M. D., Cole, E. R., Harris, C. J., & Nelson Laird, T. F.
American Educational Research Association Annual Meeting, Vancouver, British Columbia, Canada, 2012, April.
Full version
Respondent use of straight-lining as a response strategy in education survey research: Prevalence and implications
Cole, J. S., McCormick, A. C., & Gonyea, R. M.
American Educational Research Association Annual Meeting, Vancouver, British Columbia, Canada, 2012, April.
Full version
Deeply affecting first-year students' thinking: The effects of deep approaches to learning on three outcomes
Nelson Laird, T. F., Seifert, T. A., Pascarella, E. T., Mayhew, M. J., & Blaich, C. F.
Association for the Study of Higher Education Annual Conference, Charlotte, NC, 2011, November.
Full version
Examining effective faculty practice: Teaching clarity and student engagement
BrckaLorenz, A., Cole, E., Kinzie, J., & Ribera, T.
Professional & Organizational Development Conference, Atlanta, GA, 2011, October.
Full version
Examining effective faculty practice: Teaching clarity and student engagement
BrckaLorenz, A., Cole, E., Kinzie, J., & Ribera, T.
Professional & Organizational Development Conference, Atlanta, GA, 2011, October.
Full version
Does college environment have the same effect on all students?
Dong, Y., & Cole, J. S.
Association for Institutional Research Annual Forum, Toronto, ON, Canada, 2011, May.
Full version
Estimating behavior frequencies
Cole, J. S., & Korkmaz, A.
Association for Institutional Research Annual Forum, Toronto, ON, Canada, 2011, May.
Full version
Identifying disciplinary peers: A process for classifying fields of study based on faculty
Shaw, M. D., Lambert, A. D., Haywood, A. M., Cole, E. R., & Nelson Laird, T. F.
Association for Institutional Research Annual Forum, Toronto, ON, Canada, 2011, May.
Full version
Adult learners' sense-making on academic success in college: A view from three urban commuter institutions
Ziskin, M., Zerquera, D., & Torres, V.
American Educational Research Association Annual Meeting, New Orleans, LA, 2011, April.
College readiness to be engaged
Qi, W., & Cole, J.
American Educational Research Association Annual Meeting, New Orleans, LA, 2011, April.
Full version
Predicting academic competence with in-class and out-of-class engagement: Within and cross disciplinary differences
Qi, W., & Cole, J.
American Educational Research Association Annual Meeting, New Orleans, LA, 2011, April.
Full version
Relationship between faculty perceptions of institutional participation in assessment and faculty practices of assessment-related activities
Haywood, A. M., Shaw, M. D., Nelson Laird, T. F., & Cole, E. R.
American Educational Research Association Annual Meeting, New Orleans, LA, 2011, April.
Full version
Understanding evidence-based improvement in higher education: The case of student engagement
McCormick, A. C., Kinzie, J., & Kormaz, A.
American Educational Research Association Annual Meeting, New Orleans, LA, 2011, April.
Full version
Assessment for improvement: Faculty perceptions of institutional participation in assessment by field
Haywood, A. M., Shaw, M. D., & Nelson Laird, T. F.
Association for the Study of Higher Education Annual Conference, Indianapolis, IN, 2010, November.
Going deep into mechanisms for moral reasoning growth: How deep learning approaches affect moral reasoning development for first-year students
Mayhew, M. J., Seifert, T. A., Pascarella, E. T., Nelson Laird, T. F., & Blaich, C. F.
Association for the Study of Higher Education Annual Conference, Indianapolis, IN, 2010, November.
A comparison of student and faculty academic technology use across disciplines
Guidry, K. R., & BrckaLorenz, A.
Association for Institutional Research Annual Forum, Chicago, IL, 2010, May.
Full version
Documenting institutional support of and faculty engagement in the scholarship of teaching and learning
Nelson Laird, T. F., & Ribera, T.
American Educational Research Association Annual Meeting, Denver, CO, 2010, May.
Interactive technology and effective educational practices
BrckaLorenz, A., & Garver, A. K.
Association for Institutional Research Annual Forum, Chicago, IL, 2010, May.
Full version
Establishing differences between diversity requirements and other courses with varying degrees of diversity inclusivity
Nelson Laird, T. F., & Engberg, M. E.
Association for the Study of Higher Education Annual Conference, Vancouver, British Columbia, Canada, 2009, November.
Examining the transfer student experience: Interactions with faculty, campus relationships, and overall satisfaction
McCormick, A. C., Sarraf, S. A., BrckaLorenz, A., & Haywood, A. M.
Association for the Study of Higher Education Annual Conference, Vancouver, British Columbia, Canada, 2009, November.
Full version
Analysis of multiple years of NSSE data: Tips and strategies
BrckaLorenz, A., & Williams, J. M.
Southern Association for Institutional Research Conference, Dallas, TX, 2009, October.
Full version
Analysis of multiple years of NSSE data: Tips and strategies
Williams, J. M., BrckaLorenz, A., Gonyea, R. M., Lambert, A. D., & Shoup, T. R.
Association for Institutional Research Annual Forum, Atlanta, GA., 2009, June.
High school and expected first-year engagement: A motivation perspective
Cole, J., & McCormick, A.
Association for Institutional Research Annual Forum, Atlanta, GA, 2009, June.
Full version
Measuring change: Using multi-year analysis of National Survey of Student Engagement results to assess educational improvement
Kinzie, J., McCormick, A., Korkmaz, A., & Buckley, J.
, Atlanta, GA, 2009, June.
Full version
The engagement of career and technical education students who transfer to four-year institutions
Qi, W., & Cole, J.
Association for Institutional Research Annual Forum, Atlanta, GA, 2009, June.
Full version
Time spent on research with undergraduate students: Gender differences among STEM faculty
Lambert, A. D., Garver, A. K., BrckaLorenz, A., & Haywood, A.
Association for Institutional Research Annual Forum, Atlanta, GA., 2009, June.
Full version
What’s the score? Diverse experiences among collegiate athletes and non-athletes
Cruce, T. M., & Nelson Laird, T. F.
Association for Institutional Research Annual Forum, Atlanta, GA, 2009, June.
Full version
When parents hover: Student engagement and helicopter parents
Shoup, R., Gonyea, R. M., & Kuh, G. D.
Association for Institutional Research Annual Forum, Atlanta, GA, 2009, June.
Full version
Engaging online learners: A quantitative study of postsecondary student engagement in the online learning environment
Chen, P. D., Guidry, K. R., & Lambert, A. D.
American Educational Research Association Annual Meeting, San Diego, CA, 2009, April.
Faculty at coeducational and women’s colleges: How do their teaching practices compare?
Nelson Laird, T. F., Niskod-Dossett, A. S., Garver, A. K., & Chen, D.
American Educational Research Association Annual Meeting, San Diego, CA, 2009, April.
Full version
How often is ?often? revisited: The meaning and linearity of vague quantifiers used on the National Survey of Student Engagement
Nelson Laird, T.F., Korkmaz, A., & Chen, P.D.
American Educational Research Association Annual Meeting, San Diego, CA., 2009, April.
Full version
Student-faculty research: Priming the pump for additional student-faculty contact
Buckley, J. A., Korkmaz, A. & Kuh, G. D.
American Educational Research Association Annual Meeting, San Diego, CA., 2009, April.
Full version
Writing, engagement, and successful learning outcomes
Gonyea, R. M., & Anderson, P.
American Educational Research Association Annual Meeting, San Diego, CA, 2009, April.
Full version
Accuracy of self-reported SAT and ACT test scores: Implications for research
Cole, J. S., & Gonyea, R. M.
Association for the Study of Higher Education Annual Conference, Jacksonville, FL, 2008, November.
Direct, indirect, and contingent relationships between learning community participation and educational outcomes
Pike, G. R., Kuh, G. D., & McCormick, A. C.
Association for the Study of Higher Education Annual Conference, Jacksonville, FL, 2008, November.
Full version
The disciplinary effects of undergraduate research experiences with faculty on selected student self-reported gains
Buckley, J. A., Korkmaz, A., & Kuh, G. D.
Association for the Study of Higher Education Annual Conference, 2008, November.
The impact of study abroad on senior year engagement
Gonyea, R. M.
Association for the Study of Higher Education Annual Conference, Jacksonville, FL, 2008, November.
Full version
The predictive validity of a measure of deep approaches to learning
Nelson Laird, T. F., Garver, A. K., Niskode-Dossett, A., Banks, J. V.
Association for the Study of Higher Education Annual Conference, Jacksonville, FL, 2008, November.
Full version
Understanding the diversity inclusivity of college courses
Nelson Laird, T. F.
Association for the Study of Higher Education Annual Conference, Jacksonville, FL, 2008, November.
Full version
Assessing and improving undergraduate education in the United States: The National Survey of Student Engagement
McCormick, A. C.
General Conference of the OECD Programme on Institutional Management in Higher Education, Paris, France, 2008, September.
Full version
Differences in high school engagement and college expectations between underachieving and overachieving students
Cole, J. S., & Gonyea, R. M.
Association for Institutional Research Annual Forum, Seattle, WA, 2008, May.
Full version
Gender & racial-ethnic gaps among entering science, technology, engineering and mathematics (STEM) majors
Cole, J. S., & Kinzie, J.
Association for Institutional Research Annual Forum, Seattle, WA, 2008, May.
Full version
The effect of teaching general education courses on deep approaches to learning: How disciplinary context matters
Nelson Laird, T. F., & Garver, A. K.
Association for Institutional Research Annual Forum, 2008, May.
Full version
How gender and race moderate the effect of peer interactions across difference on student and faculty perceptions of the campus environment
Nelson Laird, T. F., & Niskod, A. S.
American Educational Research Association Annual Meeting, New York, NY, 2008, March.
Full version
Engaging African American students: Compare student engagement and student satisfaction at HBCUs and their self-identified PWIs using National Survey of Student Engagement (NSSE) data
Chen, P. D., Ted, I., & Davis, L. K.
Association for the Study of Higher Education Annual Conference, Louisville, KY, 2007, November.
This study compares African American students‘ educational engagement and satisfaction at Historical Black Colleges and Universities (HBCU) and their self-identified peer Predominantly White Institutions (PWI). Data of this study came from the National Survey of Student Engagement (NSSE) that includes a sample of 1,631 seniors from 17 HBCUs and 2,939 seniors from 246 PWIs. The reuslts of this study show that African American seniors at HBCU‘s
are generally equally or more engaged in educationally purposeful activities than their peers at PWIs. However, the higher engagement of African American students at HBCUs does not translate into higher student satisfaction. A further investigation indicated that student‘s
relationships with administrative personnel and offices may be the prominent factor affecting
student satisfaction at HBCUs.
Gay, lesbian, bisexual, and transgender students and their engagement in educationally purposeful activities in college
Gonyea, R. M., & Moore, J. V.
Association for the Study of Higher Education Annual Conference, Louisville, KY, 2007, November.
Three research questions guided this study:
1. What are the demographic and enrollment characteristics of GLBT students attending four
year colleges? 2. What is the relationship of GLBT status to student engagement as represented by the NSSE benchmarks of effective educational practice? 3. Do GLBT students who are more open to others about their sexual orientation differ from those who are less open?
Full version
The relationship between gender and student engagement in college
Kinzie, J., Gonyea, R., Kuh, G. D., Umbach, P., Blaich, C., & Korkmaz, A.
Association for the Study of Higher Education Annual Conference, Louisville, KY, 2007, November.
This paper examines the engagement patterns of male and female undergraduates in different types of baccalaureate-granting institutions. Descriptive statistics and hierarchical linear modeling show that on balance, undergraduate women participate more frequently than their male counterparts in educationally purposeful activities. Male first-year and senior students devote less time and effort to academic challenge tasks, such as working hard to meet expectations and spending time studying; senior males also participated less often in active and collaborative learning activities. Institutional type is unrelated to gender differences in engagement. The results point to areas where institutions could focus efforts to enhance the quality of the undergraduate experience for all students.
Full version
Gender gaps: Understanding teaching style differences between men and women
Nelson Laird, T. F., Garver, A., & Niskod, A. S.
Association for Institutional Research Annual Forum, Kansas City, MO, 2007, June.
Using data from over 9,000 faculty that participated in the Faculty Survey of Student
Engagement, this study found gender differences in the percentage of class time spent on various
activities, a measure of teaching style, but that the gaps between men and women in lecturing
and active classroom practices, for example, can vary by factors including disciplinary area and
course size.
The individual and environmental effects of part-time enrollment status on student-faculty interaction
Nelson Laird, T. F., & Cruce, T. M.
American Educational Research Association Annual Meeting, Chicago, IL, 2007, April.
Based on over 55,000 responses from seniors at 224 public colleges and universities, this
study focuses on the difference between full-time and part-time students‘ interactions with
faculty, the effect of those interactions on self-reported gains in general education, and the
differential impact of institutions with greater percentages of part-time students. We found, not
surprisingly, that part-time students interact with faculty less and report slightly less gains in general education than their full-time peers. We also found that the proportion of part-time
students is a negative predictor of full-time student interactions with faculty, suggesting that
campuses with greater percentages of part-time students are negatively effecting the engagement
of full-time students. The effect of student-faculty interaction on self-reported gains in general education was relatively strong for all students (in fact, slightly stronger for part-time students), which implies that campuses that can find a way to increase the student-faculty interaction of full-time and part-time students will see a beneficial impact on student outcomes.
Full version
Unmasking the effects of student engagement on college grades and persistence
Kuh, G. D., Cruce, T., Shoup, R., Kinzie, J., & Gonyea, R. M.
American Educational Research Association Annual Meeting, Chicago, IL, 2007, April.
This study examines the relationships between student engagement, college GPA, and persistence for 11,000 students attending 18 baccalaureate-granting institutions. Data sources included student-level information from the National Survey of Student Engagement, academic transcripts, merit aid, and ACT/SAT score reports. Engagement had positive, statistically significant effects on grades and persistence between the first and second year of study for students from different racial and ethnic backgrounds. Equally important, engagement had compensatory effects for historically underserved students in that they benefited more from participating in educationally purposeful activities in terms of earning higher grades and being more likely to persist.
Full version
Gender gaps: Understanding teaching style differences between men and women
Nelson Laird, T. F., Garver, A. K., & Niskod, A. S.
Association for Institutional Research Annual Forum, Kansas City, MO, 2007.
Using data from over 9,000 faculty that participated in the Faculty Survey of Student
Engagement, this study found gender differences in the percentage of class time spent on various
activities, a measure of teaching style, but that the gaps between men and women in lecturing
and active classroom practices, for example, can vary by factors including disciplinary area and
course size.
Full version
General education courses and the promotion of essential learning outcomes
Nelson Laird, T. F., Niskod, A. S., & Kuh, G. D.
Association for the Study of Higher Education Annual Conference, Anaheim, CA, 2006, November.
Full version
The influence of high school engagement and pre-college expectations on first-year student engagement and self-reported learning outcomes at liberal arts institutions
Gonyea, R. M., Kuh, G. D., Kinzie, J., Cruce, T., & Nelson Laird, T.
Association for the Study of Higher Education Annual Conference, Anaheim, CA, 2006, November.
For nearly three decades, national reports have underscored the need to better prepare students
for college-level work. Indeed, making the transition from high school to college is a significant leap for most students (Miller, Bender, Schuh & Associates, 2005). Given concerns about college readiness, the range of expectations that students bring with them about the demands of college-level work, and the obligation of college and universities to do their part in enhancing student success in college, it would be instructive to know what students expect to do in college, their behavioral patterns established prior to entering college, and how students‘ expectations for
college and pre-college experiences affect what they do and how much they learn during the first
year. Greater understanding about the gaps between prior experiences, expectations and behavior can inform efforts to revise pre-college socialization, orientation, and first-year experience initiatives, as well as other efforts designed to enhance student learning and improve persistence and graduation rates.
Full version
Disciplinary differences in faculty members' emphasis on deep approaches to learning
Nelson Laird, T. F., Schwarz, M. J., Kuh, G. D., & Shoup, R.
Association for Institutional Research Annual Forum, Chicago, IL, 2006, May.
?Deep learning? is important in higher education because students who utilize such an approach
tend to get more out of their educational experiences. As learning is a shared responsibility between students and faculty, it is equally important to examine how much faculty members emphasize deep approaches to learning as it is to assess how much students employ these
approaches. This study examines disciplinary differences in faculty members‘ emphasis on deep
approaches to learning. On average, faculty in education, arts and humanities, and social science
fields emphasize deep learning more than their colleagues from other disciplinary areas, which is
not entirely consistent with findings from a previous study on students.
Full version
First-year students’ plans to volunteer: An examination of the predictors of community service participation
Cruce, T. M., & Moore, J. V.
Association for Institutional Research Annual Forum, Chicago, IL, 2006, May.
The impacts of community service participation on college student development are extensive and well-documented. The characteristics of students that predict volunteerism, however, are not well understood. The purpose of this study is thus to estimate the differences in first-year students‘ plans to volunteer while in college (i.e., ?Done,‘ ?Plan to do,‘ ?Do not plan to do,‘ or ?Have not decided‘) by their background characteristics and by the characteristics of the institutions that they attend. Study results suggest changes to several campus policies and programs that may remove barriers to successful community service participation among first-year students.
Measuring deep approaches to learning using the National Survey of Student Engagement
Nelson Laird, T. F., Shoup, R., & Kuh, G. D.
Association for Institutional Research Annual Forum, Chicago, IL, 2006, May.
The concept of deep learning is not new to higher education. However, deep learning has drawn
more attention in recent years as institutions attempt to tap their student‘s full learning potential. To more fully develop student talents, many campuses are shifting from a traditional passive, instructor-dominated pedagogy to active, learner-centered activities. Using exploratory and
confirmatory factor analysis on multiple years of data from the National Survey of Student
Engagement, this study examines the structure and characteristics of items about student uses of
deep approaches to learning. Institutions and researchers can use the resulting scales to assess
and investigate deep approaches to learning.
Full version
The relationship between student engagement and selected desirable outcomes in the first year of college
Gonyea, R. M.
Association for Institutional Research Annual Forum, Chicago, IL, 2006, May.
This study examines the relationships between student engagement in the first year of college and three desirable outcomes of undergraduate education. Student engagement is a domain of constructs that measures both the time and energy students devote to educationally purposeful activities and how students perceive different facets of the institutional environment that facilitate and support their learning. The three outcomes represent a portion of what is meant
by success in the first year experience, namely obtaining good grades, acquiring intellectual
skills that are important for future academic achievement and success in the professional world,
and gaining knowledge of a general nature in step with the commonly embraced liberal arts
mission of the general curriculum. The study is a secondary analysis of existing data utilizing
two primary data sources: student responses to the fourth edition of the College Student
Experiences Questionnaire and student records maintained by Indiana University Bloomington.
Structural equation modeling (SEM) was employed to model the complex relationships between
the students‘ precollege characteristics, engagement behaviors and perceptions, and the outcome variables. The findings point to four conclusions: (a) different forms of engagement are
precursors to different outcomes, (b) different forms of engagement interact to contribute to
desired outcomes, (c) high expectations coupled with adequate support are requisite conditions
for learning and development in the first college year, and (d) grades do not necessarily represent
how much students believe they have learned. Implications for research, policy and practice are
also offered.
Full version
An examination of workload of faculty of color by rank
Johnson, S.D., Kuykendall, J.A., & Nelson Laird, T.F.
Association for the Study of Higher Education Annual Conference, Philadelphia, PA, 2005, November.
The institutional quality debate: U.S. News quality indicators and the National Survey of Student Engagement
Sarraf , S. A., Kuh, G. D., Hayek, J., Kandiko, C., Padgett, R., & Harris, K.
Association for the Study of Higher Education Annual Conference, Philadelphia , PA, 2005, November.
This study explores the relationship between two commonly accepted measures of institutional
quality ? USNWR ranking indicators and NSSE‘s benchmarks of effective educational practice.
More specifically, this study will explore the proportion of total variation in NSSE benchmark
scores that can be explained at the student and institution level, what proportion can be explained
by USNWR indicators of institutional quality, and, lastly, how individual USNWR variables such
as peer academic reputation, retention and graduation performance, faculty resources, student
selectivity, financial resources, and alumni giving relate to NSSE benchmarks.
Full version
Deep learning and college outcomes: Do fields of study differ?
Nelson Laird, T. F., Kuh, G. D., & Shoup, T. R.
Association for Institutional Research Annual Forum, San Diego, CA, 2005, May.
Full version
Latino college student success at Hispanic-Serving Institutions: NSSE as a tool to understand seniors' experiences and perceptions
Andrade, S., & Shoup, R.
Association for Institutional Research Annual Forum, San Diego, CA, 2005, May.
Full version
The impact of faculty uses of diversity for instruction
Umbach, P. D., Wawrzynski, M. R., & Nelson Laird, T. F.
Association for Institutional Research Annual Forum, San Diego, CA, 2005, May.
African American and Hispanic student engagement at Minority Serving and Predominantly White Institutions
Nelson Laird, T. F., Bridges, B. K., Salinas Holmes, M., Morelon-Quainoo, C. L., & Williams, J. M.
Association for the Study of Higher Education Annual Conference, Kansas City, MO, 2004, November.
African American and Hispanic student engagement at Minority-Serving and Predominantly White Institutions
Nelson Laird, T. F., Bridges, B. K., Salinas Holmes, M., Morelon, C. L., & Williams, J. M
Association for the Study of Higher Education Annual Conference, Kansas City, MO, 2004, November.
Full version
Getting inside the college experience: Using NSSE to examine students' experiences with diversity and their relationships to other forms of student engagement and outcomes
Nelson Laird, T. F.
Best Practices in Closing the Achievement Gap Conference, University of Wisconsin, Oconomowoc, WI, 2004, October.
Faculty do matter: The role of college faculty in student learning and engagement
Umbach, P. D., & Wawrzynski, M. R.
Association for Institutional Research Annual Forum, Boston, MA., 2004, June.
Intercollegiate athletes and effective educational practices: Winning combination or losing effort?
Umbach, P. D., Palmer, M. M., Kuh, G. D., & Hannah, S. J.
Association for Institutional Research Annual Forum, Boston, MA, 2004, June.
Full version
Student experiences with information technology and their relationship to other aspects of student engagement
Nelson Laird, T. F., & Kuh, G. D.
Association for Institutional Research Annual Forum, Boston, MA, 2004, June.
Measuring quality: A comparison of U.S. News rankings and NSSE benchmarks
Pike, G. R.
Association for Institutional Research Annual Forum, Tampa, FL., 2003, May.
Full version
Student experiences with diversity at liberal arts colleges: Another claim for distinctiveness
Umbach, P. D., & Kuh, G. D.
Association for Institutional Research Annual Forum, Tampa, FL., 2003, May.
Full version
Combining the National Survey of Student Engagement with student portfolio assessment
Stoering, J. M., & Lu, L.
Association for Institutional Research Annual Forum, Kansas City, MO, 2002, June.
First-generation and low income students: Using NSSE data to study effective educational practices and students—Self-reported gains
Filkins, J. W., & Doyle, S. K.
Association for Institutional Research Annual Forum, Toronto, Canada, 2002, June.
Full version
Using results from the CSEQ for institutional improvement
Kuh, G. D.
, Presented at the winter meeting of the Collaboration for College Teaching and Learning, Minneapolis., 1999, February.
Great expectations: What students expect from college and what they get
Olsen, D., Kuh, G.D., et al.
Association for the Study of Higher Education Annual Conference, Miami, FL, November.
Student living arrangements: An exploration of marginalized identities
Fassett, K. L., Gonyea, R. M., Graham, P. A., & Fosnacht, K. J.
American College Personnel Association Annual Convention, Columbus, OH, March.
While past research found on-campus living to benefit student success, recent studies find mixed support, particularly for marginalized groups. This study focuses on first-year and sophomore students of color, LGBQ+ students, gender nonbinary students, and students with disabilities, analyzing where they live as related to a variety of outcomes. Data come from 76 residential colleges and universities that participated in NSSE during 2018. Results show differences in where students report living and students? engagement and perceptions of belongingness and safety in their living communities.
Influences on students' openness to diversity and challenge in the second and third years of college
Whitt, E. J., Edison, M. I., Pascarella, E. T., & Terenzini, P. T.
Association for the Study of Higher Education Annual Conference, Miami, FL.
Measuring deep approaches to learning using the National Survey of Student Engagement
Nelson Laird, T. F., Shoup, R., & Kuh, G. D.
Annual Forum of the Association for Institutional Research, Chicago, IL.
Measuring deep approaches to learning using the National Survey of Student Engagement
Nelson Laird, T. F., Shoup, R., & Kuh, G. D.
Paper presented at the Annual Forum of the Association for Institutional Research, Chicago, IL.
Test item
Anderson, Kathy
test.
Presentations
Exploring how inclusive name/pronoun policies and practices relate to quality of interactions
Feldman, Steven; Copeland, Olivia; BrckaLorenz, Allison
Association for the Study of Higher Education Annual Conference, Minneapolis, MN, 2024, November.
Using a large-scale, multi-institution dataset, we explore the relationship between name/pronoun policies and practices and college students?? quality of interactions with other students, advisors, faculty, staff, and administrators on campus. Findings indicate that more affirming policies and practices were associated with more positive quality of interactions, especially for transgender students.
Full version
Complex Identities: Writing and Using Identity Demographic Questions
BrckaLorenz, Allison
Association for Institutional Research Forum, Denver, CO, 2024, May.
Examining educational quality and student or staff experiences within an institution means we must look at subgroups in the data we collect. Some defining characteristics of the respondent experience can be relatively easy to capture in a survey question, but others, particularly questions about identity, can be a challenge. Often the goals of good survey practice contrast with the variable and complex nature of identity. This session will first focus on how to balance the competing needs of creating clear, concise, and easily answerable questions on aspects of identity that are sensitive, complex, and not easily defined. We will also examine strategies for using and sharing the data and results gathered from complex identity questions. We will look at a variety of examples and scenarios, and participants should prepare to share and discuss their specific population challenges as well as any advice for working with complex identity demographics.
Full version
Faculty Perceptions of Disciplinary Cultures and Their Relationship to Teaching: Validating Becher's Convergent-Divergent Dimension
Hiller, Stephen C.; Braught, Emily; Nelson Laird, Thomas
American Educational Research Association Annual Meeting, Philadelphia, PA, 2024, April.
Becher??s (1989) seminal work on academic disciplines proposed the Convergent-Divergent dimension to capture one social dynamic that distinguished disciplinary cultures, and yet little work has explored how the Convergent-Divergent dimension relates to faculty teaching practices. This study operationalizes this dimension in items appended to the Faculty Survey of Student Engagement (FSSE). With nearly 700 responses from faculty in 98 disciplines, this study examines the relationship of a Cultural Convergence construct with faculty teaching practices and whether faculty taught similarly to their disciplinary peers. Findings indicate that cultural convergence does not influence teaching practices in four of five areas, though the more convergent a discipline, the more faculty tend to teach similarly to their peers in three of five areas of teaching.
Full version
Options for Assessing the Faculty Practice in HIPs
BrckaLorenz, Allison
Community-Engaged Alliance Summit & Research Symposium, Bloomington, IN, 2024, April.
This session discusses options for assessing faculty involvement in engaging students in high-impact practices (HIPs). We will talk about assessing faculty use of effective, educational, high-impact practices as well as ways to create environments that support and motivate faculty to do their best work engaging students in HIPs.
Full version
Beyond The Classroom: Student Perceptions of Faculty Support for Mental Health and Well-Being
Russell, Alethia; Chamis, Ella; Kinzie, Jillian
NASPA Annual Conference, Seattle, WA, 2024, March.
The 2023 National Survey of Student Engagement (NSSE) included a new MHWB topical module that invited undergraduates to respond to an open-ended prompt to describe one way their institution supported their MHWB. We used thematic analysis to examine more than 13,000 responses to this open-ended prompt. Findings revealed that students perceived faculty serve in three distinct roles that supplement and, in some cases, supplant institution support for MHWB. Our paper session further details those findings.
Full version
Promoting Campuswide Use of NSSE Data: Fostering Student Engagement, Social Identity, and a Sense of Belonging
Kinzie, J., Russell, A., & Wenger, K.
NASPA Annual Conference, Seattle, WA, 2024, March.
Students?? sense of belonging and social identities matter to engagement. In 2023, the National Survey of Student Engagement (NSSE) revised items with a critical eye toward inclusion by expanding social identity questions so students see themselves in response options and to make the survey more relevant for today??s students. This interactive session features an overview and discussion of recent NSSE results for social identities and belonging and introduces two resources for inclusive and campuswide data sharing and use in student affairs.
Full version
Supporting and retaining faculty with diverse community, workload satisfaction, and feeling valued
BrckaLorenz, A., Chamis, E., Priddie, C.
AACU Diversity, Equity, and Student Success, Philadelphia, PA, 2024, March.
Higher education continues to struggle in efforts to hire, support, and retain diverse faculty. Using a conceptual framework that focuses on how environments contribute to faculty??s ability to thrive and do their best work as educators, we will explore how faculty structural diversity (a proxy for a diverse and inclusive community), satisfaction with work-life and within-work balance, and perceptions of being valued by their institution relate to their intentions to stay at their institution, the professoriate, or academia altogether. Join this session to discuss how these aspects of environment relate to faculty retention and to contribute to a growing collection of ideas about how to create community, workload satisfaction, and perceptions of institutional value for diverse faculty. Participants will leave this session with thoughts on how these issues manifest on their campus and ideas for how to assess and improve their own efforts to support and retain diverse faculty.
Full version
Assessing College Student Mental Health and Well-Being: Implications for Campus Support and Promising Practice
Kinzie, Jillian; BrckaLorenz, Allison; Chambers, Tony; Huber, Susan; Yuhas, Bridget
AACU Annual Meeting, Washington, DC, 2024, January.
Concern about college students?? mental health and the need for institutions to provide more support are on the rise. This session will draw from three research projects??Student Well-Being Institutional Support Survey (SWISS), National Survey of Student Engagement (NSSE) Mental Health & Well-Being module, and the Center for Healthy Minds and Human Flourishing course??to combine assessments and expand understanding of student mental health, perceptions of support, and effective interventions. We will highlight the most current and important findings about college student mental health and well-being, discuss implications for colleges and universities and considerations for equity, and exchange ideas about campus interventions that show the most promise.
Full version
A Quantitative Review of Faculty Practices and Perceptions of the Scholarship for Teaching and Learning
Braught, Emily; BrckaLorenz, Allison
Scholarship of Teaching and Learning Summit, 2024.
How do faculty perceive and interact with scholarship for teaching and learning? This session will review findings from the 2022 and 2023 Faculty Survey of Student Engagement (FSSE), exploring the extent to which classroom- and institutional-level assessment efforts are used to make improvements and hone teaching practices, the extent to which faculty collaborate and build community with one another to share out teaching practices, and the extent to which external motivations influence faculty frequency of practices related to the scholarship of teaching and learning.
Full version
Beyond Demographics: Incorporating Equitable and Inclusive Language about Student Identities in Surveys
Miller, Angela; BrckaLorenz, Allison; Kilgo, Cindy Ann; Priddie, Christen; Wenger, Kevin; Zhu, Yihan
Assessment Institute, Indianapolis, IN, 2023, October.
A new workgroup within the National Survey of Student Engagement (NSSE) focuses on Equity in Survey Design, Administration, Analysis, and Reporting (ESDAR). The workgroup has made changes to survey items for the 2023 administration. These revisions were aimed at more inclusive and equitable language, particularly related to items asking about student identities such as gender identity, sexual orientation, race/ethnicity, first-generation status, and Greek life participation. Attendees will learn about the rationale behind these revisions, and be asked to reflect on whether their own institutional assessments use equitable and inclusive language.
Full version
Beyond the score: Investigating the relationship between the Campus Pride Index and perceived student support
Copeland, Olivia; Feldman, Steven; BrckaLorenz, Allison
LGBTQIA2S+ Higher Education Research Symposium, 2023, October.
Full version
Faculty Members are Not the Problem: Improving Faculty Teaching Environments to Foster Teaching Excellence
BrckaLorenz, Allison; Nelson Laird, Tom
Assessment Institute, Indianapolis, IN, 2023, October.
Given challenges with technology, the pressures of the academy, political meddling in higher education, inequitable conditions, and students whose needs are complex and changing rapidly, faculty members find themselves struggling with workload, their own health issues, competing priorities, and how to be effective teachers in a challenging time. Using data from two large-scale multi-institution assessment projects, we invite you to examine with us aspects of faculty teaching environments that contribute to faculty members' success as educators. By using measures of, for example, institutional policies and processes, access to instructional resources, and institutional climates for diversity, we will illustrate how a better understanding of the teaching environment can improve faculty development efforts. Join us for an exchange of ideas about ways to foster environments that motivate teaching excellence and support faculty in both their work and personal lives.
Full version
Measuring students?? socioeconomic status using different frameworks and analyses
Hu, Tien-Ling; BrckaLorenz, Allison
Association for Institutional Research Forum, Cleveland, OH, 2023, June.
Different from the traditional measures of SES using proxies for economic capital such as low-income status and federal financial aid that do not include all the theoretical considerations of SES, this session compiles several SES and cultural capital-related frameworks, survey items, and data analyses and present several alternative ways to measure SES in the field of higher education. Audiences in this session will learn about several SES measures and data analyses. In addition to the presentation, an interactive discussion will be demonstrated to create a mutual learning environment between presenters and audiences. The session provides researchers with alternative ways to study student success for the low-income student population in higher education.
Full version
Building on Tradition: Approaches to More Inclusive Data Analysis
BrckaLorenz, Allison; Hu, Tien-Ling
Association for Institutional Research Forum, Cleveland, OH, 2023, May.
Institutional research and assessment depends heavily on our ability to characterize the students we study into categories and on our inclination to generalize the results. Although this work is necessary for understanding student experiences, it does present challenges for critical and inclusive approaches to data analysis. In this session, we will discuss common issues and solutions associated with inclusive data analysis by investigating a series of data analysis examples that feature small sample sizes for marginalized students. We will discuss traditional variable-centered versus person-centered methodological approaches, strategies for creating groups to use in comparative analyses, challenges in quantitatively capturing aspects of identity, and tips for communicating the results, validity, and data quality of such analyses to broad audiences.
Full version
Complex Identities: Writing and Using Identity Demographic Questions
BrckaLorenz, Allison
Association for Institutional Research Forum, Denver, CO, 2023, May.
Examining educational quality and student or staff experiences within an institution means we must look at subgroups in the data we collect. Some defining characteristics of the respondent experience can be relatively easy to capture in a survey question, but others, particularly questions about identity, can be a challenge. Often the goals of good survey practice contrast with the variable and complex nature of identity. This session will first focus on how to balance the competing needs of creating clear, concise, and easily answerable questions on aspects of identity that are sensitive, complex, and not easily defined. We will also examine strategies for using and sharing the data and results gathered from complex identity questions. We will look at a variety of examples and scenarios, and participants should prepare to share and discuss their specific population challenges as well as any advice for working with complex identity demographics.
Full version
An Examination of Environments That Support and Retain Diverse Faculty
BrckaLorenz, Allison; Chamis, Ella
AACU Diversity, Equity, and Student Success, Henderson, NV, 2023, March.
Despite an emphasis on diversifying the professoriate, higher education has failed to make significant progress in supporting and retaining diverse faculty in the academy. In this session, we will present a conceptual framework grounded in empirical research that can guide our understanding of how institutions can create environments to support and retain diverse faculty as well as motivate teaching excellence. Join us for a discussion about the components of this framework, supported by qualitative and quantitative findings from studies that have used this framework as a guide. Participants will leave this session with thoughts on how these components manifest on their campus, ideas for how to assess the teaching environments of their faculty, and suggestions from other attendees about their efforts to support and retain diverse faculty.
Full version
Changing Expectations? Trends in Student Engagement Expectations and Academic Beliefs
Cole, James & Kinzie, Jillian
Annual Conference on The First-Year Experience, Los Angeles, CA, 2023, February.
The past several years has presented many challenges to higher education, including how to effectively align campus support services and academic resources to support students. Using data from Beginning College Survey of Student Engagement (BCSSE) and National Survey of Student Engagement (NSSE), this session will illustrate trends in student expectations and beliefs. We will also use data from individual campuses (de-identified) to illustrate changes to their entering student body and the connection to actual behaviors reported several months later on NSSE. Discussion will focus on how campuses can keep abreast of student trends and how to best support student success.
Full version
First Year Seminars' Influence on Student Engagement and Belonging
Kinzie, J., & Wenger, K.
First-Year Experience and Students in Transition Conference FYE, Los Angeles, CA, 2023, February.
First-Year seminars (FYS) have been vigorously studied and found to positively influence persistence, engagement, and student success. This session will explore new research from the National Survey of Student Engagement (NSSE) to understand the relationship between seminars and student engagement, intent to return, and sense of belonging, and how results vary by a range of student identities. Even more, new results from NSSE 2022 distinguish the influence of a success skills-based course from an academic first-year seminar. Join us to explore this evidence and discuss what it suggests for efforts to enhance engagement and equity in first-year student success.
Full version
Sense of Belonging in the First Year of College
Wenger, Kevin & Cole, James
Annual Conference on The First-Year Experience, Los Angeles, CA, 2023, February.
Studies have demonstrated the important role of sense of belonging to first-year persistence and overall academic success. Using data from the Beginning College Survey of Student Engagement (BCSSE) and the National Survey of Student Engagement (NSSE), this session will examine entering first-year student expected academic expectations, beliefs, and prior experiences that influence sense of belonging for students near the end of their first-year of college. Results will focus in interventions that can increase social sense of belonging, as well as ways to identify students that may benefit from efforts to increase sense of belonging on their campus.
Full version
Faculty Teaching Environments: Supporting & Retaining Diverse Faculty
BrckaLorenz, Allison; Chamis, Ella
AACU Annual Meeting, San Francisco, CA, 2023, January.
Despite an emphasis on diversifying the professoriate, higher education has failed to make significant progress in supporting and retaining diverse faculty in the academy. Literature points to issues of campus climate, discrimination, and workplace stress as common reasons for diverse faculty to leave their positions. In this session, we will present a conceptual framework grounded in empirical research that can guide our understanding of how institutions can create environments to support and retain diverse faculty as well as motivate teaching excellence. Join us for a discussion about the components of this framework, supported by qualitative and quantitative findings from studies that have used this framework as a guide. Participants will leave this session with thoughts on how these components manifest on their campuses, ideas for how to assess the teaching environments of their faculty, and suggestions from other attendees about their efforts to support and retain diverse faculty.
Full version
Sense of Belonging and First Year Student Success
Cole, James and Kinzie, Jillian
SAIR Conference 2022, New Orleans, Louisiana, 2022, October.
Sense of belonging influences student persistence and success. Findings from NSSE 2022 and BCSSE 2021 reveals that while most first-year students feel comfortable being themselves, feel valued, and feel part of the community at their institution, differences exist for marginalized subpopulations. In this session, we review findings in an interactive discussion, introduce publicly available data visualization, and offer examples of how institutions have used their data to assess and influence belongingness. Discussion will focus on identifying actions practitioners can take to influence belonging for marginalized student populations on their campus.
Full version
Making the Switch From Static to Dashboard Reporting
BrckaLorenz, Allison; Cole, James; Hu, Tien-Ling; Kinzie, Jillian
Association for Institutional Research Forum, Phoenix, AZ, 2022, June.
Different from the traditional static reports, dynamic online reporting is more efficient to communicate findings to decision makers. Making the switch from traditional static reporting to new online interactive dashboards can be a daunting task. Participants in this session will learn about several large-scale national survey center projects that made the switch from static to dashboard reporting. Interactive discussions will focus on four topics: (1) motivations, internal and external, for implementing a switch to dashboard reporting; (2) advantages and successes in making the switch; (3) challenges, concerns, and potential solutions for moving to dashboards; and (4) resources that are useful for implementation and maintenance of dynamic reports. Join us for this discussion about making the transition from static to interactive online reporting and prepare to leave with a commitment to making the switch yourself!
Full version
Examining Black STEM Students' Experiences with Collaborative Learning
Priddie, Christen
American Educational Research Association Annual Meeting, San Diego, CA, 2022, April.
Educators continue to examine how to increase Black student representation in Science, Technology, Engineering, and Mathematics (STEM) fields in higher education. There is an increased call to implement collaborative learning in STEM classrooms, but current implementations do not articulate how collaborative learning can be culturally relevant for Black students. Using a critical approach, the purpose of the current study was to establish knowledge of Black STEM students?? collaborative learning experiences. Results showed that Black STEM students valued the maintenance of their contributions in collaborative learning while placing little value in being recognized for their collaborative contributions. The current study highlighted how STEM educators should center Black STEM students?? values and experiences while transforming an active learning practices already being implemented.
Full version
Gathering Evidence for an Assessment of Environments That Motivate Teaching Excellence
BrckaLorenz, Allison; Brandon, Josclynn; Hu, Tien-Ling; Priddie, Christen; Nelson-Laird, Thomas F.
American Educational Research Association Annual Meeting, San Diego, CA, 2022, April.
Inequities and discrimination within the systems and structures of higher education prevent faculty from doing and receiving recognition for their best work as educators. The purpose of this study is to present the validation testing and overview of results from a new project designed to help institutions understand the teaching environments in their local context and for researchers to understand teaching environments in higher education. The assessment instrument examined here guides our understanding of faculty needs, motivations, and supports that are necessary for healthy teaching environments and the wellbeing of diverse faculty. Findings from this study add to our knowledge of faculty teaching cultures as well as provide an example of how to collect validity evidence for climate assessment instruments
Full version
Getting Beyond the High-Impact Practice (HIPs) Checklist: Assessing and Designing for Quality and Equity
Jillian Kinzie and Beth Manke
WASC Accreditation Resource Conference, 2022, April.
HIPs, such as undergraduate research, service-learning, and internships, represent experiences associated with student learning and success. Yet, implementation matters more than the label. This session shares findings about HIP participation and quality, including considerations for student subgroups, and discusses institutional efforts, featuring CSU Long Beach, to assess and design more effective and equitable experiences.
Full version
Retaining Black women faculty: Cultivating an equitable teaching environment
Brandon, Josclynn; BrckaLorenz, Allison
, American Educational Research Association Annual Meeting, 2022, April.
Current research on the experiences of Black women faculty often focuses on the challenges they face and the reasons why they leave the academy. Instead, this study examined the experiences and success strategies of Black women faculty who have successfully navigated the tenure and promotion process. Findings can inform new and aspiring Black women faculty in navigating the academy, advise institutional leadership who are looking to recruit and retain Black women faculty, and promote discussions and tangible action items to improve inequities within the professoriate. Themes from interviews revolved around policies and procedures that are problematic for Black women specifically, the importance of support networks, the failure of institutional programs, and their persistence as an act of caring.
Full version
Using Sense of Belonging Data to Foster Equitable Student Success: New Findings from NSSE
Colleen Lofton, Jillian Kinzie and Allison BrckaLorenz
NASPA 2022, 2022, March.
Sense of belonging influences student persistence and success. NSSE 2020 findings from 521 bachelor's granting colleges and universities show most first-year students feel a sense of belonging, yet notable differences were found for traditionally marginalized subpopulations. In this session, we will provide an overview of findings through an interactive discussion, publicly available data visualization, and examples of how institutions have used their data to assess and impact belongingness. Prepare to identify actions you can take to influence sense of belonging on your campus for marginalized student populations.
Full version
Expectations for engagement? What 1st year students and transfers say
James Cole and Jillian Kinzie
First Year Experience Annual Conference, 2022, February.
Understanding entering student expectations is critical to assure that staff can align appropriate institutional resources for each student. This session will include how the Beginning College Survey of Student Engagement (BCSSE) provides comprehensive information about your entering first-year and transfer student's prior academic experiences, as well as their expectations and beliefs regarding the upcoming academic year. Participants will learn how other institutions use BCSSE for academic advising, retention efforts, faculty and staff development, and other activities. Participants will be encouraged to share their campuses current practices and how BCSSE could facilitate best practices on their campus.
Full version
Entering Students and the Pandemic: Campus Responses and Continued Action
Jim Cole and Jillian Kinzie
First Year Experience Annual Conference, 2022, February.
By February 2022, new students who experienced a pandemic disrupted high school will be well into their first college year. How did colleges & universities adapt and how are they continuing to respond to entering student circumstances? This facilitated dialogue session is framed by data about entering students, and then encourages FYE practitioners to share ideas and learn from one another's experiences related to 2021 entering student expectations and needs and institutional practices to support their success. Join us to exchange ideas and contribute to the evolving body of information about pandemic-responsive practices.
Full version
First-Year Seminars: Evidence of HIP Qualities and Outcomes
Jillian Kinzie and Kevin Wenger
First Year Experience Annual Conference, 2022, February.
First Year Seminars (FYS) are positively associated with persistence and fostering student success. Yet, their content, form and outcomes can vary. This session first highlights research exploring FYS student's exposure to the eight essential dimensions theorized to define High-Impact Practices (HIPs) as a way to prompt enhancements to FYS quality, and then discusses the association between FYS and outcomes such as sense of belonging, intent to return and NSSE Engagement Indicators as evidence of the contribution of FYS. Join us to discuss the implications of this research and to give input on this new item set.
Full version
Enhancing Sense of Belonging for Equitable Student Success: New Findings from NSSE
Jillian Kinzie, Alex McCormick, and Bob Gonyea
AAC&U Annual Meeting, 2022, January.
Students' sense of belonging influences persistence, well-being, and success. Yet students from underrepresented racial-ethnic identities and other diverse backgrounds report lower belonging than their peers. To help educators understand sense of belonging for their campus community, and especially for student subpopulations, the National Survey of Student Engagement (NSSE) added sense of belonging measures to the 2020 survey. Results show that while most first-year students feel comfortable being themselves, feel valued, and feel part of the community at their institution, there are notable differences between subpopulations. NSSE created a public Sense of Belonging interactive dashboard to support the investigation of results filtered by institution and student characteristics. This session highlights results, demonstrates the interactive dashboard, and involves participants in a discussion of the engagement behaviors positively associated with sense of belonging and how campuses can positively influence belonging to promote equitable student success.
Full version
Motivating Teaching Excellence: Identifying Supportive Environments for Diverse Faculty
BrckaLorenz, Allison; Brandon, Josclynn
, 2022, January.
Multitudes of theories, findings from scholarly work, and our everyday experiences show us that inequities and discrimination are built into the systems and structures of higher education. These systemic issues prevent faculty from doing their best work. We will present the groundwork for a conceptual framework that can guide our understanding of how institutions can create faculty teaching environments that motivate teaching excellence and support diverse faculty. Join us for a discussion about how the components of this framework manifest on your campus and leave with ideas on how to assess and improve your institution's teaching environments for diverse faculty.
Full version
NSSE Showcase session at SACSCOC Annual Meeting: Making the Most of NSSE for Equity and Student Success
Kinzie, Jillian
Southern Association of Colleges & Schools: Commission on Colleges, 2021, December.
The link between student engagement in educationally effective practice and student success is strong. The National Survey of Student Engagement (NSSE) provides participating institutions information about the conditions that matter for student learning and success, which can then help diagnose and point to action to improve quality and equity in the undergraduate experience. This session frames NSSE as a tool for promoting equity and student success and highlights new findings about sense of belonging, advising and high-impact practices.
Full version
Success of the Siloed: Strategies for Retaining Black Women Faculty
Brandon, Josclynn; BrckaLorenz, Allison
POD Network Conference, Virtual, 2021, November.
Despite diversity, equity, and inclusion efforts, many Black women faculty still face difficulties - including hostile work environments, a lack of mentorship, and unfair critiques. We conducted a mixed-methods study that touched on these issues from the perspective of the strategies and support structures that allowed these women to persevere despite these difficulties. Our presentation will discuss these findings and provide suggestions to institutional leaders, faculty colleagues, and aspiring Black women faculty for how to create access to these paths of success, and more equitable spaces for these valuable members of the academy.
Full version
Assessing Sense of Belonging for Student Success: New Findings from NSSE
BrckaLorenz, Allison; Lofton, Colleen; Kinzie, Jillian
Assessment Institute, 2021, October.
Sense of belonging influences student persistence and success. NSSE 2020 findings from 521 bachelor??s granting colleges and universities show most first-year students feel comfortable being themselves and feel valued and a part of the community at their institution, yet notable differences were found for traditionally marginalized subpopulations. This session will provide an overview of findings through an interactive discussion and publicly available data visualization. Facilitators will provide examples of how institutions have used their data to assess and impact belongingness. Participants will identify actions their institution can take to influence the sense of belonging on their campus for marginalized student populations.
Full version
NSSE's 3rd Decade: Highlighting New Emphases in Assessment and Student Engagement
BrckaLorenz, Allison; Cole, Jim; Gonyea, Robert; Kinzie, Jillian; McCormick, Alex; Sarraf, Shimon
Assessment Institute, 2021, October.
The National Survey of Student Engagement (NSSE) is excited to enter our 3rd decade of assessment to improve educational quality and student outcomes. This session will highlight NSSE's suite of surveys – the Faculty Survey of Student Engagement (FSSE) and Beginning College Survey of Student Engagement (BCSSE) and new emphases, including survey items on effective teaching and sense of belonging and data visualization tools. We'll also introduce enhancements including Topical Modules to assess inclusiveness and cultural diversity, advising, and quality in online education and HIPs
Full version
Recovering Equilibrium for Student Engagement, Learning and Success
Kinzie, Jillian
University of Wisconsin System Meeting, 2021, October.
As we continue to operate in a disrupted undergraduate experience, what should colleges and universities have front of mind to foster equitable student learning and success? Decades of research affirms that learning mindsets, such as sense of belonging, purpose and expectations for success and support, can increase students?? likelihood of retention and success. In addition, students?? experiences in collaborative learning, High-Impact Practices (HIPs) and advising can enhance learning. These factors are perhaps more critical than ever as we seek to ensure success for all students. This session draws on recent data from the Beginning College Survey of Student Engagement (BCSSE) regarding students entering college in 2021 and findings from the 2021 administration of the National Survey of Student Engagement (NSSE) to highlight vital student success practices. The importance of disaggregated data to explore quality and differences by student subpopulations will also be discussed.
Full version
NSSE/ACUHO-I Housing Study: Reflections on Three Years of Research
Gonyea, Robert; Fosnacht, Kevin; Graham, Polly; Fassett, Kyle T.
ACUHO-I Annual Conference & Expo, 2021, June.
With funding and support from the ACUHO-I Foundation, researchers from the National Survey of Student Engagement studied the influence of college student housing at 76 diverse residential institutions. A culmination of three years of research, this session highlights implications for practice in the areas of persistence, living-learning communities, roommate matching, and housing differences among diverse students. We also will discuss the future of housing research.
Full version
Assessing Student & Faculty Experiences in CV-19: Lessons for Our New Future
Kinzie, Jillian; McCormick, Alex; Sarraf, Shimon; and Blaich, Charlie; Wise, Kathy (Higher Education Data Sharing and Wabash College Center for Inquiry)
Association for Institutional Research, 2021, May.
Assessing Student & Faculty Experiences in CV-19: Lessons for Our New Future, is a research presentation with NSSE staff Jillian Kinzie, Alexander McCormick, Shimon Sarraf, and Higher Education Data Sharing Consortium colleagues, Charlie Blaich and Kathy Wise.
Full version
Data for Decision-Making: Inclusion & Engagement with Cultural Diversity
Kinzie, Jillian; Silberstein, Samantha; Palmer, Dajanae; McKinley, Kristin (Lawrence University); Nicholas, Jason (Northern Michigan University)
Association for Institutional Research, 2021, May.
A panel session with NSSE staff Jillian Kinzie, Dajanae Palmer, and Samantha Silberstein, with Jason Nicholas (Northern Michigan University) and Kristin McKinley (Lawrence University) discussing the use of NSSE??s Inclusion & Engagement with Cultural Diversity Topical Module.
Full version
Making the Most of NSSE for Equity and Student Success
Kinzie, Jillian; Gort, Amy (Metropolitan State University)
Higher Learning Commission Annual Meeting, 2021, April.
The link between student engagement in educationally effective practice and quality learning and student success is strong. Recently, HLC identified student engagement and connection, as a core component in a Heuristic Model of Student Success, and includes surveys like the National Survey of Student Engagement (NSSE) to assess this element. Student engagement represents something institutions can facilitate and results can diagnose and point to action to improve the conditions for student success. This session frames NSSE in HLCs recent student success heuristic and then illustrates how institutions have effectively used student engagement results to influence student success initiatives.
Full version
Two Sides of a Coin: Patterns of Student & Faculty Participation in High-Impact Practices
Fassett, Kyle T.; BrckaLorenz, Allison; Nelson Laird, Thomas F.
American Educational Research Association Annual Meeting, 2021, April.
The higher education community continues to perpetuate high-impact practices as means for improving student success. Yet, challenges exist for assuring all students participate equitably in these beneficial educational experiences; one inhibiting factor may be a lack of faculty support. We examined the responses from 12,147 faculty and 28,504 seniors at 83 institutions to better understand the relationship between faculty who emphasize or participate in high-impact practices and students who do participate. Results indicate potential inequities in faculty participation in engaging students in high-impact practices. Faculty values of importance in participation relates to whether they participate reveling implications for future conversations about faculty hiring and development.
Full version
Enhancing career-preparation equity for international students
BrckaLorenz, Allison; Zhu, Yihan; Gopal, Kriti
AAC&U Conference on Diversity, Equity, and Student Success, 2021, March.
In this session, we will explore the unique challenges of international students with respect to support for career-related skill development and experiences with career services on campus. We will present findings from quantitative and qualitative responses of more than 4,500 senior international students over the past five years at hundreds of four-year colleges and universities. Through discussion, participants will learn about international students?? confidence in using skills and abilities essential to their future careers and how institutions can create new career services supports for this large group of minoritized students.
Full version
Understanding and Improving Survey Data Quality: Key Insights from NSSE
Sarraf, Shimon
Overseas Chinese Association for Institutional Research (OCAIR), 2021, February.
What has NSSE learned over the past ten years related to understanding and improving survey data quality? This presentation covers various topics, including the effect of survey incentives, learning management systems, and campus promotions on survey response, the importance of optimally formatting long surveys for small screen devices, the effectiveness of panel data collection, and how to evaluate response rates.
Full version
Sense of Belonging and the First-Year Experience
Cole, Jim; Kinzie, Jillian
Annual Conference on the First-Year Experience, 2021, February.
With the turmoil and uncertainty of this past year, a students? sense of belonging is now more critical than ever. This presentation will use NSSE and BCSSE-NSSE combined data to highlight the important connections between sense of belonging, student expectations, intention to persist, quality of relationships with advisors, faculty, and other students, academic engagement, as well as other important aspects of the first-year student experience. This session will include opportunities for discussion and reflection, as well as include current institutional examples of data use.
Full version
Doing Academic Advising Well: Findings about Advising Practice at Research Universities
Kinzie, Jillian; McCormick, Alex; Silberstein, Samantha; Gonyea, Bob; Dugan, Brendan
Association of American College & Universities Annual Meeting, 2021, January.
High-impact practices (HIPs) represent a core feature of a high-quality undergraduate education and are often hailed as life-changing events. The literature identifies a set of essential elements common across HIPs, yet to date most evidence about HIPs has been limited to student participation in designated HIPs, with scant empirical examination of their implementation. We report on a multi-institution study of students?? exposure to these el! ements of quality in seven HIPs (first-year seminar, learning communities, service-learning, research with faculty, study abroad, internships and field experiences, and culminating senior experiences) to deepen understanding of HIP quality and to explore racially minoritized student access to high-quality HIPs and discuss strategies to enhance quality standards and equity.
View presentation
Full version
The Influence of Faculty on Marginalized Student Participation in High-Impact Practices
Fassett, Kyle T.; BrckaLorenz, Allison; Nelson Laird, Thomas F.
Association of American College & Universities Annual Meeting, 2021, January.
As creators and facilitators of high-impact practices, understanding how faculty promote or inhibit student participation is integral in continuing to equitably promote their benefits. Data from the National Survey of Student Engagement (NSSE) paired with data from the Faculty Survey of Student Engagement (FSSE) show differences in faculty participation in high-impact practices, the importance faculty place on student participation, and how these factors impact student participation. We will share findings from 83 diverse institutions to start a conversation about the faculty labor associated with high-impact practices and ways to increase equity in student participation of high-impact practices.
Full version
Belonging, teaching environments, & grading: An exploration of faculty emotion
Fassett, Kyle; Nelson Laird, Thomas; BrckaLorenz, Allison; Strickland, Joe
POD Network Annual Conference, 2020, November.
The session provides an overview of faculty members? sense of belonging to their institutions, their sense of supportive teaching environments, and their thoughts about grading. Findings from our large-scale, multi-institutional study help faculty developers and other administrators better understand faculty members and how these affective constructs vary by faculty sub-groups. Participants will be invited to join in a conversation about the results and how the study?s findings could lead to providing better support to faculty members in their varied roles on college campuses.
Full version
Faculty Use of Collaborative Learning and Approaches to Learning: Examining Social Aspects of Online Learning
Hiller, Stephen; Nelson Laird, Thomas
Association for the Study of Higher Education, 2020, November.
This large-scale study expands knowledge of online teaching by comparing faculty practices around collaborative learning and deep approaches to learning in online and in-person courses. Findings indicate that online faculty emphasize deep approaches more than in-person, but use collaborative learning less. Implications for faculty and researchers are discussed.
Full version
Navigating difficult discourse: Understanding faculty strategies for challenging teaching situations
Hurtado, Sarah; BrckaLorenz, Allison; Sisaket, Lesley; Washington, Sylvia
POD Network Annual Conference, 2020, November.
Using critical pedagogy as a guide, we illuminate how educators can approach teaching in a way that humanizes students and encourages the examination of oppressive practices and ideologies through discourse centered on difficult topics. Presenters will offer insights from a large-scale mixed-methods study of faculty preparation for dealing with difficult situations in their courses and supporting students with complex concerns. This session will provide evidence-based practices and strategies to support the work of faculty and faculty developers in dealing with difficult situations involving incivility, disclosure of sensitive information, sexual assault, mental health, and other challenging topics.
Full version
No one taught me to teach: Preparation for challenging situations
BrckaLorenz, Allison; Hurtado, Sarah; McCoy-Simmons, Casey; Palmer, Dajanae
POD Network Annual Conference, 2020, November.
Socialization is often the mechanism through which faculty acquire knowledge of teaching behaviors, but teaching-related training can have a powerful impact on practice. This session will provide evidence-based practices and strategies to support the work of educational developers by sharing results from a large-scale, multi-institution mixed methods study asking faculty about influences on their teaching, examples of teaching-related training that has been useful, and training they wish they?d had. We will additionally share strategies faculty have used and how prepared faculty feel to deal with difficult situations in their courses such as student incivility and controversial events on campus.
Full version
All NSSE session recordings from the 2020 Assessment Institute are now available for viewing.
Assessment Institute, 2020, October.
- 05A Plenary Session and Panel Discussion
Teresa Leyba Ruiz, Glendale Community College; Stephen P. Hundley, IUPUI, Keston H. Fulcher, James Madison University; Natasha Jankowski, National Institute for Learning Outcomes Assessment (NILOA) and University of Illinois Urbana-Champaign; Jillian Kinzie, Indiana University?Bloomington and NILOA; Verna F. Orr, University of Illinois Urbana-Champaign and NILOA; Hamsa Marikar, Watermark - 07B* Advancing Institutional Assessment: Lessons from Excellence in Assessment 2020 Designees
Jillian Kinzie, Indiana University?Bloomington and National Institute for Learning Outcomes Assessment (NILOA); Frank Hall, Northwestern State University of Louisiana; Kristen Springer Dreyfus, East Carolina University (ECU); and Rebecca Lewis and Diane Waryas Hughey, The University of Texas at Arlington - 08D Dealing with Tough Moments: Assessing Faculty Preparation for Teaching Challenges
Kyle T. Fassett and Allison BrckaLorenz, Indiana University-Bloomington; and Sarah S. Hurtado, University of Denver - 09O NSSE?s 3rd Decade: Synthesizing Contributions and Highlighting New Emphases in Assessment and Student Engagement
Jillian Kinzie, Indiana University?Bloomington and National Institute for Learning Outcomes Assessment (NILOA); Robert Gonyea and Alexander McCormick, Indiana University-Bloomington - 12A Assessing HIP Quality: Evidence from the Literature and Students? Experience
Jillian Kinzie, Indiana University?Bloomington and National Institute for Learning Outcomes Assessment (NILOA); Brendan Duggan, Robert Gonyea, Alexander McCormick, and Samantha Silberstein, Indiana University-Bloomington - 13A Assessing the Faculty Role in High-Impact Practices
Kyle T. Fassett, Allison BrckaLorenz, and Thomas F. Nelson Laird, Indiana University-Bloomington - 14J Assessment with the Improvement of Student Learning as the End Goal
Jillian Kinzie, Indiana University?Bloomington and National Institute for Learning Outcomes Assessment (NILOA); Kathleen Gorski, Waubonsee Community College; Kathleen Gorski, Natasha Jankowski, National Institute for Learning Outcomes Assessment (NILOA); and Monica Stitt-Bergh, University of Hawai?I at M?noa - 15C Developing Culturally Responsive Multiple Assessments of Student Learning in Diversity-Inclusion-Social Justice (DISJ) Core Courses and National Survey Results (CECE and NSSE) to Advance Campus Conversations
Jesse Mills, Carole Huston, Paula Krist, and Antonieta Mercado, University of San Diego - 16B A Conceptual Framework and Strategies for Examining High-Impact Practices
Kyle T. Fassett, Indiana University-Bloomington - 18A Equity and Inclusivity in the Assessment of High-Impact Practices
Heather Haeger, California State University, Monterey Bay; and Allison BrckaLorenz, Indiana University-Bloomington - 20D Better Together: How Student Learning Outcomes Assessment and Faculty Development Can Partner to Strengthen Student Success
Pat Hutchings, National Institute for Learning Outcomes Assessment (NILOA) and Bay View Alliance (BVA); and Jillian Kinzie, Indiana University?Bloomington and National Institute for Learning Outcomes Assessment (NILOA)
Assessing the Faculty Role in High-Impact Practices
Fassett, Kyle T.; BrckaLorenz, Allison; Nelson Laird, Thomas F.
Assessment Institute, 2020, October.
High-impact practices are effective educational practices leveraged to improve student outcomes, and often faculty members are key to their facilitation. This session examines faculty roles in emphasizing students? participation and engaging students in these practices. We will share characteristics of faculty who encourage and partake in these activities with an emphasis on assessment practices for gathering more information about faculty experiences with high-impact practices. Attendees will have the opportunity to learn from one another through sharing their own challenges and successes in measuring faculty involvement in high-impact practices and how they cultivate a culture of high-impact experiences on campus.
Full version
Dealing with tough moments: Assessing faculty preparation for teaching challenges
Fassett, Kyle T.; BrckaLorenz, Allison; Hurtado, Sarah
Assessment Institute, 2020, October.
Faculty are increasingly placed in situations where they have to navigate difficult teaching situations (student incivility, disclosure of sensitive information, controversial events, etc.) and challenging conversations with students (sexual assault, racism, mental health, etc.). As such, it is important to examine faculty preparation for managing such situations, what strategies they implement when they encounter these concerns, and what related training they wish they had received. Findings from a large-scale quantitative and qualitative study of teaching challenges will guide a discussion about assessing and supporting faculty efforts to navigate difficult teaching situations through professional development programming.
Full version
Equity and Inclusivity in the Assessment of High-Impact Practices
Heager, Heather; BrckaLorenz, Allison
Assessment Institute, 2020, October.
As we seek to assess what works and what needs improvement in High-Impact Practices (HIPs), it is essential that we critically examine our assessment strategies and methodologies. Many assessment plans inadvertently overlook the experiences of diverse student populations and only focus on large, aggregate data that reflects the experiences of traditionally privileged, majority students. This session will focus on how to conduct more inclusive assessment, including specific strategies for: creating more inclusive survey questions, how to assess the experiences of small populations in order to improve the experiences of small populations, more equitable quantitative methods, and democratically engaged assessment strategies.
Full version
High School Disrupted: First-Year Expectations of 2020 High School Graduates
Cole, J. S., & Kinzie, J.
Southern Association for Institutional Research, Virtual, 2020, October.
The COVID pandemic left no part of education untouched. Spring 2020 was clearly a dramatic shift for high schools, teachers, and students. With little online learning experience, this is the first entering class with increased responsibility for directing their own learning. This session highlights survey findings from thousands of 2020 high school graduates entering college. The study examines their high school learning experiences, college expectations and preparedness, as well as their feeling prepared to taking future online courses. The presenters will facilitate discussion among the participants about what we have collectively learned and how this can inform future plans.
Full version
How Do We Know Advising Is Done Well? Using NACADA Core Competencies to Assess Advising
Cole, James & Kinzie, Jillian
NACADA Annual Conference, 2020, October.
This sessions suggests how institutions can use NSSE & the Advising Module to:
* consider advising practice overall (are students experiencing quality advising to support learning, engagement and persistence?),
* assess the impact of advising aligned with NACADA standards,
* investigate differences in advising experiences by race/ethnicity, first generation status, gender identity, and disability status for their students, and
* determine if groups of students for example, those earning lower grades or who have lower intentions to return differ in their advising experiences.
View the recorded presentation
Full version
New insights into faculty advising: An overview of national patterns and trends
Fassett, Kyle; Woodlee, Kara M.; BrckaLorenz, Allison
NACADA Annual Conference, Virtual, 2020, October.
This session provides an overview of faculty advisors across the U.S. using a large-scale data-set from the 2019 administration of the Faculty Survey of Student Engagement (FSSE). Presenters will share survey findings including an overview of the national landscape of faculty advisors, what faculty tend to emphasize during the advising process, and what can be done to support faculty in their roles as advisors. Participants will be invited to share their experiences collaborating between faculty and advising units. Implications for attendees will be highlighted through a large group discussion.?
Full version
Revisiting the Impact of LLCs on Student Engagement and Success
Fosnacht, Kevin, Gonyea, Robert M., Fassett, Kyle T., & Graham, P.
ACUHO-I Academic Initatives, Virtual, 2020, October.
Campus housing has changed markedly in recent years, prompting questions about its impact and the benefits of living-learning communities (LLCs) in particular. Sponsored by an ACUHO-I research grant, we surveyed a diverse, multi-campus sample of residents to study the relationships between LLC participation, engagement, perceived gains in learning and development, and persistence. Results affirm LLCs promote engagement in expected ways, but also point to areas for improvement. Implications for practice will be discussed.
Full version
Roommate Assignments: Managing The Process and Supporting Students of Color
Gonyea, Robert M., Graham, Polly, Fosnacht, Kevin, & Fassett, Kyle T.
ACUHO-I Business Operations Conference, Virtual, 2020, October.
Getting a roommate is one of the first milestones of a student?s campus experience. In the past decade, the rise of social media and online roommate-matching sites has changed how students find roommates, and the proportion of incoming students choosing their preferred roommate has increased. Lately, however, multiple institutions moved to requiring incoming students to have institutionally-assigned roommates in the hope of increasing cross-cultural interactions. We investigated this assertion using data from 76 schools participating in an ACUHO-I sponsored study. Results show that preventing students from choosing their own roommates is not an effective method of increasing interactional diversity. We also discovered that the policies can have negative consequences for students of color. Considering these findings, the NSSE research team makes recommendations for institutions.
Full version
Survey Inclusivity: Centering Minoritized Groups in Survey Design
Priddie, Christen; BrckaLorenz, Allison
Assessment Institute, 2020, October.
The emergence of critical quantitative methodologies emphasizes the importance of using race-conscious approaches to highlight the centrality of race in student experiences, as a neutral approach can support a deficit framing. This session explores why it is important to center racially minoritized groups in survey design in order to move toward more equitable assessments of their experiences. Discussion will focus on an example of intentionally centering Black college student experiences in a quantitative study of collaborative learning and perceptions of campus climate with tips and strategies for participants to center racially minoritized voices in their own assessments.
Full version
Campus Housing, Student Engagement and Persistence
Gonyea, Robert; Fosnacht, Kevin; Graham, Polly; Fassett, Kyle
ACUHO-I 2020 Virtual Summit, 2020, June.
For the past three years, a team of researchers from the National Survey of Student Engagement has been studying the impact of residence life on first-year and sophomore students enrolled at 76 residential campuses. This session will overview their findings and make recommendations to improve practice. Topics covered include student engagement, living-learning programs, roommate selection, and persistence.
Full version
Lost at the crossing? Tips for assessing intersectional experiences
BrckaLorenz, Allison; Fassett, Kyle T.; Kirnbauer, Tom; Washington, Sylvia
Association for Institutional Research Annual Forum, 2020, May.
Faculty and administrators are often tasked with educating the whole student upon their arrival at college, so it is important to understand ways to assess the whole student. Often student demographics and characteristics are examined one at a time such as by examining differences by racial/ethnic, gender, or other known influences on the student experience. Disaggregating data in this way, allows us to better understand how different students understand and participate in their environment. This poster provides an overview of four different examples to better examine small populations with attention to intersections of identity.
Full version
Person-centered approaches to inclusive data analysis
BrckaLorenz, A., Kirnbauer, T., & Nelson Laird, T.
Association for Institutional Research Annual Forum, New Orleans, LA., 2020, May.
Demographic questions are critical to our understanding of student and faculty experiences, allowing us to learn about marginalized subpopulations, find areas of inequity, and close gaps in achievement. Although this work is necessary, it does present challenges for critical and inclusive approaches to data analysis. Person-centered approaches, grouping people based on similar experiences or outcomes, allow for more nuanced stories of experiences. To illustrate the benefits of this approach, facilitators will guide participants through a series of examples using person-centered explorations, unpacking the challenges and possible solutions for using such methods for more critical and inclusive quantitative analyses and reporting.
Full version
Senior international students' perceptions of gains while attending U.S. colleges
Oktafiga, D.; BrckaLorenz, A.
NAFSA 2020 Annual Conference & Expo, St. Louis, MO, 2020, May.
Using the 2015-2017 National Survey of Student Engagement (NSSE) data from senior college students (n=13,950), this study explores the variations of senior international students? perceptions of gains while attending 1,029 U.S. colleges/universities. Results indicate that seniors from the African Sub-Saharan region gained the most in terms of academic and personal skills while seniors from Canada perceived gains the least.
Full version
What's next for student engagement and institutional assessment
Kinzie, J.; BrckaLorenz, A.; Gonyea, R.; Kirnbauer, T.; Sarraf, S.
Association for Institutional Research Annual Forum, 2020, May.
Over the past 20 years, the National Survey of Student Engagement (NSSE) has helped institutional researchers gain insight into institutional quality. Further, a shifting higher education landscape requires institutional researchers to reconsider how assessment is conducted. NSSE continues to search for innovative ways to understand student engagement and serve as a valuable assessment tool for institutions. In this session, we will focus on three areas that impact institutional assessment: changing student demographics, developments in teaching and learning, and innovative approaches to assessment. The session will conclude with an active discussion with participants about the trends and possibilities at their institutions.
Full version
Collegial and departmental support matters: An exploration of teaching cultures and practice
Strickland, J.; Hengtgen, K.; BrckaLorenz, A.; Nelson Laird, T.
American Educational Research Association Annual Meeting, San Francisco, CA, 2020, April.
Even though many colleges and universities are increasingly supporting teaching and learning centers, SoTL, faculty learning communities, and other evidence-based teaching practices, uncertainty still remains regarding the impact of these practices and programs on quality student learning. Often colleges and universities simply give ?lip service to the idea? of good teaching, and yet lack organizational commitments and structures to truly support teaching. Using a large-scale, multi-institutional study of teaching cultures, this study explores faculty perceptions of commitment to quality teaching and faculty perceptions of departmental and institutional support for teaching. The results carry implications for departmental and institutional initiatives in support of teaching and the improvement of pedagogical practice towards equitable college student learning.
Full version
"Step it up": Increasing LGBTQ+ inclusivity in and out of class
BrckaLorenz, Allison; Duran, Antonio; Haeger, Heather; Velasquez, Selena
AAC&U's Diversity, Equity, and Student Success Conference, 2020, March.
Creating a positive campus climate for LGBTQ+ folx requires efforts both in-and out-of-class. The lack of representation/visibility of diverse experiences can be detrimental for all students regardless of sexual orientation or gender identity. To frame the discussion of LGBTQ+ inclusive courses and campuses, this session will utilize analyses from a large-scale, multi-institution quantitative and qualitative data set. This study examined student perceptions of the inclusion of LGBTQ+ issues in curricula and the relationship to other forms of engagement. We use individual?s write-in responses along with scholarship to guide an organic dialogue where participants share their experiences as well as learn strategies to bring back to their own communities.
Full version
Including mental wellness: A more holistic view of student success
Washington, S.; Brandon, J.; Holmes, B.; BrckaLorenz, A.
ACPA-College Student Affairs Educators International Convention, 2020, March.
To better support diverse student populations, this study uses large-scale, multi-institution survey data that focuses on students? mental wellness. Participants in this session will discuss the relationship that race and gender have on students? mental wellness, explore how adverse feelings affect student success, and gain insight into students? awareness of how to get help. Implications will focus on holistic and proactive solutions.
Full version
Campus Housing, Student Engagement and Persistence
Gonyea, Robert; Fosnacht, Kevin
ACUHO-I State of the Profession, New Orleans, LA, 2020, February.
This presentation summarizes recent research examining the direct and indirect relationships of first-year and sophomore students' living arrangements on student engagement and persistence.
Full version
Student engagement and institutional assessment: Current trends and future possibilities
McCormick, A., Kinzie, J., BrckaLorenz, A., Gonyea, R., Sarraf, S.
Association of American Colleges & Universities Annual Meeting, Washington, DC, 2020, January.
With the National Survey of Student Engagement marking its 20th year, we invite participants to explore the trends and possibilities of engagement as a lens for examining institutional quality. This session, conducted as a research town hall, will focus on three broad areas:
1. Changing demographics?What are the emerging demographics on your campus? How will new kinds of students challenge and shape what we know about engagement?
2. Developments in teaching and learning?Do current measures of engagement adequately cover what is essential to the improvement of student learning? What new forms of engagement should we assess?
3. Approaches to assessment?What trends should a large-scale survey assessment project consider over the next decade to facilitate evidence-informed improvement?
After briefly introducing each topic, the presenters will facilitate an active discussion with participants about the trends and possibilities at their institutions and in higher education overall.
Full version
Aligning deep learning with classroom time use: A view of disciplinary variations among faculty
Hiller, S., BrckaLorenz, A., & Nelson Laird, T.
Association for the Study of Higher Education Annual Conference, Portland, OR, 2019, November.
This exploratory study seeks to reimagine research into disciplinary differences in teaching approaches through multilevel methods that allow the examination of over 100 specific disciplines. Findings suggest that focusing on broad categories of disciplines could mask underlying variations in how faculty approach teaching.
Full version
Diversity beyond content: Examining physical and life science fields
BrckaLorenz, A., Priddie, C., & Haeger, H.
Association of American Colleges and Universities Transforming STEM Higher Education Conference, Chicago, IL, 2019, November.
This session uses large-scale multi-institutional data to examine the experiences of diverse students within specific fields of the STEM conglomerate. Within specific STEM disciplines, we first examine a nuanced view of compositional diversity, then student engagement in culturally engaging course work, and finally perceptions of institutional commitment to diversity. In doing this, we find some fields to be highly supportive of diversity, thus problematizing the STEM umbrella. In this session, we will discuss the idea that support for diversity in STEM fields can be improved by looking within. We will focus on practical behaviors faculty and staff can do to foster more support for diversity in STEM fields and how the cultures of STEM fields themselves shape the meaning of diversity in courses.
Full version
Educational environments for faculty: Improving postsecondary teaching through assessment
Strickland, J., BrckaLorenz, A., Fassett, K., Nelson Laird, T.
Professional and Organizational Development Network Annual Conference, Pittsburgh, PA, 2019, November.
This session focuses on understanding the relationship between faculty members' educational environments and their teaching practices. Results from a large-scale, multi-institutional study give insight into these environments by documenting faculty sense of departmental belonging, collegial commitment to quality teaching, and access to resources to meet high standards. Participants will engage in a conversation about how to best assess educational environments, differences across faculty characteristics, and how to create momentum for change.
Full version
Mining and maximizing NSSE data to advance student success
Kinzie, J. (NSSE, Indiana University Bloomington), Castellino, L. (Humboldt State University), Swarat, S. (California State University Fullerton), & Shindledecker, E. (San Francisco State University)
California Association for Institutional Research Annual Conference, Seaside, CA, 2019, November.
Student engagement data provides colleges and universities useful insights into aspects of the undergraduate experience that matter to understanding the whole student and, importantly, what the institution does to promote their success. Yet making full use of institutional National Survey of Student Engagement (NSSE) data is challenging. This session highlights the varied approaches undertaken by institutional research professionals at several CSUs to maximize NSSE data use and mine results to address the system's Graduation Initiative 2025. Participants will learn from effective examples of sharing data in a "Did You Know?" campaign, the use of first-year student data to influence retention, approaches to studying the benefits of high-impact practices, and efforts to interpret qualitative student comments, and will reflect on practices for their own institution.
Full version
Using student engagement data to inform decision making about student success
Kinzie, J. (NSSE, Indiana University Bloomington), & Henderson, A. (Stetson University)
National Association of College and University Business Officers Integrating Analytics Forum, Orlando, FL, 2019, November.
More than 1,600 four-year colleges and universities have data from NSSE about student engagement in practices that matter to student learning and success. Although many institutions use these data to monitor and document effectiveness, too few regularly use their results to make data-informed decisions. This session highlights lessons from campuses that have effectively used NSSE data to make strategic decisions about resource allocation and to inform efforts to enhance undergraduate education. We will highlight how Stetson University used powerful data visualization to expand access to and use of NSSE data to inform institutional decision making and to explore the role of institutional research in helping colleges and universities know where to invest. Join this discussion about general lessons for using educational quality measures and, in particular, how NSSE data can help you make better decisions about student success.
Full version
20 years of student engagement: Insights about students, assessment, and college quality
Kinzie, J., Gonyea, R., & McCormick, A.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
In 2020 the National Survey of Student Engagement enters its third decade assessing the quality of undergraduate learning and success. In 20 years, the student engagement movement has surely changed our notions of quality in higher education. Most institutions now value a culture of evidence, promoting deep approaches to learning, developing high-impact practices, and tracking engagement indicators. This session reviews the most important findings about student engagement in the past two decades, and asks participants to consider what engagement will look like in the next decade. What is next for assessing quality in undergraduate education and collecting evidence for improvement?
Full version
Assessing environmental factors that promote quality collegiate teaching
BrckaLorenz, A., Nelson Laird, T., Fassett, K., Hiller, S., & Strickland, J.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
As the need to improve undergraduate education intensifies, assessment of student and faculty practices should be complemented by information about the environmental conditions that help faculty members do their best work. This session focuses on understanding the relationship between faculty educational environments and their teaching practices. Results from a large-scale, multi-institutional study give insight into these environments by documenting faculty sense of departmental belonging, collegial commitment to quality teaching, and access to resources to meet high standards. Session participants will engage in a conversation about how to best assess educational environments, and how to create momentum for change.
Full version
Assessing the quality of undergraduate living arrangements: Relationships with engagement and persistence
Fosnacht, K., Gonyea, R., Fassett, K., & Graham, P.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
This presentation overviews research findings from the National Survey of Student Engagement's living arrangements study. It discusses student persistence, the sophomore experience, roommate matching policies, and living-learning communities.
Full version
Challenges and benefits of cross sectional assessment
Fassett, K. & BrckaLorenz, A.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
Repeated assessments are intended to generate knowledge about changes occurring on campuses to make informed decisions; however, data often lay dormant, not reaching their full potential beyond a single use. This session clarifies the differences between the uses of longitudinal studies and cross?sectional examinations and discusses strategies for using cross?sectional data to discover trends in student outcomes. Examples include investigations of teaching practices and student engagement over time. Examples will be provided for using both multi?institutional and single institution data sets.
Full version
Getting beyond the label: What makes high-quality HIPs, how widespread are they, and who has access to them?
McCormick, A., Kinzie, J., Gonyea, R., Dugan, B., & Silberstein, S.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
High-impact practices (HIPs) represent a core feature of a high-quality undergraduate education and are often hailed as life-changing events. The literature identifies a set of essential elements common across HIPs, yet to date most evidence about HIPs has been limited to student participation in designated HIPs, with scant empirical examination of their implementation. We report on a multi-institution study of students?? exposure to these elements of quality in six HIPs (learning communities, service-learning, research with faculty, study abroad, internships and field experiences, and culminating senior experiences) to deepen understanding of HIP quality and which students have access to high-quality HIPs.
Full version
Getting lost at the crossing? Tips for assessing intersectional experiences
BrckaLorenz, A., Fassett, K., Kirnbauer, T., & Washington, S.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
Faculty and administrators are often tasked with educating the whole student upon arrival at college, so it is important to understand ways to assess the whole student. This session will discuss factors to consider when quantitatively examining intersecting aspects of students?? identities, student characteristics, and collegiate endeavors. Case studies will provide examples of challenges and strategies for better understanding ways to assess and better understand the experiences of students with intersecting identities. Attendees will discuss their own challenges and solutions for intersectional analyses and leave with tangible takeaways for their work.
Full version
Identifying and helping students develop confidence and growth mindset
Cole, J., & Holmes, B.
NACADA: The Global Community for Academic Advising Annual Conference, Louisville, KY, 2019, October.
Self-efficacy and growth mindset research suggests that entering first-year students with a high degree of academic confidence are more engaged during their first year of college, set higher academic goals, and generally are more academically successful. This session will discuss general principles that can help enhance student confidence and growth mindset. We will also use strength-based advising as a guide to discuss how to best serve incoming students who may be lacking in academic confidence and feelings of helpless regarding their academic performance. This session will culminate with examples advisors may use from the Beginning College Survey of Student Engagement (BCSSE) survey to inform practice.
Full version
Revisiting the impact of LLCs on student engagement and success
Fosnacht, K., Graham, P., Gonyea, R. M., Hurtado, S., & Fassett, K.
ACUHO-I Academic Initiatives Conference, Minneapolis, MN, 2019, October.
Campus housing has changed markedly in recent years, prompting questions about its impact and the benefits of living-learning communities (LLCs) in particular. Sponsored by an ACUHO-I research grant, we surveyed a diverse, multi-campus sample of residents to study the relationships between LLC participation, engagement, perceived gains, and persistence. Results affirm LLCs promote engagement in expected ways, but also point to areas for improvement. Implications for practice will be discussed.
Full version
The next decade of HIPs: Increasing access, quality, and equity
Kinzie, J.
Assessment Institute 2019, Indianapolis, IN, 2019, October.
Many colleges and universities promote the value of high-impact practices (HIPs)--such as service-learning, undergraduate research, internships, and study abroad--and evidence demonstrates that students benefit. Yet simply offering such activities does not guarantee high-quality learning or even participation. Over the past decade, we??ve learned the importance of intentionally designed HIPs that are delivered with fidelity, but shaped to the context, a defined purpose and inclusive pedagogy. This session briefly reviews the HIP landscape, introduces new findings about HIP quality and equity, and suggests practical approaches to scaling and ensuring the quality of HIPs.
Full version
Faculty development for all? Investigating participation in development opportunities
Fassett, K., Strickland, J., Nelson Laird, T., & BrckaLorenz, A.
Society for Teaching and Learning in Higher Education Annual Conference, Winnipeg, Manitoba, Canada, 2019, June.
The session provides a broad overview of current faculty development practices, the faculty members who participate, and how participation relates to the use of effective teaching strategies. The session will incorporate the Faculty Learning Outcomes Framework to help attendees situate how the participation in faculty development practices relates to potential classroom outcomes. Data come from the 2014-2018 administrations of the Faculty Survey of Student Engagement (FSSE) at 33 institutions. Patterns were examined based on faculty characteristics, disciplines, and demographics related to participation in teaching mentorships, teaching learning communities, and teaching-focused conferences.
Full version
Innovations in teaching: A flipped classroom narrative
Fassett, K., Strickland, J., & BrckaLorenz, A.
Society for Teaching and Learning in Higher Education Annual Conference, Winnipeg, Manitoba, Canada, 2019, June.
The session will offer insights from hundreds of faculty teaching at 18 four-year colleges and universities who have applied flipped classroom techniques in their selected courses. Using data collected by the 2018 Faculty Survey of Student Engagement, presenters will share findings on the types of courses that faculty tend to flip as well as ways in which they structure the delivery of their course content. Session participants will also learn about the challenges and benefits faculty experienced in flipping a course and the reasons why they turned to this pedagogical approach. The general purpose of this session is to inspire thoughtful and strategic planning for faculty and offer an example of how assessment professionals may gauge institutional support for innovative teaching practices.
Full version
The ACUHO-I/NSSE Student Housing Study: What have we learned so far?
Graham, P., Fosnacht, K., Fassett, K., Gonyea, R. M., & Hurtado, S.
ACUHO-I Annual Convention and Expo, Toronto, Canada, 2019, June.
Backed by an ACUHO-I Sponsored Research Grant, researchers from the National Survey of Student Engagement surveyed over 55,000 first-year, sophomore, and senior students about their housing, roommates, safety, finances, and well-being. Combining these responses with data on engagement; information about campus facilities, policy, and programming from the ACUHO-I Campus Housing Index; and enrollment records from the National Student Clearinghouse, we are gaining a better understanding of the relationship of housing conditions, student learning, and outcomes. Come listen and ask questions as we share what we have learned about topics like roommate policies, living-learning communities, and more.
Full version
The relationship of sophomore living arrangements on engagement and perceived outcomes
Gonyea, R. M., Fosnacht, K., Fassett, K., & Graham, P.
ACUHO-I Annual Convention and Expo, Toronto, Canada, 2019, June.
Much of the conversation about living on campus focuses on first-year students. In this session, we offer a deep dive into understanding the housing experiences of sophomores at 76 institutions. Using data from the National Survey of Student Engagement and supported by an ACUHO-I Sponsored Research Grant, participants will learn how the background characteristics and engagement of on- and off-campus sophomores are associated with perceptions of safety and support, financial stress, programming, and more. After a presentation of findings, we will engage in a discussion about what this means for housing and residence life policy and practice.
Full version
The role of residence life in undergraduate persistence
Fosnacht, K., Gonyea, R. M., Graham, P., & Fassett, K.
ACUHO-I Annual Convention and Expo, Toronto, Canada, 2019, June.
For many decades, living on campus was believed to be a primary determinant of undergraduate persistence and success. However, more recent research must raise questions about expanding diversity and the experiences of underrepresented groups, changing living arrangements, new programs and learning opportunities, and the changing campus environment in general. This session will present results from a study supported by an ACUHO-I Sponsored Research Grant that examined residence life's contribution to the persistence of first-year and sophomore students at 76 institutions. It will also detail the role residence life programming and factors like perceptions of safety on persistence.
Full version
What motivates us to teach? Examining faculty motivation for teaching
Strickland, J., Fassett, K., BrckaLorenz, A., & Nelson Laird, T.
Society for Teaching and Learning in Higher Education Annual Conference, Winnipeg, Manitoba, Canada, 2019, June.
Understanding faculty motivations for teaching can provide a powerful window into what encourages instructors to do the work of teaching. We administered a brief survey developed from self-determination theory to over 2,000 instructional staff at nineteen institutions. Using data collected through the 2018 administration of the Faculty Survey of Student Engagement, we investigated how varying faculty and institutional characteristics relate to intrinsic, introjected, and external motivations to teach. In this session, participants will be provided insights into how these three motivation types link to identified faculty and institutional characteristics, as a way to promote the highest levels of instructional effectiveness. Teaching and faculty development initiatives can be designed to explicitly focus on meeting the needs of faculty members to inspire motivation types that highly correlate with effective teaching practices.
Full version
A brief introduction to R
Dugan, B.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Aggregate measures: Development, creation, and validation
BrckaLorenz, A., Fassett, K., & Kirnbauer, T.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Item and scale development are critical components to survey research and are often an institutional researcher‘s best tool for understanding higher education populations. As such, it is vital to develop and use sound instruments that provide useful information. This poster presentation will discuss methods for operationalizing concepts, creating items, forming aggregate measures, and using appropriate means for validation and reevaluation. Processes and examples from national large-scale, multi-institution, longitudinal survey projects will be used as a starting point to show viewers suggestions and provide tips at each stage of the aggregate life cycle.
Full version
Celebrating NSSE's 20th: Making the most of student engagement data
Gonyea, R. M., & Kinzie, J.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
In this session, Bob Gonyea and Jillian Kinzie share NSSE‘s achievements, highlight effective institutional reporting and data uses, and preview plans for assessment in the project‘s next several years.
Full version
Crises and considerations for assessment
Fassett, K., & BrckaLorenz, A.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Crises have been studied showing large-scale negative effects on aspects of higher education institutions. However, there has been limited discussion or research about how they appear to influence the operation of institutional research. Given the heightened climate on campuses over the last several years, it is important to consider how crises alter our work. This discussion group begins a conversation about how to prepare, endure, and reflect on ways to analyze data when there may be discontinuity in assessment practices due to crisis.
Full version
How are survey response rates changing? Findings from NSSE
Sarraf, S.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
How much have survey response rates changed at colleges and universities over the last decade? Using a National Survey of Student Engagement longitudinal data set (2010 to 2018) based on approximately 1,000 institutions, this study investigates how much response rates have changed over the years, the degree of variability in response rates within any given year, and what factors influence these outcomes, such as school undergraduate enrollment and the use of survey incentives. While reviewing this poster presentation, attendees will also gain an appreciation for one statistical method well suited for understanding change over time-latent growth curve modeling.
Full version
Illustrating career advancement opportunities in IR with web-scraped data
Dugan, B.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Measuring quality in online education: A NSSE–QM collaboration
Sarraf, S., Kinzie, J., & Burch, B.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
The purpose of this discussion is to explore the extent to which the actual experiences of learners in online courses align with standards for quality online courses as reflected in the Quality Matters Rubric. QM has a dearth of cross-institutional data. NSSE helped! The question set was administered via the standard NSSE administration in spring 2018 to about 6,000 first-year and senior undergraduate students from 21 four-year colleges and universities (non-profit, publics and privates, some QM members) who responded about their online learning experiences in ?entirely online courses? for that term.
Full version
Tableau tips and tricks: Building dynamic dashboards with survey data
BrckaLorenz, A., & Kirnbauer, T.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
IR professionals are responsible for communication information to a broad audience through interactive data visualizations. For many professionals, using Tableau as a tool to create dynamic and appealing visualizations may be frustrating. The purpose of this poster presentation is to help decode Tableau jargon and provide participants with a guide for using essential Tableau features. This presentation will provide guidance on how to import custom colors, the power of using calculated fields and parameters, and other suggestions for building Tableau dashboards using survey data. Examples of visualizations will be shown using data from the Faculty Survey of Student Engagement (FSSE).
Full version
The effect of nonresponse bias in undergraduate student surveys
Fosnacht, K., Gonyea, R., & Cole, J.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Undergraduate living arrangements and persistence
Fosnacht, K., & Gonyea, R.
Association for Institutional Research Annual Forum, Denver, CO, 2019, May.
Comparison of the effects of campus environment and teaching practices on international students' perceived gains through reflective-integrative learning
Oktafiga, D. A., BrckaLorenz, A., & Nelson Laird, T. F.
Comparative and International Education Association Annual Conference, San Francisco, CA, 2019, April.
This session presents findings from a study of international students' college experience that explored the relationships among self-reported perceived gains, reflective-integrative learning, supportive campus environment, and effective teaching practices by considering international students' geographical regions of origin.
Full version
An examination of inclusivity and support for diversity in STEM fields
Haeger, H., BrckaLorenz, A., & Priddie, C.
AAC&U Diversity, Equity, and Student Success Conference, Pittsburgh, PA, 2019, March.
To diversify STEM fields, it is imperative that institutions of higher education move beyond looking at diversity in terms of numerical representation on a narrow set of categories (race/ethnicity, gender 38 and socioeconomic status) by exploring the culture and climate of campuses. Using data from a large- scale, multi-institution study of undergraduate students, we not only look at how proportionally represented students are in STEM fields by a wide variety of identity characteristics, but also explore how perceptions of institutional commitment to inclusivity and culturally engaging coursework compare for STEM and non-STEM students. Within STEM fields, we also examine how students with different identity characteristics perceive institutional commitment to inclusivity.
Creating a lasting impact: Constructing and assessing significant student learning opportunities
Palmer, D., Silberstein, S., & Kinzie, J.
NASPA Annual Conference, Los Angeles, CA, 2019, March.
Full version
Improving diversity and inclusion in college courses should account for varied faculty roles
BrckaLorenz, A. & Nelson Laird, T. F.
AAC&U Diversity, Equity, and Student Success Conference, Pittsburgh, PA, 2019, March.
Despite the overwhelming support for including diversity in coursework, experiences, and environments in higher education, our progress in creating diverse and inclusive curricula falls short. Through an interactive discussion of results from an empirical study of nearly 40,000 full-time faculty employed at over 400 four-year colleges and universities over the past five years, participants in this session will explore the relationship between how faculty approach their scholarly work and their inclusion of diversity in the curriculum. Discussion will focus on multiple aspects of courses (i.e., more than course content) and on what participants and their institutions can do to better to support how different types of faculty create inclusive and culturally engaging spaces.
Full version
Searching for belonging: Queer-spectrum and trans-spectrum students of color in American higher education
Greathouse, M., & BrckaLorenz, A.
National Association of Diversity Officers in Higher Education Annual Conference, New Brunswick, NJ, 2019, March.
This session will highlight findings from a national study of queer-spectrum and trans-spectrum students of color at 4-year colleges and universities across the United States. Participants will learn about the intersections of race, gender, sexuality and gain a better understanding of the experiences, strengths and disparities among queer-spectrum and trans-spectrum students of color.
Full version
Entering students' experience: BCSSE for first-year and transfer students
Cole, J., & Kinzie, J.
Annual Conference on the First-Year Experience, Las Vegas, NV, 2019, February.
Beginning College Survey of Student Engagement (BCSSE) can now be used to survey your first-year, transfer, and older students. Since 2007, nearly 900,000 entering first-year students at more than 500 institutions have completed BCSSE. The updated web survey now includes questions specifically for incoming transfer and older students. This session will describe how data about entering first-year, transfer, and older students provides comprehensive information about your students‘ experiences. Institutions use BCSSE for academic advising, retention models, faculty and staff development, and other assessment needs. This session will present the new survey, revised reports, and details regarding fall and winter administrations.
Full version
Leveraging survey data and predictive analytics to support first-year students
Bombaugh, M., & Cole, J.
Annual Conference on the First-Year Experience, Las Vegas, NV, 2019, February.
This session will discuss the emerging trend of using predictive data to identify and support first-year students. For several years, USF-Tampa has been using an in-house persistence model to identify 10-12% of new first-year students at risk of not persisting to the second year. In Fall 2016, USF incorporated BCSSE data into the predictive model. BCSSE Advising Reports and results are shared with academic advisors, first-year seminar instructors, and housing personnel who provide targeted interventions for these students. BCSSE data not only strengthened the statistical model, but also identified which BCSSE variables were significant predictors of first-year persistence.
Full version
Documenting the value of higher education with student engagement data
Kinzie, J., McCormick, A. C., Gonyea, R. M., & Nez, E.
Association of American Colleges and Universities Annual Meeting, Atlanta, GA, 2019, January.
A key component of the college value story is the explication of
specific knowledge, skills, and habits of mind that students gain from
their undergraduate education. This session will demonstrate the use
of aggregate National Survey of Student Engagement (NSSE) results
to document graduating senior outcomes, highlight new findings from
the Senior Transition module that reveal seniors‘ confidence in essen
-
tial skills and abilities valued by employers, and explore the specific
educational practices associated with these outcomes. We will discuss
the implications of this narrative; illustrate approaches to communicat-
ing it; feature examples from institutions that have used their data
to communicate their unique value stories, including students‘ open-
ended comments to give authentic voice to the quantitative data and
exchange ideas about crafting data-rich value stories.
Full version
Mapping and NSSE: Relating institutional internationalization efforts and student global learning
Kinzie, J., Helms, R., & Brajkovic, L.
Association of International Education Administrators Annual Conference, San Francisco, CA, 2019, January.
Using results from the 2016 iteration of the American Council on Education (ACE) Mapping Internationalization on U.S. Campuses survey and NSSE's Global Learning Topical Module, ACE and NSSE conducted a joint analysis of the two data sets to study the relationship between institutional internationalization efforts and the student global learning that results. This session will address the question of "what works" in producing globally competent graduates, along with implications of the research findings for campus strategies and practice.
Full version
Reshaping the narrative on faculty time and motivations
BrckaLorenz, A., & Nelson Laird, T. F.
Association of American Colleges and Universities Annual Meeting, Atlanta, GA, 2019, January.
Often lost in discussions about what students are doing and learning while in college are the critical roles that faculty play in students‘ learning and development. Relying on results from a large-scale, multi-institution study of thousands of faculty members, participants will examine how faculty spend their time on scholarly activities and how this time allocation relates to good teaching practices. Additionally, participants will discuss why faculty might be allocating their time in different ways, focusing particularly on faculty motivations and what institutions could do to support current trends or reshape the narratives about faculty productivity at their institutions. Connecting faculty time allocation to good teaching practices and motivations for teaching and doing research will provide participants with practical solutions and forewarn potential challenges for maintaining or changing current narratives about faculty work and postsecondary educational spaces.
Full version
The spiritual campus climate for diverse learners
Fosnacht, K.
NASPA Religious, Secular, and Spiritual Identities Conference, New Orleans, LA, 2018, December.
This session will overview three research studies that analyzed the spirituality campus climate for a diverse, multi-institution sample of undergraduates. The first study examined how two aspects of the spirituality campus climate, students‘ comfort in expressing their spiritual beliefs and perceptions of the respect for their beliefs on campus, were related to perceptions of the overall campus climate. The second study investigated how students‘ religion and institution type were related to the spirituality campus climate. The final study examined the correlates of being the victim of an act of religious intolerance on campus. Student affairs professionals will learn how they can utilize the studies‘ findings to improve the spiritual campus climate on their campuses.
Full version
A 10-year cross-section of STEM faculty teaching
Fassett, K., & BrckaLorenz, A.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
Studies have shown that faculty in STEM are slow to adopt pedagogies that improve learning outcomes. This study centered on female STEM faculty, as they have been, and are currently, marginalized in these disciplines. To explore faculty teaching practices, the study used data from the Faculty Survey of Student Engagement (FSSE), which collects data on the ways and extent to which faculty engage students at four-year colleges and universities. A cross-sectional approach used data from three survey administrations spanning ten years to uncover differences in pedagogical approaches among female and male faculty. The Carnegie Basic Classifications for 2005, 2010, and 2015 were used to identify institution types. Master‘s colleges and universities with smaller, medium, and larger programs were collapsed into one group for the analysis. Each year, 48 to 71 institutions were represented in the sample. Of the total 62,000 FSSE respondents in 2007, 2012, and 2017, respectively 1,521; 917; and 1,300 met the criteria of working at a master‘s institution and in a STEM field. Female faculty were found to be using active teaching practices more than their male counterparts.
Full version
A time for action: Relating student identity and experiences with activist behaviors
Zilvinskis, J., Morgan, D., & Dugan, B.
Association for the Study of Higher Education Annual Conference, Tampa, FL, 2018, November.
Using data from an experimental item set administered with the NSSE in which more than three thousand respondents were asked about their involvement in activism, multilevel modeling was employed to measure the relationship between these behaviors and student backgrounds, high-impact practice participation, involvement in student activities, and institutional characteristics. characteristics.
Full version
Examining flipped classes: Planning, enacting, and assessing innovation
Strickland, J., BrckaLorenz, A., Fassett, K., & Ribera, A.
Professional and Organizational Development Network Annual Conference, Portland, OR, 2018, November.
A flipped classroom is one in which traditional in-class activities are completed outside of class to provide facetime for active learning. In this session, participants will learn more about flipped classrooms by examining a large-scale study of flipped classroom practice at 18 institutions. Common characteristics of courses and faculty that incorporate flipped designs, motivations for flipping classes, and benefits and challenges will all be discussed. Participants will be encouraged to reflect on the importance of this teaching practice to meet current student needs with an opportunity to apply lessons learned about flipped classrooms to improve their own practices.
Full version
Assessing faculty experiences teaching a flipped course
Ribera, A., BrckaLorenz, A., Fassett, K., & Strickland, J.
Assessment Institute, Indianapolis, IN, 2018, October.
The session explores flipped classrooms as an innovative pedagogical practice. Facilitators in this session will offer insights from hundreds of faculty who have applied flipped classroom techniques in their courses. Presenters will share findings on the types of courses that faculty tend to flip as well as ways in which they structure the delivery of their course content. Session participants will also learn about the challenges and benefits faculty experienced in flipping a course and why they turned to this pedagogical approach. Discussion will focus on how assessment professionals may gauge institutional support for innovative teaching practices.
Full version
Assessing for diversity: Evidence from NSSE’s Inclusiveness and Engagement with Cultural Diversity and Global Learning modules