• Skip to Content
  • Skip to Main Navigation
  • Skip to Search

NSSE logo

NSSENSSENSSE

Open Search
  • NSSE
    • About NSSE
      • Conceptual Framework
      • Positions and Policies
      • Advisors
      • Partners
      • Employment
    • Survey Instruments
      • Topical Modules
      • Engagement Indicators
      • High-Impact Practices
    • Registration Details
      • Pricing
      • Campus Contacts
      • Administration Checklist
    • Administering NSSE
      • Population File
      • Customizing NSSE
      • Recruitment Method
        • Folder Name
      • Encouraging Participation
      • Terms of Participation
      • Accessibility
      • Data Security
    • Reports & Data
      • NSSE Administration Overview
      • Data Files
      • Sample Report
      • Institutional Report Guide
      • Report Builder
      • Data Summaries & Interactive Displays
    • Working with NSSE Data
      • Data Codebooks
      • Syntax
    • Psychometric Portfolio
      • Response Rates
    • NSSE Shorts (New)
      • Pricing and Registration
      • Administration Instructions
      • Item Sets
      • Reports & Data Use
      • Dashboard LogIn
  • FSSE
    • FSSE Portal Log-in
    • About FSSE
    • Survey Instruments
      • Main Survey
        • FSSE Scales
        • Disciplinary Areas
      • Topical Modules
      • Consortium Questions
    • Registration & Pricing
    • Administering FSSE
      • Administration Overview
      • Confidentiality
      • Customization
        • Preparing for Message Delivery
        • Population File Instructions
      • Data Security
      • IRB Protocol
        • Informed Consent
      • Locating Your Data & Results
      • Sample Reports
        • Administration Summary
        • FSSE Respondent Profile
        • FSSE Topical Module Report
        • FSSE Disciplinary Area Report
        • FSSE-NSSE Combined Report
        • FSSE Frequency Report
        • FSSE Snapshot Report
      • Terms of Participation
    • Findings, Data, & Reports
      • FSSE Overview
      • Content Summaries
      • Data Visualizations
      • Data Use Examples
    • Working with FSSE data
      • Using FSSE Data
      • Analysis Resources
      • Data User's Guide
    • Psychometric Portfolio
  • BCSSE
    • About BCSSE
    • BCSSE Survey
      • BCSSE Scales
    • Fall Check-In
    • Registration & Pricing
    • Administering BCSSE
      • Administration Protocol and Procedures
      • BCSSE Contacts
      • Demonstration Dashboard Portal
      • Institution Participation Agreement
      • IRB
      • Data Security and Accessibility
    • Reports & Data
      • BCSSE Overview
      • Accessing BCSSE Data
      • Summary Tables
    • Working with BCSSE data
      • Additional Resources
    • Dashboard Log-in
  • Support & Resources
    • For Participating Institutions
      • How Institutions Use Their Data
        • Lessons from the Field
          • Institution Examples
        • NSSE Data Use in Brief
        • Search for examples
        • Displaying Results
        • Data Use Teams
      • Data & Results Guides
        • Student Success Mapping
        • Navigating Your Institutional Report
        • Tips for More Inclusive Data Sharing and Analysis
        • Data User's Guide: Sense of Belonging
        • Accreditation Toolkits
        • Sharing and Disseminating NSSE Results
        • NSSE Data User’s Guide
        • Campuswide Mapping
        • Contextualizing NSSE Effect Sizes
        • Custom Analysis
      • Workshops and Webinars
    • For Partnerships
      • Special Projects
    • For Students & Parents
      • Pocket Guide
        • English
        • Spanish
    • For All Audiences
  • Research
    • Annual Results
      • Annual Results 2023
        • Special Report 1
        • Special Report 2
      • Annual Results 2022
        • 1. Rebounding Engagement
        • 2. Digging Deeper Into HIP Quality
        • 3. Hot Topics in Higher Ed
      • Past Annual Results
    • Publications & Presentations
      • Foundational Publications
      • Featured Publications
      • Recent Presentations
      • Lessons from the Field
      • DEEP Practice Briefs
      • Search
    • NSSE Essentials
    • NSSE Sightings (blog)
      • Search Posts
  • Institution Login
  • BLOG
  • Contact Us

Our Research: Projects,
Publications, and More

  • Home
  • NSSE
    • About NSSE
    • Survey Instruments
    • Registration Details
    • Administering NSSE
    • Reports & Data
    • Working with NSSE Data
    • Psychometric Portfolio
    • NSSE Shorts (New)
  • FSSE
    • FSSE Portal Log-in
    • About FSSE
    • Survey Instruments
    • Registration & Pricing
    • Administering FSSE
    • Findings, Data, & Reports
    • Working with FSSE data
    • Psychometric Portfolio
  • BCSSE
    • About BCSSE
    • BCSSE Survey
    • Fall Check-In
    • Registration & Pricing
    • Administering BCSSE
    • Reports & Data
    • Working with BCSSE data
    • Dashboard Log-in
  • Support & Resources
    • For Participating Institutions
    • For Partnerships
    • For Students & Parents
    • For All Audiences
  • Research
    • Annual Results
    • Publications & Presentations
    • NSSE Essentials
    • NSSE Sightings (blog)
  • Search
  • Institution Login
  • BLOG
  • Contact Us
  • Home
  • Research
  • NSSE Sightings (blog)

The Importance of Outside Expertise: Updating the NSSE Disability Items

Dr. John Zilvinskis, Assistant Professor Binghamton University, State University of New York (with Dr. Kirsten Brown and Ms. Bridgette Holmes)

Thursday, May 06, 2021

When it comes to updating NSSE items, sometimes it is necessary to consult with outside experts to make sure we are "getting things right" when it comes to the most recent research and terminology. However, we still want to make sure that new items will fit seamlessly within the existing NSSE survey. This invited guest blog describes the process for updating the NSSE disability item that is part of the demographic section of the core survey.

 

Forming Our Research Team

As part of this project, our team came together as colleagues presenting at conferences and networks within higher education survey research. At the Fall 2019 Annual Association for the Study of Higher Education Conference, Dr. Kirsten Brown and I presented on a panel Conceptualizing disability, discussing the tradeoffs of measuring disability along with the panel organizer Dr. Ellen Broido and Dr. Ryan Wells. During this conference, I ran into colleague Dr. Allison BrckaLorenz and mentioned the panel, and during this conversation Dr. BrckaLorenz invited the group to propose an updated version of the disability item for the National Survey of Student Engagement (NSSE). She also introduced me to Ms. Bridgette Holmes, a current Graduate Research Assistant for NSSE, who is studying Black students with disabilities for her dissertation.

The three of us, Dr. Brown, Ms. Holmes, and myself, began meeting weekly in spring 2020 to further explore how disability is measured via survey research. We followed the work of Dr. Jason Garvey, who studies the way sexual orientation is measured in higher education. Part of our agenda included a proposal to update the current NSSE items measuring disability. In a special issue for the Journal of Postsecondary Education and Disability, I had written about the tradeoffs of these questions (along with the survey items on the Community College Survey of Student Engagement) and had used them in my own research. Meanwhile, Dr. Brown contributed her expertise on the scholarship of disability research in higher education, notably serving as a co-author for Disability in higher education: A social justice approach along with several other works. Ms. Holmes added her familiarity with the survey, and also provided insight into the ways our research can be used for advocacy for students with disabilities.

The National Survey of Student Engagement Disability Items Spring 2020

Proposing Revisions

Our proposal included two major changes. First, our research team wanted to update the stem of the first question. The existing language came from the medical model of disability, including the word "diagnosed." Our criticism of this approach is that it removes the efficacy of the student and puts diagnosis in the hands of a third-party medical professional. Additionally, it is not inclusive for students who may have been diagnosed as a child but have not been evaluated recently, or students who become disabled later in life. Furthermore, our team wanted to expand the options for the follow-up question, which would provide researchers and educators with a better option for disaggregation. Improvements to this item included differentiating between the deaf and blind communities, adding options not previously represented in the survey such as chronic health issues, and differentiating between mental health issues such as depression and anxiety.

Our research team consulted over 20 versions of surveys measuring disability to create a draft of the new items. The draft was forwarded to 7 experts on disability in higher education for feedback before being sent to the NSSE Item Revision Team. While discussing the new item, the team worked through issues such as considering the functionality of one vs. two survey questions related to disability, aligning the grammar in question stem and response options, and consistency with language that is used by disabled communities and scholars on this topic.

Using Data for Policy and Practice

Below are the final survey items that will be included in the spring 2021 NSSE administration. Of course, any updates to a survey item will have tradeoffs such as increasing length or inability to combine multiple years of data, but our hope is that the new version will be more welcoming and inclusive for respondents with disabilities. Our research team also believes this version will provide more nuanced and detailed data for researchers and educators. For example, in the current era, being able to identify students with depression and/or anxiety is critically important.

Furthermore, connecting this aspect of identity to NSSE's measures of student engagement will provide more information on the pathways to success for students. On a campus level, institutional researchers can explore engagement within broad categories of disability through the aggregate NSSE data, and also use their institution's student-level data to learn more about this aspect of identity. On a national level, we believe these items could serve as an example for other survey researchers to better understand this group.

  • Annual Results
  • Publications & Presentations
  • NSSE Essentials
  • NSSE Sightings (blog)
    • Search Posts

Evidence-Based Improvement in Higher Education resources and social media channels

  • Twitter
  • LinkedIn
  • Facebook
  • Instagram
  • YouTube

RELATED SITES

  • Center for Postsecondary Research
  • Indiana University Bloomington School of Education

Evidence-Based Improvement in Higher Education

Center for Postsecondary Research
Indiana University School of Education
201 N. Rose Avenue
Bloomington, IN 47405-1006
Phone: 812.856.5824
Contact Us


NSSE, FSSE, BCSSE, and the column logo are registered with the U.S. Patent and Trademark Office.
Accessibility | Privacy Notice | Copyright © 2021 The Trustees of Indiana University

Center for Postsecondary Research | Indiana University Bloomington School of Education