• About WordPress
    • WordPress.org
    • Documentation
    • Support
    • Feedback
  • Log In
  • About
    • Mission
    • Board of Directors
    • Committees
    • Bylaws
    • Strategic Plan
    • Annual Reports
    • Administrative Centre Staff
    • Contact Us
  • Members
    • Benefits of Membership
    • Join or Renew
    • Get Involved
    • Awards
  • Opportunities
    • Interest Groups
    • The Conference
    • The Journal
    • International Collaborative Writing Groups
    • ISSOTL Fellows Program
    • Committees
    • Board of Directors
    • Awards
  • Events
    • Annual Conference
      • Conference Listing
  • Publications
    • Teaching & Learning Inquiry
    • ISSOTL Blog
  • Updates
    • Blog
    • News
    • Jobs
    • ISSOTL Social Media
    • Become a Member
    • Log in
International Society for the Scholarship of Teaching and Learning (ISSOTL)
  • About
    • Mission
    • Board of Directors
    • Committees
    • Bylaws
    • Strategic Plan
    • Annual Reports
    • Administrative Centre Staff
    • Contact Us
  • Members
    • Benefits of Membership
    • Join or Renew
    • Get Involved
    • Awards
  • Opportunities
    • Interest Groups
    • The Conference
    • The Journal
    • International Collaborative Writing Groups
    • ISSOTL Fellows Program
    • Committees
    • Board of Directors
    • Awards
  • Events
    • Annual Conference
      • Conference Listing
  • Publications
    • Teaching & Learning Inquiry
    • ISSOTL Blog
  • Updates
    • Blog
    • News
    • Jobs
    • ISSOTL Social Media
    • Become a Member
    • Log in

Blog

  • Home
  • Blog
  • Blog
  • Student-generated data – Trends in the 2014 Conference program

Student-generated data – Trends in the 2014 Conference program

  • Posted by ISSOTL Admin
  • Categories Blog
  • Date June 16, 2015
  • Comments 0 comment
  • Nichole Powell, Assistant Professor of Chemistry, Oxford College of Emory University, USA, nichole.powell@emory.edu
  • Brenda Harmon, Senior Lecturer and Chemistry Laboratory Director, Oxford College of Emory University, USA, bharmon@emory.edu
  • Margy MacMillan, Professor/Communications Librarian, Mount Royal University, Calgary, AB, Canada mmacmillan@mtroyal,.ca

In a pre-conference workshop at ISSOTL 2014, a small group of us decided to investigate how much of the SoTL work presented at ISSOTL 2014 was actually based on data from students. As we dove into the work, trends emerged around the kinds of investigations reported on and the kinds of data presented. This blog post provides a quick summary of what we found and raises questions that point the way to future work.

The workshop, “A Collaborative flash-research project on the state of the field of SoTL,” was led by Peter Felten, Nancy Chick, and Margy MacMillan. It had a number of objectives, including familiarizing participants with the breadth of SoTL research, developing protocols for analysing data from conference programs, and actually looking for patterns and meaning in the abstracts of successful submissions to ISSOTL 2014. Our team – Margy from Mount Royal University, Nichole Powell and Brenda Harmon from Emory University, and Sook (Ivy) Chia from the Singapore Ministry of Education, first extracted presentations that identifiably dealt with data from students. Some of us continued working on the data in the Winter and Spring and thought others might be interested in what we found.

We found that of the 178 presentations and 44 posters (T=222), abstracts for 98 clearly stated that at least some portion of the presentation was based on data generated by learners (we did not include pre-conference workshops). Of these, using Pat Hutching’s taxonomy of questions we classified 53 as ‘What is” questions, 26 as “What works” questions, and 19 as including elements of both..

We first looked at indicators of which populations were being studied, so extracted information on level and discipline of students and courses.

Student level# of abstracts (T=98)
Freshman/early undergraduate22
Undergraduate35
Upper-level undergraduate10
Senior5
Graduate12
Not Given7
Mixed levels5
Other2

It appears that the majority of studies involve undergraduate students with the largest identifiable subcategory being first year students. This leaves a lot of room for those who wish to study students further along in academia. It would be useful to know for example whether there are similar effects to various interventions in later years to those seen in freshmen populations.       

Similarly, we looked at patterns in the representation of disciplines:

Student level# of abstracts (T=98)
Freshman/early undergraduate22
Subject/Discipline (where noted)# of abstracts (T=98)
Science22
Health-related15
History/Social Science15
All (drawn from across many disciplines)12
English/composition/communication10
Not given6
Education5
Liberal arts/interdisciplinary5
Business4
Fine Arts4

The sciences are well represented at the conference. Is it possible that faculty who hold appointments that have high teaching loads in the sciences choose to publish SoTL work rather than laboratory based scholarship? Or is there more support for SoTL in the sciences? Or are presentations based on methods drawn from the sciences more likely to be accepted?

We were interested in the kinds of student data used, distinguishing between performance – data based on students’ assignments, tests, assessments etc. and perception – data based on how students thought they were doing and/or their attitudes to subject matter etc.

Type of data# of abstracts (T=98)
Only Perception49
Only Performance25
Both Performance and Perception20
Not determinable from abstract4

Researchers used a variety of performance measures including tests, written work, concept maps, performance reviews, peer reviews, grade point average, and retention. Similarly we saw a variety of perception measurements. This evidence included reflections, self-assessments, focus groups, interviews, surveys, and recorded conversations. Some abstracts noted another interesting indicator of student learning: behavior. The results here show a marked reliance on perception data to gauge the effects of various intervention or to understand what is going on in the classroom. What are the implications of this for the strength of conclusions about student learning? Are there benefits for combining data from perception and performance measures and if so, what are they?

This is just a preliminary look at an interesting data set; there is more work that could be done by looking at criteria in combination, e.g. are there patterns in whether ‘What is” or ‘What works” are measured through performance or perceptions? and what are the disciplinary differences in levels of students studied, questions asked and measures used?

This activity – examining the program abstracts for themes- was a fabulous way to clarify our thinking and to give us a “big picture” understanding of what SoTL is and can be. In the workshop we worked with people from various disciplines and this allowed us to move outside our own disciplinary lenses and required us to think outside our disciplinary box. We have gained a much clearer understanding of what SoTL is and what it can be (various forms, types of questions pursued, evidence of student learning, etc.)

Open questions others might want to investigate:

  • What are the characteristics of research that investigates students across sections, courses or disciplines?
  • What are the patterns in methods of gathering and analyzing data from students?
  • Are there patterns in research /results undertaken in different kinds of institutions?
  • Do the patterns we saw in the data for the 2014 conference show up in the abstracts for other ISSOTL conferences? other non-ISSOTL conferences?
  • Share:
author avatar
ISSOTL Admin

Previous post

Students & SoTL Committee Seeks Members
June 16, 2015

Next post

Communications Committee Seeks Members
July 17, 2015

You may also like

72883 photo
Students’ Views on the Nature of Science in an Interdisciplinary First-Year Science Program: Content Analysis of a Weekly Reflection Activity
16 March, 2023
Print
A Constellation Model for Mentoring Undergraduates During COVID-19
16 March, 2023
Camarao+and+Din_Image+for+blog+post
“A Group of People to Lean On and Learn From”: Graduate Teaching Assistant Experiences in a Pedagogy-Focused Community of Practice
16 March, 2023

Leave A Reply Cancel reply

You must be logged in to post a comment.

Search

Categories

  • Blog
  • Jobs
  • News
  • Teaching & Learning Inquiry: The ISSOTL Journal Content

Archives

  • March 2023 (5)
  • February 2023 (4)
  • January 2023 (7)
  • December 2022 (1)
  • November 2022 (1)
  • October 2022 (6)
  • September 2022 (2)
  • August 2022 (4)
  • July 2022 (5)
  • June 2022 (4)
  • May 2022 (2)
  • April 2022 (2)
  • March 2022 (9)
  • February 2022 (7)
  • January 2022 (6)
  • December 2021 (4)
  • November 2021 (4)
  • October 2021 (2)
  • September 2021 (1)
  • August 2021 (1)
  • June 2021 (1)
  • May 2021 (2)
  • April 2021 (1)
  • March 2021 (2)
  • February 2021 (5)
  • January 2021 (2)
  • December 2020 (4)
  • October 2020 (3)
  • September 2020 (2)
  • August 2020 (1)
  • June 2020 (4)
  • April 2020 (1)
  • March 2020 (3)
  • January 2020 (2)
  • November 2019 (5)
  • October 2019 (31)
  • September 2019 (3)
  • July 2019 (1)
  • April 2019 (3)
  • March 2019 (27)
  • January 2019 (2)
  • November 2018 (2)
  • October 2018 (6)
  • August 2018 (1)
  • July 2018 (1)
  • June 2018 (2)
  • May 2018 (9)
  • March 2018 (1)
  • January 2018 (3)
  • December 2017 (2)
  • November 2017 (1)
  • October 2017 (3)
  • September 2017 (2)
  • August 2017 (5)
  • June 2017 (4)
  • May 2017 (2)
  • April 2017 (2)
  • March 2017 (3)
  • February 2017 (2)
  • January 2017 (4)
  • November 2016 (3)
  • October 2016 (4)
  • September 2016 (1)
  • August 2016 (1)
  • May 2016 (1)
  • April 2016 (3)
  • March 2016 (1)
  • February 2016 (3)
  • January 2016 (1)
  • December 2015 (3)
  • November 2015 (6)
  • August 2015 (1)
  • July 2015 (1)
  • June 2015 (2)
  • May 2015 (2)
  • April 2015 (1)
  • February 2015 (2)
  • January 2015 (3)
  • December 2014 (2)
  • November 2014 (1)
  • August 2014 (1)
  • May 2014 (1)
  • April 2014 (1)
  • January 2014 (3)
  • December 2013 (3)
  • November 2013 (1)

ISSOTL

© 2023 International Society for the Scholarship of Teaching and Learning (ISSOTL) All rights reserved.

Contact Us

MENU

ABOUT

MEMBERS

OPPORTUNITIES

EVENTS

PUBLICATIONS

UPDATES

Facebook Twitter Linkedin Youtube

Web Design by Clio Websites. Powered by WordPress.

Login with your site account

Lost your password?