TY - GEN
T1 - Inclusivity Bugs in Online Courseware
T2 - 18th Annual ACM International Computing Education Research Conference, ICER 2022
AU - Chatterjee, Amreeta
AU - Letaw, Lara
AU - Garcia, Rosalinda
AU - Reddy, Doshna Umma
AU - Choudhuri, Rudrajit
AU - Kumar, Sabyatha Sathish
AU - Morreale, Patricia
AU - Sarma, Anita
AU - Burnett, Margaret
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/8/3
Y1 - 2022/8/3
N2 - Motivation: Although asynchronous online CS courses have enabled more diverse populations to access CS higher education, research shows that online CS-ed is far from inclusive, with women and other underrepresented groups continuing to face inclusion gaps. Worse, diversity/inclusion research in CS-ed has largely overlooked the online courseware - the web pages and course materials that populate the online learning platforms - that constitute asynchronous online CS-ed's only mechanism of course delivery. Objective: To investigate this aspect of CS-ed's inclusivity, we conducted a three-phase field study with online CS faculty, with three research questions: (1) whether, how, and where online CS-ed's courseware has inclusivity bugs; (2) whether an automated tool can detect them; and (3) how online CS faculty would make use of such a tool. Method: In the study's first phase, we facilitated online CS faculty members' use of GenderMag (an inclusive design method) on two online CS courses to find their own courseware's inclusivity bugs. In the second phase, we used a variant of the GenderMag Automated Inclusivity Detector (AID) tool to automatically locate a "vertical slice"of such courseware inclusivity bugs, and evaluated the tool's accuracy. In the third phase, we investigated how online CS faculty used the tool to find inclusivity bugs in their own courseware. Results: The results revealed 29 inclusivity bugs spanning 6 categories in the online courseware of 9 online CS courses; showed that the tool achieved an accuracy of 75% at finding such bugs; and revealed new insights into how a tool could help online CS faculty uncover assumptions about their own courseware to make it more inclusive. Implications: As the first study to investigate the presence and types of cognitive- and gender-inclusivity bugs in online CS courseware and whether an automated tool can find them, our results reveal new possibilities for how to make online CS education a more inclusive virtual environment for gender-diverse students.
AB - Motivation: Although asynchronous online CS courses have enabled more diverse populations to access CS higher education, research shows that online CS-ed is far from inclusive, with women and other underrepresented groups continuing to face inclusion gaps. Worse, diversity/inclusion research in CS-ed has largely overlooked the online courseware - the web pages and course materials that populate the online learning platforms - that constitute asynchronous online CS-ed's only mechanism of course delivery. Objective: To investigate this aspect of CS-ed's inclusivity, we conducted a three-phase field study with online CS faculty, with three research questions: (1) whether, how, and where online CS-ed's courseware has inclusivity bugs; (2) whether an automated tool can detect them; and (3) how online CS faculty would make use of such a tool. Method: In the study's first phase, we facilitated online CS faculty members' use of GenderMag (an inclusive design method) on two online CS courses to find their own courseware's inclusivity bugs. In the second phase, we used a variant of the GenderMag Automated Inclusivity Detector (AID) tool to automatically locate a "vertical slice"of such courseware inclusivity bugs, and evaluated the tool's accuracy. In the third phase, we investigated how online CS faculty used the tool to find inclusivity bugs in their own courseware. Results: The results revealed 29 inclusivity bugs spanning 6 categories in the online courseware of 9 online CS courses; showed that the tool achieved an accuracy of 75% at finding such bugs; and revealed new insights into how a tool could help online CS faculty uncover assumptions about their own courseware to make it more inclusive. Implications: As the first study to investigate the presence and types of cognitive- and gender-inclusivity bugs in online CS courseware and whether an automated tool can find them, our results reveal new possibilities for how to make online CS education a more inclusive virtual environment for gender-diverse students.
KW - GenderMag
KW - Inclusivity bugs
KW - online CS education
UR - http://www.scopus.com/inward/record.url?scp=85137084654&partnerID=8YFLogxK
U2 - 10.1145/3501385.3543973
DO - 10.1145/3501385.3543973
M3 - Conference contribution
AN - SCOPUS:85137084654
T3 - ICER 2022 - Proceedings of the 2022 ACM Conference on International Computing Education Research
SP - 356
EP - 372
BT - ICER 2022 - Proceedings of the 2022 ACM Conference on International Computing Education Research
PB - Association for Computing Machinery, Inc
Y2 - 7 August 2022 through 11 August 2022
ER -