Can Consumer Chatbots Reason? A Student-Led Field Experiment Embedded in an "AI-for-All" Undergraduate Course

Amarda Shehu, Adonyas Ababu, Asma Akbary, Griffin Allen, Aroush Baig, Tereana Battle, Elias Beall, Christopher Byrom, Matt Dean, Kate Demarco, Ethan Douglass, Luis Granados, Layla Hantush, Andy Hay, Eleanor Hay, Caleb Jackson, Jaewon Jang, Carter Jones, Quanyang Li, Adrian Lopez, Logan Massimo, Garrett McMullin, Ariana Mendoza Maldonado, Eman Mirza, Hadiya Muddasar, Sara Nuwayhid, Brandon Pak, Ashley Petty, Dryden Rancourt, Lily Rodriguez, Corbin Rogers, Jacob Schiek, Taeseo Seok, Aarav Sethi, Giovanni Vitela, Winston Williams, Jagan YetukuriarXiv 2026 · DOI

BibTeX
@misc{shehu2026can,
  author = {Amarda Shehu and Adonyas Ababu and Asma Akbary and Griffin Allen and Aroush Baig and Tereana Battle and Elias Beall and Christopher Byrom and Matt Dean and Kate Demarco and Ethan Douglass and Luis Granados and Layla Hantush and Andy Hay and Eleanor Hay and Caleb Jackson and Jaewon Jang and Carter Jones and Quanyang Li and Adrian Lopez and Logan Massimo and Garrett McMullin and Ariana Mendoza Maldonado and Eman Mirza and Hadiya Muddasar and Sara Nuwayhid and Brandon Pak and Ashley Petty and Dryden Rancourt and Lily Rodriguez and Corbin Rogers and Jacob Schiek and Taeseo Seok and Aarav Sethi and Giovanni Vitela and Winston Williams and Jagan Yetukuri},
  title = {{Can Consumer Chatbots Reason? A Student-Led Field Experiment Embedded in an "AI-for-All" Undergraduate Course}},
  year = {2026},
  eprint = {2601.04225},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2601.04225},
}

Loading related content...

Figure