Skip to Main Content

Artificial Intelligence for Faculty: Chatbot - Proof Strategies

Chatbot Proof Assignments

Chatbot Proof Strategies

While there may not be completely chatbot-proof assignments, try some of the strategies listed below to mitigate the use of chatbots by students in your course.

You may also want to add specific language to your syllabus indicating that using a chatbot in your course will be considered cheating and/or plagiarism.

_____________________________________________________________________________

Strategies

Move away from the five-paragraph essay format. Chatbots can follow this format easily. Encourage your students' originality by moving away from this formulaic format.

Tip: If you want to stick with the five-paragraph essay, test out your prompt on an advanced chatbot like ChatGPT. Greene (2022) writes, "If it can come up with an essay that you would consider a good piece of work, then that prompt should be refined, reworked, or simply scrapped... if it comes up with an assignment that can be satisfactorily completed by computer software, why bother assigning it to a human being?"

_____________________________________________________________________________

Sticking with essays? Warner (2022) suggests focusing on process rather than product. Scaffolding learning and allowing students to explain their thinking and make learning visible along the way are strategies that may help you confirm student originality.

Using collaborative activities and discussions is one strategy to mitigate the use of chatbot responses in your class. While students may generate ideas from a chatbot, they will need to discuss with one another whether they want to use the chatbot responses, if they fit the prompt, and if they are factually accurate.

Activities to try include:

These strategies can work for online courses with a few tweaks. For discussions, ask students to post a recording rather than text. While students may generate a response using ChatGPT, creating their video will require more interaction with the content than copy-pasting a text response would.

Idea from Ditch That Textbook

Engage your students in meaning-making activities to demonstrate their learning.

Consider low-tech activities like:

Consider technology-infused activities like:

 

* Note that a chatbot can provide an outline for these activities.

Brain dumps are an ungraded recall strategy. The practice involves pausing a lecture and asking students to write everything they can recall about a specific topic. Read more at:


Idea from Ditch That Textbook

During or after writing, students explain their process or thinking. Students could:

  • Use Comments in Word or Google Docs;
  • Create a video explaining their change history on a Google Doc;
  • Use Track Changes to show their revisions.

Inspired by Watkins (2022) also see the article from Times Higher Education in the section above.

Consider using planned or impromptu oral exams. You may consider including phrasing in your syllabus about conducting oral exams if you suspect plagiarism through the use of a chatbot.


Idea from Darren Hudson Hick (2022).

When selecting readings, consider sourcing more obscure texts for your students to read. Chatbots may have less information in their training data on obscure texts. As an example, the New York Times reports that, "Frederick Luis Aldama, the humanities chair at the University of Texas at Austin, said he planned to teach newer or more niche texts that ChatGPT might have less information about, such as William Shakespeare’s early sonnets instead of 'A Midsummer Night’s Dream'" (Huang, 2023). 

Contact your Librarian Liaison for help sourcing new content.

(Note that ChatGPT is currently trained on data through 2021. Some educators suggest using newer writings and research, but this strategy isn't foolproof since the training models for chatbots are updated frequently.)

References

Greene, P. (2022, December 11). No, ChatGPT is not the end of high school english. But here’s the useful tool it offers teachers. Forbes. Retrieved on January 9, 2023, from https://www.forbes.com/sites/petergreene/2022/12/11/no-chatgpt-is-not-the-end-of-high-school-english-but-heres-the-useful-tool-it-offers-teachers

Hick, D.H. (2022, December 15). Today, I turned in the first plagiarist I’ve caught using A.I. software to write her work [Facebook post]. Facebook. Retrieved on January 10, 2023, from https://www.facebook.com/title17/posts/pfbid0D8i4GuCUJeRsDJjM1JJtfkDYDMCb7Y7RdK2EoyVhRuctg9z2fhvpo1bB2WAxGBzcl

Huang, K. (2023, January 16). Alarmed by A.I. chatbots, universities start revamping how they teach. The New York Times. Retrieved on January 17, 2023, from https://www.nytimes.com/2023/01/16/technology/chatgpt-artificial-intelligence-universities.html

Kelley, K.J. (2023, January 19). Teaching Actual Student Writing in an AI World. Inside Higher Ed. Retrieved on January 19, 2023, from https://www.insidehighered.com/advice/2023/01/19/ways-prevent-students-using-ai-tools-their-classes-opinion

Warner, J. (2022, December 11). ChatGPT can't kill anything worth preserving: If an algorithm is the death of high school English, maybe that's an okay thing. The Biblioracle Recommends. Retrieved on January 11, 2023, from https://biblioracle.substack.com/p/chatgpt-cant-kill-anything-worth