OC logo
Libraries Home Start Researching Subject Guides Services About Us
Skip to Main Content

AI Literacy

Fact-checking Toolkit

Fact Check AI Responses

Currently, there is no way to guarantee AI-generated answers are correct or accurate. If you plan to use AI-generated answers in your academic or professional work, here are some steps you can take to fact check that information.

  • Verify citations are real by searching article titles. Use Google Scholar or OneSearch for academic sources.
  • Read the output critically, watching for logical leaps, circular arguments, and misinformation.
  • Compare hard data (statistics, dates, names, etc.) in the AI answer to data from reliable sources.
  • Compare claims and conclusions to trustworthy sources

Librarians can help with the verification process!

Watch the two UMD Library videos below for demonstrations of fact checking AI.

Captions are available on the video.
Captions available on the video.

FactChecking ChatGPT Citation Claims

Fact Checking Info about AI

There is a LOT of video and writing about AI, but not all of it is worth your time or attention. While many of us are not going to learn to code and participate in the creation of AI, we can all be AI-literate.
A key part of AI-literacy is having a broad understanding of the technologies and critically approaching new information concerning AI.

The ROBOT Evaluation Criteria

When you watch videos or read articles about AI, consider the following—
Reliability
  • How reliable is this information about the AI technology?
  • If it’s not produced by the party responsible for the AI, what are the author’s credentials? Bias?
  • If it is produced by the party responsible for the AI, how much information are they making available? 
    • Is information only partially available due to trade secrets?
    • How biased is they information that they produce?
Objective
  • What is the goal or objective of the use of AI?
  • What is the goal of sharing information about it?
    • To inform?
    • To convince?
    • To find financial support?
Bias
  • What could create bias in the AI technology?
  • Are there ethical issues associated with this?
  • Are bias or ethical issues acknowledged?
    • By the source of information?
    • By the party responsible for the AI?
    • By its users?
Owner
  • Who is the owner or developer of the AI technology?
  • Who is responsible for it?
    • Is it a private company?
    • The government?
    • A think tank or research group?
  • Who has access to it?
  • Who can use it?
Type
  • Which subtype of AI is being discussed?
  • Is the technology theoretical or applied?
  • What kind of information system does it rely on?
  • Does it rely on human intervention? 

Hervieux, S. & Wheatley, A. (2020). The ROBOT test [Evaluation tool].