Discover Truths: Mastering Info Literacy

In the world of AI, being able to identify reliable information is more important than ever. AI chatbots like those on Poe can provide tons of information, but how do you determine if that information is accurate or trustworthy? That’s where information literacy comes into play. In this lesson, we’ll explore how to evaluate sources, understand AI limitations and master the art of finding credible information.

Before exploring this topic, it’s recommended to watch this YouTube clip to understand the potential consequences of using ChatGPT in legal proceedings, especially when misinformation is generated.

Understanding Information Literacy 

Information literacy is the ability to find, evaluate, and use information effectively. It’s a vital skill when working with AI tools and online resources. Here’s why it matters:

  • AI Chatbots Aren’t Always Right: Chatbots like GPT-4o or Assistant can provide answers that sound convincing but might not be entirely accurate.
  • Misinformation is Everywhere: The internet is full of unreliable data, fake news, and biased opinions.
  • AI Hallucinations Can Occur: Sometimes, AI generates hallucinations—responses that seem plausible but actually are inaccurate or false. For example, an AI might summarize an article with content created by it or answer questions with meaningless responses.
  • Critical Thinking is Key: To make informed decisions, you need to critically assess the information you receive.
Can you spot any wrong information on this AI-generated photo?
Is this photo reliable?

Causes of AI hallucination

  • Source-Reference Divergence: AI hallucinations can occur when the training data contains inconsistencies or inaccuracies, leading to outputs that are not grounded in reality.
  • Input Bias: A biased or unrepresentative training dataset can cause the AI to hallucinate patterns that reflect societal or systemic biases.
  • Encoding/Decoding Errors: Errors in encoding or decoding can result in the AI learning wrong correlations or misinterpreting input, producing results that diverge from the intended output.
  • Overconfident Memorization: The model can become overconfident in its hardwired knowledge during pre-training, resulting in false outputs that it confidently presents as accurate.
  • Adversarial Attacks: Malicious manipulation of input data in the form of adversarial attacks can trick the AI into hallucinating false or misleading results.

Evaluating Information

When engaging with AI or online tools, use these steps to evaluate the credibility of the information provided:

1. Who is the Author?

  • Does the author have expertise in the subject?
  • Are they cited in other reliable sources?

2. Is the Information Current?

  • Check the date of publication or the last update.
  • For rapidly changing topics (like AI), older information may no longer be relevant.

3. What is the Purpose?

  • Does the content aim to inform, persuade, or sell something?
  • Separate facts from opinions or promotional material.

4. Is the Source Reliable?

  • Was the information published by a reputable institution (e.g., universities, government, or credible organizations)?
  • Avoid sensational or overly biased sources.

Practicing Info Literacy with AI

Now, let’s practice evaluating information while using AI chatbots on Poe. Keep in mind that AI hallucinations may occur—this is when the AI provides information that appears valid but is factually incorrect or misleading. For instance, if asked for a summary, the AI might fabricate a quote that was never part of the original material.

Try it with Poe!


Try these prompts:

  • “What are the causes of climate change? Can you provide recent data?”
  • “Summarize the pros and cons of renewable energy sources.”
  • “Explain how vaccines work, and include credible sources for further reading.”

After receiving the chatbot’s response, use the steps above to assess its credibility and check for hallucinations. Watch for any responses that sound plausible but don’t make sense or include invented details.

Tips for Fact-Checking

Here are some quick tips to ensure the information you’re using is accurate:

  • Cross-Check: Compare the chatbot’s response with other reliable sources. Consider using AI with search engine, like Perplexity, to verify information on the internet.
  • Use Fact-Checking Websites: Platforms like Snopes or FactCheck.org can verify claims.
  • Look for Citations: Reliable information is often backed by references or links to trustworthy research.
  • Watch for Hallucinations: Be on alert for fabricated statements, events, or sources that may seem realistic but are incorrect. If a source mentioned by the AI doesn’t exist or cannot be verified, treat the information with skepticism.
  • Avoid Overreliance on AI: Remember, AI is a tool—not a definitive source of truth.
We can use Perplexity to verify information on the internet.

AI tools are powerful but can produce inaccuracies, especially with complex topics. For instance, an AI might incorrectly state, ‘Einstein discovered gravity.’ Always critically evaluate information from AI chatbots, as misinformation spreads quickly. Your ability to verify information is crucial when using generative AI.

Where Is Info Literacy Useful Today?

Information literacy is a valuable skill in many areas of life:

  • Social Media: Identifying fake news or manipulated content.
  • Academics: Ensuring research is based on credible sources.
  • Workplace: Making informed decisions by relying on trustworthy data.

For example, platforms like Google Scholar or Cornell University Library provide access to reliable academic sources. In addition, by studying AI responses critically, you are better equipped to detect common hallucinations and avoid incorporating inaccurate information into your work.

Now you’ve learned the basics of mastering information literacy, test your skills by critically analyzing the information you discover using Poe or other AI tools. Stay alert for hallucinations, and always cross-check your findings. In the next topic, we’ll explore how to create your own AI projects step by step!