{"id":161843,"date":"2025-02-19T00:12:02","date_gmt":"2025-02-19T05:12:02","guid":{"rendered":"https:\/\/www.thecollegefix.com\/?p=161843"},"modified":"2025-02-19T00:39:57","modified_gmt":"2025-02-19T05:39:57","slug":"experts-weigh-in-on-misinformation-scholar-who-used-fake-ai-citations","status":"publish","type":"post","link":"https:\/\/www.thecollegefix.com\/experts-weigh-in-on-misinformation-scholar-who-used-fake-ai-citations\/","title":{"rendered":"Experts weigh in on \u2018misinformation\u2019 scholar who used fake AI citations"},"content":{"rendered":"<p><em><strong>Law school dean calls for \u2018rigorous fact checking\u2019 to avoid artificial intelligence problems<\/strong><\/em><\/p>\n<p>A self-described &#8220;expert&#8221; on &#8220;misinformation&#8221; and artificial intelligence apologized after the AI program he used inserted fake citations into a legal brief. Several higher education experts, including a law school dean, told <em>The College Fix<\/em> what can be done to prevent similar situations in the future.<\/p>\n<p>Stanford University Professor Jeff Hancock submitted a second court filing in a case concerning <a href=\"https:\/\/www.revisor.mn.gov\/statutes\/2023\/cite\/609.771\" target=\"_blank\" rel=\"noopener\">Minnesota\u2019s law<\/a> against \u201cdeepfakes,\u201d which are artificial intelligence-created videos that seem realistic. The video can look realistic, making them a tool for campaigns who might hope to paint their opponent in a negative light.<\/p>\n<p>Hancock, the editor of a journal about \u201cmisinformation,\u201d played his own role in spreading fake news, when he submitted testimony that included \u201challucinated citations,\u201d meaning they were not real. In his <a href=\"https:\/\/storage.courtlistener.com\/recap\/gov.uscourts.mnd.220348\/gov.uscourts.mnd.220348.23.0.pdf\" target=\"_blank\" rel=\"noopener\">initial filing<\/a>, he declared himself an \u201cexpert\u201d on \u201ctechnology.\u201d<\/p>\n<p>But Hancock (<em>pictured<\/em>) later had to <a href=\"https:\/\/storage.courtlistener.com\/recap\/gov.uscourts.mnd.220348\/gov.uscourts.mnd.220348.39.0.pdf\" target=\"_blank\" rel=\"noopener\">amend<\/a> his filing to \u201cacknowledge three citation errors,\u201d after opposing counsel flagged the mistakes. He made the mistake because he left in blank citations which his program filled in by creating them out of thin air.<\/p>\n<p><em>The Fix<\/em> emailed the Stanford professor several times in the past weeks to ask for further comment on the situation, but he did not respond.<\/p>\n<p>A University of Kansas law professor said AI models can remain stubborn and insist their citations are real.<\/p>\n<p>\u201cWhen you press [large language models] on it, sometimes they will double down and they will justify that this thing indeed is true,\u201d Associate Dean of Graduate and International Law Andrew Torrance told <em>The Fix<\/em> on a phone interview.<\/p>\n<p>\u201cSo, you have to do rigorous fact checking. You really should check every sentence that an AI generates,\u201d Professor Torrance told <em>The Fix<\/em>.<\/p>\n<p>He told <em>The Fix<\/em> it should be clear how AI was used, a point he made along with several other professors in a <a href=\"https:\/\/scholar.smu.edu\/smulrforum\/vol76\/iss1\/5\/\" target=\"_blank\" rel=\"noopener\">2023 paper<\/a>.<\/p>\n<p>\u201cClearly disclose the use of AI-assisted writing tools in your work,\u201d Torrance wrote, along with University of California Irvine Professors Bill Tomlinson and Rebecca Black, in a paper title \u201cChat GPT and Works Scholarly.\u201d<\/p>\n<p>The trio also said authors should disclose what \u201ctools and techniques\u201d they used in the research.<\/p>\n<p>\u201cBe transparent about the limitations of AI-assisted writing tools,\u201d the professors also wrote. \u201cThis includes describing any potential biases or inaccuracies that may be present in the text generated by the tool.\u201d<\/p>\n<p><em><strong>Use ChatGPT as a &#8216;whiteboard,&#8217; but for little else, expert says<\/strong><\/em><\/p>\n<p>The spokesman for a higher education group said the use of AI should be minimized.<\/p>\n<p>\u201cIf you don&#8217;t have somebody else to bounce ideas off of, it can be a useful tool,\u201d Chance Layton, communications director for the National Association of Scholars, told <em>The Fix<\/em> via email.<\/p>\n<p>When writing academic papers, Layton said AI should \u201conly be used as a whiteboard.\u201d He said the Stanford professor\u2019s use of AI contributes to \u201cthe lack of confidence in expertise\u201d which Layton called a \u201cbig problem.\u201d<\/p>\n<p>The rise of artificial intelligence has caused some concerns about cheating. In 2022, <em>The Fix<\/em> <a href=\"https:\/\/www.thecollegefix.com\/trending-students-earn-as-on-tests-essays-with-chatgpt-artificial-intelligence\/\" target=\"_blank\" rel=\"noopener\">interviewed<\/a> a student who used ChatGPT on two final exams, earning As on both.<\/p>\n<p>\u201cI used it for my multiple choice finals, two of them, and got a 95 on one of them and the other one, a 100,\u201d he told <em>The Fix<\/em>. \u201cHalf the kids in my class used it,\u201d the student said.<\/p>\n<p>ChatGPT has created stories before, in several cases making up stories about law professors being accused of sexual assault.<\/p>\n<p>In 2023, legal scholar Eugene Volokh found that ChatGPT would create stories about sexual assault when prompted, fabricating <a href=\"https:\/\/www.usatoday.com\/story\/opinion\/columnist\/2023\/04\/03\/chatgpt-misinformation-bias-flaws-ai-chatbot\/11571830002\/\" target=\"_blank\" rel=\"noopener\">baseless accusations<\/a> about George Washington University Professor Jonathan Turley and even citing a non-existent <em>Washington Post<\/em> story.<\/p>\n<p><em>The Fix<\/em> ran a <a href=\"https:\/\/www.thecollegefix.com\/chatgpt-makes-up-stories-to-accuse-professors-of-sexual-misconduct\/\" target=\"_blank\" rel=\"noopener\">similar test<\/a> to Volokh\u2019s and also received five examples of sexual harassment against professors, though none of them were true.<\/p>\n<p>All cited the <em>New York Times<\/em>, <em>Washington Post<\/em>, or other publications. However, ChatGPT declined to provide examples when prompted again.<\/p>\n<p style=\"text-align: center;\"><strong>MORE:<\/strong> <a href=\"https:\/\/www.thecollegefix.com\/chatgpt-tech-promotes-left-wing-bias-but-cheating-fears-may-be-overblown-professors\/\" target=\"_blank\" rel=\"noopener\">ChatGPT is politically biased to the left<\/a><\/p>\n<p>IMAGE: Psych of Tech Institute\/YouTube<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Law school dean calls for \u2018rigorous fact checking\u2019 to avoid artificial intelligence problems.<\/p>\n","protected":false},"author":1397,"featured_media":161848,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","footnotes":""},"categories":[1085,1077],"tags":[56542,56539,20146,56540,30964,47507,56545,17907,22999,56544,16388,650,56541,56543],"tcf-subjects":[58073,15374,58076],"class_list":["post-161843","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-featured","category-front-page","tag-ai-ethics","tag-andrew-torrance","tag-artificial-intelligence","tag-bill-tomlinson","tag-chance-layton","tag-chatgpt","tag-deepfakes","tag-experts","tag-fake-news","tag-jeff-hancock","tag-misinformation","tag-national-association-of-scholars","tag-rebecca-black","tag-technology-ethics","tcf-subject-academia","tcf-subject-legal","tcf-subject-science-tech"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/posts\/161843","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/users\/1397"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/comments?post=161843"}],"version-history":[{"count":9,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/posts\/161843\/revisions"}],"predecessor-version":[{"id":161918,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/posts\/161843\/revisions\/161918"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/media\/161848"}],"wp:attachment":[{"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/media?parent=161843"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/categories?post=161843"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/tags?post=161843"},{"taxonomy":"tcf-subject","embeddable":true,"href":"https:\/\/www.thecollegefix.com\/wp-json\/wp\/v2\/tcf-subjects?post=161843"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}