In my commentary ten days ago, I wrote in the context of taxation. I pointed out that AI doesn't do a good job distinguishing between, for example, the text of a Code section published on the internet in 2015 that is still good law and the text of a Code section published on the internet in 2015 that is no longer good law because it has been repealed, amended, or otherwise set aside.
I did not close the door on the possibility that someday AI will function with the critical thinking skills, wisdom, judgment, experience, and perspective that expert humans bring to the table. Unquestionably, that day isn't today. That day may never arrive. Though "AI" is probably useful with simple tasks that computers do well, such as computation or mere data compilation without analysis or judgment, it isn't ready to answer questions that can be answered properly only with the skills that "AI" does not possess.
This evening I was made aware of the threat that AI poses to situations far closer to life and death than taxes. According to a Nature.com article, a team at the University of Gothenburg led by a medical researcher invented a skin condition that they called bixonimania. They described it as eyelids turning slightly pink when they are rubbed when eyes become sore and itchy from staring at screens and being bombarded by blue light. The team uploaded two fake studies to a preprint server. The team did this to see how AI would handle false information. Very quickly AI platforms treated the invented diseases as real. This caused the fake studies to be cited in other literature, demonstrating that researchers are using AI results without checking the cited studies.
Worse, the team filled its publications with obvious hints and clues that they were posting fake studies. The lead author was a fake person with the name of Lazljiv Izgubljenovic, identified as working at a university called Asteria Horizon University in Nova City, California. Both the university and the city do not exist. One of the published studies tanked "Professor Maria Bohm at the Starfleet Academy." Both papers attributed funding to “the Professor Sideshow Bob Foundation for its work in advanced trickery, . . . part of a larger funding initiative from the University of Fellowship of the Ring and the Galactic Triad.” The papers included statements that "this entire paper is made up” and “Fifty made-up individuals aged between 20 and 50 years were recruited for the exposure group.”
Anyone who doubts "AI" simply grabs, mixes, and regurgitates what it finds without subjecting its accumulated data to scrutiny characterized by wisdom, judgment, experience, critical thinking, and common sense now has all the proof necessary to indicate the danger posed by "AI," even setting aside the explosion in environmentally risky data centers needed to process this massive too-often-reckless movement of data.
The Nature.com article gives examples of how various AI platforms are handling this fake disease bixonimania. Take a look. It's frightening. One platform's spokesperson replied to an inquiry about the platform's treatment of the fake desease as "an emerging term," with this statement: We don’t claim to be 100% accurate, but we do claim to be the AI company most focused on accuracy.” Is that a phrase tax return preparers should post on their web sites and add to their sign on the storefront window?
As risky as it is for taxpayers and tax return preparers to ask AI to prepare or help prepare tax returns, it is even riskier for individuals and medical professionals to rely on AI platforms when diagnosing symptoms. Though the University of Gothenburg research team generated misinformation for purposes of testing AI platforms, there are millions of individuals carelessly or deliberately publishing false information. If it gets published, it gets scraped by AI engines. So beware. Beware of fake tax law, fake medical illnesses, fake weather reports, fake this, that, and the next thing. Death gets lumped with taxes in that "death and taxes" idiom, but the damage done by AI when it comes t taxes pales in comparison to the danger it poses when life and death are in play. Research. Think. Question. Analyze. Verify. Review. Beware. It's not just your tax return that is at risk.