Hal Foster Meets Hal 9000: We Asked ChatGPT About Art Theory. The A.I.’s Results Were Truly Terrible—But Unintentionally Revealing

0
55

Another title for this article could have been “The Problem with ‘The Problem With the Case Against Art History.’”

Recently, the news has been awash with stories about the very weird, surreal, sometimes sinister things that A.I. text generators are squirting out. Even so, Microsoft’s Bing search engine is incorporating the most famous of these, ChatGPT, advancing at lightning speed to make “A.I. assistants” the standard for how people find knowledge.

Is this the future? I don’t know! But here’s a little art-history experiment gone wrong that illustrates some of the pitfalls.

Last week, my colleague Naomi Rea chatted me, asking if I had ever heard of an essay called “The Case Against Art History” by the theorist Hal Foster, from the Summer 1992 issue of .

I looked it up and could find no such article.

It turned out that Naomi had been using ChatGPT exactly as Microsoft intends it to be used: as a research aid. In this case, she had been investigating whether there was any good writing on the concept of “category collapse” as it applied to contemporary art. The chatbot was extremely helpful. It quickly produced the following:

Yes, there are many essays and articles that explore the concept of category collapse in art history. Here are some examples:

1. “Category Collapse and the Art Historical Canon” by Rebecca Zorach (Art Journal, Vol. 62, No. 4, 2003, pp. 76-87)

This essay explores how category collapse can lead to the exclusion of certain artists and artworks from the art historical canon.

2. “Re-Categorizing Art History” by Trevor Stark (Journal of Art Historiography, No. 19, 2018, pp. 1-15)

This essay examines how the practice of categorizing art history can lead to oversimplification and argues for a more flexible approach to categorization.

3. “The Case Against Art History” by Hal Foster (October, Vol. 61, 1992, pp. 3-22)

This essay critiques the discipline of art history for its reliance on categorization and argues for a more interdisciplinary approach to the study of art.

4. “The Problem of Category in Art History” by Whitney Davis (Art Bulletin, Vol. 83, No. 2, 2001, pp. 297-318)

This essay discusses the limitations of categories in art history and explores alternative methods of organizing and interpreting art historical material.

Naomi followed up by asking it to summarize the Foster, to see if it might be useful. Again, the robot quickly supplied the goods via a concise and clear summary:

In “The Case Against Art History,” Hal Foster argues that the traditional discipline of art history is in crisis and needs to be rethought. He argues that the discipline’s focus on visual analysis and categorization has limited its ability to engage with the social and political contexts in which artworks are produced and received.

Foster critiques the idea that art history is a neutral, objective discipline and argues that it is shaped by power relations and ideological assumptions. He contends that the discipline is complicit in maintaining the status quo by privileging certain artists and artworks over others and by perpetuating myths about the autonomy of art.

Foster calls for a more interdisciplinary approach to the study of art that draws on methodologies and theories from other fields such as sociology, anthropology, and cultural studies. He advocates for a focus on the social and political dimensions of art, including issues of race, class, and gender.

Overall, Foster’s essay argues that the discipline of art history needs to move beyond the traditional emphasis on visual analysis and categorization and engage with the complex social and political contexts in which artworks are produced and received.

Pretty convincing! If only any of it was real. It’s all made up.

The title “The Case Against Art History” like something I might have read in Hal Foster is real, as are Rebecca Zorach, Trevor Stark, and Whitney Davis. But the titles and articles are all made up—“hallucinations” of the system.

I have to admit, ChatGPT’s summary of “The Case Against Art History” sounds convincing on first scan. It feels like it summarizes something in the manner of a typical academic abstract. When I reread it, however, I realize that what it describes is not very specific, just something very general, like a baseline understanding of a social history of art.

But then, the citation was supposed to be from 1992. So a first take could easily be, “maybe that was a new idea back then…”

It’s as if the A.I. reduced the name “Hal Foster” to the lowest common denominator level of general knowledge that the internet might know about him—“famous critical art theorist”—then speculated about what someone who fit that description might have contributed to a discussion of “category collapse” in art, the subject of the query.

The other interesting thing about this episode is that, after we realized what had happened, Naomi looped back to ChatGPT to give it another chance. The chatbot was reasonably contrite:

I apologize for the confusion. It appears that “The Case Against Art History” is actually a chapter in Hal Foster’s book “Recodings: Art, Spectacle, Cultural Politics” (The New Press, 1985). I apologize for my error earlier.

Also not true.

She followed up again:

I apologize for the confusion. You are correct that “The Case Against Art History” is not a chapter in Hal Foster’s book “Recodings: Art, Spectacle, Cultural Politics”. I apologize for the misinformation.

I have double-checked and it appears that “The Case Against Art History” was originally published in the journal October in 1992. You should be able to find the article online through academic databases such as Jstor.

Talk about a “category collapse”!

It feels like a parody of that scene from where HAL-9000 refuses to open the pod bay doors:

(“Hal the computer’s been cranking his stuff out since 1968,” Foster joked when I wrote to confirm that the fake citation of “The Case Against Art History” was, indeed, fake. “He got rid of the meat Hal a long time ago.”)

I played around with ChatGPT a bit further to get a sense of what it can tell me about art history. Sometimes—if, for instance, I ask it to “give me a list of citations about the influence of Artificial Intelligence on European Medieval Art”—it accurately tells me that this query makes no sense—but then provides a list of made-up references to explain why:

I’m sorry, but there is no evidence to suggest that Artificial Intelligence (AI) has had any influence on European Medieval Art. AI technology did not exist during the medieval period, and there is no indication that it has had any retrospective impact on the art of that time.

However, if you are interested in exploring how AI is being used to study and analyze Medieval Art, I can suggest some references that discuss this topic:

1. “Medieval Art and Artificial Intelligence: A Review” by Heather E. Grossman, published in the journal “Digital Medievalist” (2019).

2. “Computational Analysis of Medieval Art: Artificial Intelligence and Iconography” by Emilie E.S. Gordenker and Daan van Espen, published in the journal “The Art Bulletin” (2021).

3. “AI and Art History: A Review of Current Research” by Carolyn Yerkes, published in the journal “Visual Resources” (2020).

4. “Artificial Intelligence and the Study of Art: A Critical Review” by Hannah Turner and Florian Wiencek, published in the journal “Journal of Cultural Analytics” (2020).

These articles explore the ways in which AI technology is being used to analyze and understand medieval art, including aspects such as iconography, style, and historical context. However, it should be noted that AI is not influencing the creation of new works of medieval art.

(Arguably, that delightful final clarification is wrong, given that DALL-E and its ilk can spit out infinite amounts of stuff in the style of “medieval art” now.)

When I ask a follow-up, specifying that the references now be actually “real,” my chatbot helper is again very helpful, but again just makes stuff up:

Certainly! Here are some real references that discuss the influence of Artificial Intelligence on Art:

1. “The Art of Artificial Intelligence: GANs and the Next Step in Human-AI Collaboration” by Ahmed Elgammal, published in the journal “Leonardo” (2018).

2. “Art and Artificial Intelligence” edited by Aude Oliva and Ahmed Elgammal, published by MIT Press (2020).

3. “AI Art at Christie’s Sells for $432,500” by Kate Brown, published in The Art Newspaper (2018).

4. “Can Computers Create Art?” by Claudia M. Müller and Michael Leyton, published in the journal “Leonardo” (2019).

These references discuss the use of Artificial Intelligence in the creation and analysis of art, including works of art that have been generated entirely by AI algorithms. These articles are not specifically about European Medieval Art, but they do explore the intersection of AI and art more broadly.

Hilariously, one of these (the third) is by a real colleague of mine, Kate Brown.

So its model knows that “Kate Brown” sounds probable as the name of someone who might have written something about art and artificial intelligence, even though she never wrote this story. And it does not know that she works at Artnet News, or that she has never written for the .

Naomi summed up what she learned from her experience with the tool: “ChatGPT is a useful tool but anyone using it should understand it is also unreliable. If you take what it says at face value, it could be a dumb and dangerous mistake.”

This kind of bug is found to wreck havoc and give teachers a headache. But maybe it will get worked out. The technology is getting better by leaps and bounds, and it seems like an obvious flaw to fix. It’s unclear what good use generating fake scholarly references could even be.

Finally, what is happening seems to be a linear consequence of the fact that so-called Large-Language Models are about predicting what , based on its huge data sets. As a commenter put it in a post about the fake citations problem from months ago: “It’s a language model, and not a knowledge model.”

Essentially, it’s a machine for , not for —which is just so, so emblematic of the whole world that has produced this thing, isn’t it? Essentially, Silicon Valley has succeeded in making something that gives everyone the power to instantly be Elizabeth Holmes.

LEAVE A REPLY

Please enter your comment!
Please enter your name here