ChatGPT is fun, but it is not funny! Humor is still challenging Large Language Models

AI-generated keywords: Humor Artificial Agents Language Models Joke Generation Understanding

AI-generated Key Points

  • Humor is a complex aspect of human communication that is not fully understood by artificial agents
  • Large language models like OpenAI's ChatGPT can capture implicit and contextual information, leading some to wonder if they can tell jokes on a human level
  • Researchers conducted experiments around joke generation, explanation, and detection to test this hypothesis
  • ChatGPT accurately explained valid jokes but came up with fictional explanations for invalid ones in the joke generation task
  • Certain characteristics commonly found in jokes (structure, topic, and wordplay) were central to ChatGPT's conception of humor but could also mislead it in classifying jokes
  • ChatGPT represents a significant step towards creating "funny" machines, but more research is needed to fully understand how artificial agents comprehend and generate humor compared to humans.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Sophie Jentzsch, Kristian Kersting

License: CC BY 4.0

Abstract: Humor is a central aspect of human communication that has not been solved for artificial agents so far. Large language models (LLMs) are increasingly able to capture implicit and contextual information. Especially, OpenAI's ChatGPT recently gained immense public attention. The GPT3-based model almost seems to communicate on a human level and can even tell jokes. Humor is an essential component of human communication. But is ChatGPT really funny? We put ChatGPT's sense of humor to the test. In a series of exploratory experiments around jokes, i.e., generation, explanation, and detection, we seek to understand ChatGPT's capability to grasp and reproduce human humor. Since the model itself is not accessible, we applied prompt-based experiments. Our empirical evidence indicates that jokes are not hard-coded but mostly also not newly generated by the model. Over 90% of 1008 generated jokes were the same 25 Jokes. The system accurately explains valid jokes but also comes up with fictional explanations for invalid jokes. Joke-typical characteristics can mislead ChatGPT in the classification of jokes. ChatGPT has not solved computational humor yet but it can be a big leap toward "funny" machines.

Submitted to arXiv on 07 Jun. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2306.04563v1

Humor is a complex aspect of human communication that has yet to be fully understood and replicated by artificial agents. Despite this, large language models (LLMs) such as OpenAI's ChatGPT have gained attention for their ability to capture implicit and contextual information, leading some to wonder if they can also tell jokes on a human level. To test this hypothesis, researchers conducted a series of exploratory experiments around joke generation, explanation, and detection. In the joke generation task, ChatGPT was tasked with generating valid jokes. However, this alone does not necessarily reflect the system's ability to understand humor from a human perspective. The results showed that while ChatGPT accurately explained valid jokes, it also came up with fictional explanations for invalid ones. To examine how closely ChatGPT's understanding of humor is connected to certain characteristics commonly found in jokes, researchers manually modified the top 25 jokes to eliminate one or multiple criteria: structure, topic, and wordplay. The results revealed that these criteria were central characteristics for ChatGPT's conception of humor but could also mislead it in classifying jokes. Overall, while ChatGPT has not yet solved computational humor entirely, it represents a significant step towards creating "funny" machines. However, more research is needed to fully understand how artificial agents comprehend and generate humor compared to humans.
Created on 09 Jun. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.