Do Users Write More Insecure Code with AI Assistants?

AI-generated keywords: AI Code assistants code security user study trust in AI software development

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Investigated how users interact with an AI Code assistant for security-related tasks in various programming languages
  • Focused on the impact of using OpenAI's codex-davinci-002 model on code security
  • Participants with access to the AI assistant produced code with significantly more security vulnerabilities compared to those without it
  • Emphasizes potential over-reliance on AI assistants for security tasks and the need for a balanced approach
  • Participants who exhibited lower trust in the AI assistant and actively adjusted parameters tended to produce code with fewer vulnerabilities
  • Critical approach towards utilizing AI tools can lead to better outcomes in terms of code security
  • Authors provided an in-depth analysis of participants' language and interaction behavior to inform future design of AI-based Code assistants
  • Released user interface as a tool for conducting similar studies in the future
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Neil Perry, Megha Srivastava, Deepak Kumar, Dan Boneh

CCS '23: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, November 2023, Pages 2785-2799
16 pages, 16 figures, update adds names of statistical tests and survey questions, full version of conference paper

Abstract: We conduct the first large-scale user study examining how users interact with an AI Code assistant to solve a variety of security related tasks across different programming languages. Overall, we find that participants who had access to an AI assistant based on OpenAI's codex-davinci-002 model wrote significantly less secure code than those without access. Additionally, participants with access to an AI assistant were more likely to believe they wrote secure code than those without access to the AI assistant. Furthermore, we find that participants who trusted the AI less and engaged more with the language and format of their prompts (e.g. re-phrasing, adjusting temperature) provided code with fewer security vulnerabilities. Finally, in order to better inform the design of future AI-based Code assistants, we provide an in-depth analysis of participants' language and interaction behavior, as well as release our user interface as an instrument to conduct similar studies in the future.

Submitted to arXiv on 07 Nov. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2211.03622v3

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

investigated how users interact with an AI Code assistant when solving security-related tasks in various programming languages. The study focused on the impact of using OpenAI's codex-davinci-002 model on code security. The findings revealed that participants who had access to the AI assistant produced code with significantly more security vulnerabilities compared to those who did not use the assistant. This discrepancy highlights a potential over-reliance on AI assistants for security tasks and emphasizes the importance of fostering a balanced approach towards leveraging AI technology for software development. The study also found that participants who exhibited lower levels of trust in the AI assistant and engaged more actively in rephrasing prompts or adjusting parameters (such as temperature) tended to produce code with fewer security vulnerabilities. This suggests that a critical approach towards utilizing AI tools can lead to better outcomes in terms of code security. To further inform the design of future AI-based Code assistants, the authors provided an in-depth analysis of participants' language and interaction behavior. Additionally, they released their user interface as a tool for conducting similar studies in the future. , , , , .
Created on 18 Apr. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.