Tech

Study explores the impact of LLMs on human creativity

Experimental framework for measuring the influence of AI use on Human creativity. Members interact in a collection of Publicity rounds the place they’re randomized to both obtain – (A) No help, (B) LLM resolution (commonplace): This could possibly be analogous to utilizing a chat LLM comparable to ChatGPT for the duty, or (C) LLM steering (coach-like): On this case, members obtain response from a personalized LLM which guides them via the artistic course of. Lastly, within the final spherical, all members are requested to do the identical artistic activity with none help as a Take a look at. (D) The efficiency and inventive outputs on this unassisted spherical are the first measures for evaluating the influence of utilizing LLMs on Human cognition. Credit: arXiv (2024). DOI: 10.48550/arxiv.2410.03703

Giant language fashions (LLMs), AI programs that may course of human language and generate new texts in response to written prompts, are actually extensively utilized by individuals worldwide to finish varied duties. These programs can be utilized to rapidly create varied texts for particular functions, together with work emails, experiences, lists, articles and essays, in addition to poems, tales, scripts and even track lyrics.

Some individuals use LLMs as a supply of inspiration or concepts, which they then adapt in their very own phrases, whereas others may select to straight use AI-generated texts with out altering them. Regardless of their total effectiveness as artistic instruments, their precise influence on human creativity remains to be poorly understood.

Researchers on the University of Toronto just lately got down to discover how the usage of LLMs throughout artistic duties impacts the creativity of human customers. Their findings, published on the arXiv preprint server, recommend that these fashions can impair the flexibility of people to suppose creatively, leading to much less different and revolutionary concepts.

“Generative AI instruments, comparable to ChatGPT, are more and more getting used for creative tasks, from writing emails to brainstorming concepts,” Harsh Kumar, co-author of the paper, advised Tech Xplore.

“However, there are growing concerns, which have not yet received sufficient attention, about the long-term impact of these tools on human creativity. We hypothesized that the repeated use of large language models (LLMs) might be impairing our ability to think creatively on our own, despite enhancing performance while the tool is in use—similar to the temporary boost provided by performance-enhancing steroids in sports.”

The important thing purpose of the current research by Kumar and his colleagues was to measure the residual results of LLM utilization on the creativity of human customers in an experimental setting. To do that, they carried out two experiments that centered on completely different elements of human creativity, generally known as divergent and convergent considering.

“The tasks for each experiment were adapted from established psychology literature,” defined Kumar. “In the divergent thinking experiment, participants were asked to generate alternative uses for a given object in each round, while in the convergent thinking experiment, they were presented with three words and tasked with finding a fourth word to connect them (for example, ‘book’ connects ‘shelf,’ ‘log,’ and ‘worm’).”

Each the primary and second experiment had been divided into two distinct phases: an publicity section and a take a look at section. In the course of the publicity section, members within the experimental situation acquired responses to particular questions utilizing GPT-4o, the extensively used conversational LLM developed by OpenAI.

Study explores the impact of LLMs on human creativity
Totally different Approaches to LLM Collaboration: On the left, people and LLM create collectively, mixing concepts; within the center, LLMs offers steering that people implement; on the precise, the human completes the duty independently, with out LLM help. Credit: Harsh Kumar et al

The responses acquired by GPT-4o had been particular to the duty at hand. For the divergent considering activity, GPT-4o supplied related lists of concepts, whereas for the convergent considering activity it generated a phrase that will join the three phrases supplied to the participant.

“We also explored the potential of the model to serve as a coach by providing a structured framework for thinking rather than directly offering solutions,” stated Kumar. “In the control condition, participants had no access to LLM assistance. During the test phase, all participants completed the tasks independently, enabling us to measure the residual effects of LLM use during the exposure rounds.”

The researchers discovered that throughout each experiments, the usage of GPT-4o had improved the efficiency of members in the course of the publicity section. Apparently, nevertheless, members who didn’t initially use GPT-4o had been discovered to outperform members who had entry to the mannequin in the course of the take a look at section.

“This suggests that designers of LLM-based creativity tools, as well as developers of LLMs, should consider not only the immediate benefits of LLM use but also the potential long-term impact on users’ cognitive abilities,” stated Kumar. “Otherwise, these tools may inadvertently contribute to cognitive decline over time. We also observed, consistent with existing literature, that using LLM-generated ideas during exposure can lead to a homogenization of ideas within a group.”

The researchers had been additionally shocked to seek out that the beforehand reported homogenization impact (i.e., the reported tendency of LLM customers to give you much less numerous concepts over time) persevered even after members had stopped utilizing GPT-4o. This persistent impact was discovered to be significantly accentuated when the mannequin provided them a basic structured framework designed to information their considering in the course of the publicity section of the experiments.

General, the findings collected by Kumar and his colleagues supply some invaluable perception that might information future efforts geared toward creating LLMs and AI-powered artistic instruments. The group has to date carried out its experiments in a managed laboratory setting, the place members had been solely uncovered to GPT-4o for a restricted time, but they quickly plan to hold out extra research in additional life like eventualities.

“Real-world contexts are more complex and involve prolonged exposure periods,” added Kumar. “To handle this, we plan to conduct area experiments with extra pure duties, comparable to writing a artistic story.

“Additionally, we believe that the issue of idea homogenization is significant and carries long-term negative implications for culture and society. As a next step, we intend to explore the design of LLM agents that can mitigate the homogenization of ideas.”

Extra info:
Harsh Kumar et al, Human Creativity within the Age of LLMs: Randomized Experiments on Divergent and Convergent Pondering, arXiv (2024). DOI: 10.48550/arxiv.2410.03703

Journal info:
arXiv


© 2024 Science X Community

Quotation:
Examine explores the influence of LLMs on human creativity (2024, October 30)
retrieved 30 October 2024
from https://techxplore.com/information/2024-10-explores-impact-llms-human-creativity.html

This doc is topic to copyright. Other than any truthful dealing for the aim of personal research or analysis, no
half could also be reproduced with out the written permission. The content material is supplied for info functions solely.



Click Here To Join Our Telegram Channel


Source link

When you’ve got any considerations or complaints relating to this text, please tell us and the article will likely be eliminated quickly. 

Raise A Concern

Show More

Related Articles

Back to top button