Stand-up comedians test ability of LLMs to write jokes

Credit: AI-generated picture

A small crew of AI researchers at Google’s DeepMind mission has discovered that LLMs should not superb at writing jokes which might be humorous. They requested stand-up comedians to make use of LLMs to put in writing a stand-up routine for them and posted their findings on the arXiv preprint server.

To achieve success, most stand-up comedians have to put in writing a stand-up routine and carry out it on stage. Such routines, or monologs, usually contain each storytelling and jokes, or describe humorous conditions. Many additionally make use of stunning or incongruous remarks, giving the viewers a sudden perception into one thing they might not have thought of in a sure means earlier than.

{Most professional} stand-up comedians spend a substantial amount of time sharpening their routines and testing them on small audiences earlier than performing in entrance of huge crowds or on tv specials.

On this new effort, the crew at DeepMind questioned if LLMs may be able to creating not simply jokes, however total stand-up routines. To search out out, they recruited 20 skilled stand-up comedians who had used LLMs of their work earlier than. The performers used an LLM to assist them write a complete routine after which rated the outcomes.

The researchers discovered that LLMs have been fairly good at developing with jokes; sadly, few if any have been humorous. Most, they recommended, have been generic in nature and few supplied something in the best way of a shock.

Stand-up comedians test ability of LLMs to write jokes
Left: Analysis of the instruction-tuned LLMs as creativity help instrument for writing comedy utilizing a Likert scale; every row corresponds to a query in a survey. Proper field plots (field for quartiles and whiskers for min and max) present the break-down of the Creativity Help Index, respectively. Credit: arXiv (2024). DOI: 10.48550/arxiv.2405.20956

Total, the comedians discovered the AI-generated jokes to lack the innovative that’s usually wanted for a joke to be humorous. Many described the outcomes as bland. However a few of them did discover the LLM to be helpful in producing a routine that may very well be used for making a fundamental construction round which they might construct their very own jokes.

The analysis crew suggests the outcomes weren’t stunning contemplating that makers of LLMs use filters to forestall them from producing output that may very well be offensive or edgy.

Extra data:
Piotr Wojciech Mirowski et al, A Robotic Walks right into a Bar: Can Language Fashions Function Creativity Help Instruments for Comedy? An Analysis of LLMs’ Humour Alignment with Comedians, arXiv (2024). DOI: 10.48550/arxiv.2405.20956

Journal data:

© 2024 Science X Community

Stand-up comedians check skill of LLMs to put in writing jokes (2024, June 21)
retrieved 21 June 2024

This doc is topic to copyright. Aside from any honest dealing for the aim of personal examine or analysis, no
half could also be reproduced with out the written permission. The content material is offered for data functions solely.

Click Here To Join Our Telegram Channel

Source link

You probably have any issues or complaints relating to this text, please tell us and the article will likely be eliminated quickly. 

Raise A Concern

Show More

Related Articles

Back to top button