None
EN
Science journalists find ChatGPT is bad at summarizing scientific papers
[]
Damn Interesting Curated Links
Summarizing complex scientific findings for a non-expert audience is one of the most important things a science journalist does from day to day.
"These technologies may have potential as helpful tools for science writers, but they are not ready for 'prime time,' at this point for the SciPak team," AAAS writer Abigail Eisenstadt said.
From December 2023 to December 2024, AAAS researchers selected up to two papers per week for ChatGPT to summarize using three different prompts of varying specificity.
The team focused on papers with difficult elements like technical jargon, controversial insights, groundbreaking discoveries, human subjects, or non-traditional formats.
In total, 64 papers were summarized, and those summaries were evaluated both quantitatively and qualitatively by the same SciPak writers who had briefed those papers for the AAAS.
['scientific'
'scipak'
'summarizing'
'writers'
'aaas'
'team'
'journalists'
'papers'
'science'
'human'
'summaries'
'chatgpt'
'bad']