Episode Summary
Drew and David scrutinize ChatGPT’s ability to deliver safety recommendations, questioning the fairness of expectations placed on the AI and considering appropriate benchmarks for its performance. Their analysis is shaped by the framework of the article, “The Risks of Using ChatGPT to Obtain Common Safety-Related Information and Advice” from the Journal of Safety Science from November 2023.
Episode Notes
From discussing mobile phone use while driving to the challenges of giving advice to older adults at risk of falls, this episode covers ChatGPT’s responses to a wide range of safety topics – identifying biases, inconsistencies, and areas where ChatGPT aligns or falls short of expert advice. The broader implications of relying on ChatGPT for safety advice are examined carefully, especially in workplace settings. While ChatGPT often mirrors general lay understanding, it can overlook critical organizational responsibilities, potentially leading to oversimplified or erroneous advice. This episode underscores the importance of using AI-generated content cautiously, particularly in crafting workplace policies or addressing complex safety topics. By engaging with multiple evidence-based sources and consulting experts, organizations can better navigate the limitations of AI tools.
Discussion Points:
- Drew and David discuss their own recent experience with generative AI
- The multiple 15 authors are all experts, discussing the methods used
- Examining the nine different question scenarios
- ‘Mobile phone use while driving’ results
- Crowd/crush safety advice
- Advice for preventing falls in older adults
- Analyzing ChatGPT response formats
- Exercising outdoors near traffic with asthma
- Questioning ChatGPT about how to engage a distressed person who may commit suicide
- Safety working ‘under high pressure’ and job demands, burnout prevention
- Lack of nuance in ChatGPT
- The safety of sharing personal data on fitness apps, how can it be shared safely?
- Is it safe to operate heavy machinery when fatigued? Testing several ways to ask this question – sleepy, tired, fatigued
Takeaways:
- The answer to our episode’s question: “AI is not currently a suitable source for writing safety guidelines or advice”
Resources:
The Article – The Risks Of Using ChatGPT to Obtain Common Safety-Related Information and Advice
DisasterCast Episode 54: Stadium Disasters