Scenario: Firing Decisions Taken by Bots

[CatTruxillo]

This is a discussion forum for the activities in the Human Centricity module of the Free SAS e-learning course, Responsible Innovation and Trustworthy AI.

Scenario: Firing Decisions Taken by Bots

Consider This: 

What can be done to make the system more human centric?

How could a rating system accommodate circumstances beyond a driver’s reasonable control?

Please share your ideas in this discussion. 

[brob06dur]

We can add a human in the loop, prior to making any punitive actions. 

[rshaikh2003]

na

[sunilbhardwaj]

Analytical Methods: 

1. Instead of a single low rating leading to deactivation, consider a weighted average over time.

2. Peer to Peer rating comparison, in case of a tornado, everybody must have received low rating

Human Intervention:

1. Right to appeal or a feature for providing contextual information by the user for  low rating in case of uncontrollable factors.

Automated Decision Making Deactivation:

In the times of crises, humans should take over decisioning rather than an automated system which do not consider natural calamity or a weather disruption as a factor.

[VernonHunte]

• Automated Adjustments for Known Extreme Weather

  • The system should integrate real-time weather data and automatically adjust performance metrics when severe weather events (e.g., tornado warnings, storms, floods) are detected.
  • If an area is impacted by a weather event, all delivery ratings in that region should be flagged for review or automatically adjusted.

• Cross-Referencing Other Drivers’ Data

  • If multiple drivers in the same region experience similar delays or incomplete deliveries, the system should recognize that as an external factor rather than an individual failure.
  • This could be achieved using AI-driven anomaly detection to identify patterns and prevent unfair penalties.

[izumi_sas]

At the beginning, there were huge potential problems in this bot created based on only employee’s behavior, lack of perspective of work environment which should affect on working performance. This came from some biases, then this bot originally could not replace the employee management task by human. So there should be human interaction during using this incomplete bot at this moment.

[jomana-khatib]

This is a reality many drivers face every day. It’s why we need systems that are not only efficient but fair, flexible, and human-centric.

A human-centric rating system should:

• Recognize factors beyond a person’s control, like severe weather or traffic delays.

• Include ways for individuals to provide context and appeal unfair ratings.

• Prioritize safety and effort, not just raw numbers.

• Be transparent about how scores are calculated.

• Treat people as people—not just data points.

Technology should support us, not judge us unfairly. A human centric rating system recognizes that life is unpredictable. It builds in fairness, context, and the ability to respond to exceptions ensuring that drivers are treated with dignity and respect, even when the unexpected happens