topic Re: Discussion: Why Robustness is Key to Deploying AI in Trustworthy AI

Discussion: Why Robustness is Key to Deploying AI

CatTruxillo — Tue, 19 Mar 2024 19:57:21 GMT

This is a discussion forum for the activities in the Robustness module of the Free SAS e-learning course, Responsible Innovation and Trustworthy AI.

Discussion: Why Robustness is Key to Deploying AI

Consider This:

What is one way that a changing environment can impact the accuracy of machine learning predictions?

What are two ways to improve robustness in a dynamic environment?

Please share your ideas in this discussion.

Re: Discussion: Why Robustness is Key to Deploying AI

DavidGould — Fri, 03 Jan 2025 19:30:13 GMT

Environment degradation will be a cause for model drift. When changes occur quickly, or fluctuate dramatically, models may be completely maladapted, producing costly harms.
Environmental intensities can produce conditions in which systems fail, which may produce domino effects.
In the scenario of cyber-environment circumstances, models may be manipulated or altered to become covertly counterproductive.

Re: Discussion: Why Robustness is Key to Deploying AI

CarlosBarrera — Mon, 03 Feb 2025 17:10:04 GMT

A changing environment cause that data valid to train a model (for example) is not valid anymore, impacting the accuracy of ML predictions. Example: COVID-19 changed consuming behaviors. Buying predicting models were not valid anymore in that context.
Improving robustness though monitoring and human in the loop oversight

Re: Discussion: Why Robustness is Key to Deploying AI

VernonHunte — Fri, 14 Mar 2025 13:14:54 GMT

Good article by Jacob Steinhardt and Helen Toner esp. the the distinction between high-stakes and lower-stakes machine learning models in terms of robustness. The contrast between continuously updating models in areas like speech recognition and the more complex challenges of fairness and accountability in judicial algorithms highlights the importance of careful design and oversight.

Re: Discussion: Why Robustness is Key to Deploying AI

FRCARO — Mon, 21 Jul 2025 16:00:31 GMT

Q1. What is one way that a changing environment can impact the accuracy of machine learning predictions?

A1. When it is possible to ensure data continuity in the environment that fuels machine learning

Q2. What are two ways to improve robustness in a dynamic environment?

A2.a Human supervision
A2.b TEAM with heterogeneous people who supervise Model decisions

Re: Discussion: Why Robustness is Key to Deploying AI

jomana-khatib — Fri, 01 Aug 2025 13:06:18 GMT

1. One way that a changing environment can impact the accuracy of machine learning predictions:
A changing environment can cause data drift, where the patterns in the data used to train the model no longer match real-world data. This leads to reduced prediction accuracy because the model’s assumptions become outdated.

2. Two ways to improve robustness in a dynamic environment:

Continuous model monitoring and retraining: Regularly update the model with new data to adapt to changes and maintain accuracy.
Implement fallback systems or human-in-the-loop approaches: These allow for oversight or manual intervention when the model encounters unfamiliar or high-risk situations.