Handling Uncertainty in AI (Artificial Intelligence)

What is Uncertainty?

Uncertainty refers to a lack of complete knowledge about an outcome or situation.

What is Handling Uncertainty in AI?

Handling uncertainty in AI refers to the ability of artificial intelligence systems to make decisions in situations where there is uncertainty.

Key aspects to consider when dealing with uncertainty in AI

Probabilistic Models: AI systems can incorporate probabilistic models to represent uncertainty. Instead of providing a single, deterministic answer, these models assign probabilities to different outcomes.
Uncertainty Quantification: AI systems should be capable of quantifying uncertainty. This involves estimating the likelihood of different outcomes or the confidence level associated with a particular decision.
Continuous Learning and Adaptation: AI systems should be able to adapt and improve over time by continuously learning from new data. This adaptive learning process can help AI models better cope with changing environments and evolving uncertainties.

Non-Monotonic Reasoning in AI

Non-monotonic reasoning in AI is a form of logic that allows for conclusions to be changed as new information becomes available.
Unlike classical logic, where conclusions remain fixed.

let's understand with an example:

So let's assume you prompt ChatGPT that "birds can fly."
Based on this information, the ChatGPT concludes that "penguins can fly" because penguins are birds.
However, if you later prompt the ChatGPT that "some birds cannot fly" (which is true for penguins), it should be able to update its knowledge and correct its earlier conclusion.

Probabilistic Reasoning in AI

Probabilistic reasoning in AI involves using probability theory to make decisions and draw conclusions based on uncertain or incomplete information.
It's a way for AI systems to handle uncertainty and make educated guesses rather than giving definitive answers.

For Example:

Let's say you have an AI weather app that uses probabilistic reasoning.

When you check the app, it doesn't just give you a single weather forecast (e.g., "It will rain today"). Instead, it provides a probability-based forecast like this:

"There's a 70% chance of rain today."
"There's a 30% chance of sunshine."

Features of Probabilistic Reasoning

Assigning Probabilities

AI assigns probabilities to different possible outcomes or events. These probabilities indicate how likely each outcome is.

Quantifying Uncertainty

Instead of making binary (yes/no) decisions, AI acknowledges and quantifies uncertainty by expressing probabilities.
For instance, it might say, "There's an 80% chance it's true," indicating the level of confidence in an outcome.

Bayesian Inference

Bayesian probability theory is a common framework used in probabilistic reasoning. It involves updating probabilities as new evidence becomes available.
For example, if a medical test is 90% accurate and yields a positive result, Bayesian reasoning allows for adjusting the probability of having a disease based on this new information.

Decision Making

AI systems use these probabilities to make decisions that aim to maximize expected outcomes or utility.
For example, in autonomous vehicles, probabilistic reasoning helps determine how fast to drive based on the likelihood of encountering obstacles ahead.

Risk Assessment

Probabilistic reasoning is valuable for assessing and managing risks.
It can be applied in financial modeling to estimate the level of risk associated with different investment options.
This allows decision-makers to make more informed choices in situations involving uncertainty.

Bayes Theorem in AI

Bayes' Theorem, named after the 18th-century mathematician Thomas Bayes, stands as a foundational principle in probability theory.
Bayes' Theorem, also known as Bayes' Rule or Bayes' Law, is a fundamental concept in AI and probability theory.
It's used to update probabilities based on new evidence, making it a crucial tool for reasoning under uncertainty.

In AI, Bayes' Theorem is often applied in various areas, including:

Machine Learning: In machine learning, it's used for Bayesian inference and probabilistic modeling. For instance, it's employed in Bayesian networks, which are graphical models that represent probabilistic relationships among variables.
Natural Language Processing: Bayes' Theorem can be used in text classification tasks, such as spam detection, sentiment analysis, and language modeling.
Medical Diagnosis: Bayes' Theorem helps doctors update the probability of a patient having a disease based on the results of medical tests and the patient's symptoms.
Autonomous Systems: In autonomous systems like self-driving cars, Bayes' Theorem is used for sensor fusion and decision-making under uncertainty.
Recommendation Systems: It can be applied in recommendation engines to improve the accuracy of personalized recommendations by updating user preferences based on their interactions and feedback.

Certainty Factors in AI

Certainty factors are used in AI to represent and reason about the degree of certainty or belief in a particular statement.
They are typically expressed as values between -1 (completely false) and +1 (completely true), with 0 indicating uncertainty.
Example: In a medical diagnosis system, if the symptom "fever" has a certainty factor of +0.7, it indicates a high degree of belief that the patient has a fever based on observed symptoms. Conversely, a certainty factor of -0.7 would imply a belief that the patient does not have a fever.

Rule-Based Systems in AI

Rule-based systems use a set of conditional rules to make decisions or draw conclusions.
These rules consist of conditions and corresponding actions.
The system evaluates conditions and triggers actions based on the conditions that are satisfied.

Example: In a weather forecasting system, a rule might be: If the sky is cloudy and the temperature is below 10°C, then predict rain.

The system checks the conditions (cloudy sky and low temperature) and triggers the action (predicting rain) if both conditions are met.

Bayesian Networks in AI

Bayesian networks are graphical models used for representing and reasoning about probabilistic relationships among variables.
They consist of nodes (representing variables) and directed edges (representing probabilistic dependencies).
They use Bayes' Theorem to update probabilities as new evidence becomes available.

Example: In a fraud detection system, a Bayesian network can model the relationships between various factors like transaction history, location, and purchase patterns. As new data arrives, the network can update the probability of a transaction being fraudulent.

Dempster-Shafer Theory (DS Theory) in AI

The Dempster-Shafer Theory is a mathematical framework for reasoning under uncertainty, especially when dealing with conflicting evidence.
It extends traditional probability theory by allowing for the representation of uncertainty in a more flexible manner.
Example: In a sensor fusion system for autonomous vehicles, the DS Theory can be used to combine information from multiple sensors (e.g., cameras, LiDAR, radar).
When different sensors provide conflicting data about the presence of an obstacle, DS Theory can help combine this evidence to make a more robust decision about whether an obstacle is present or not.

Conclusion

Probabilistic reasoning, non-monotonic reasoning, and certainty factors provide tools to navigate uncertainty, adapt to changing information, and quantify degrees of belief.

Table of contents