The key element is how to represent states and transitions between them.
Representations vary in their expressiveness:
- More expressive representations can capture anything a less expressive one can
- More expressive representations are often more concise
- …but reasoning is more complex as the expressiveness increases
- Atomic: each state is indivisible
- Factored: each state as a set of variables or attributes, with values
- Structured: describes relationship between elements of the model, as well as their values
Formulation of Agent Problems