In a discussion Oct-27, 2010 introduced Vassili Hiller and Marcus Pfaff the idea to solve the problem of feedback by looking to the sequence of actions as that compound unit which leads from a 'start' to a 'goal'. In that case all actions between start and goal have to be 'weighted'. Translating this idea into the context of our model world of world1 with some ANIMAT (with ) (cf. 4.8) we have to define the terms start and goal.
For this we have to assume, that an agent system S represents at every point of time a state . Thus one can write the process of an agent system S as a sequence of states . A start is then every state with parameter and the 'predecessor' of in has the parameter . Similarly one can define a goal as that state with parameter and the 'successor' of in has the parameter . Thus while the raise of the drive triggers the 'start' does a lowering of the drive only mark a minimal success. A start-state followed by a finite sequence of states not being a goal-state and then a goal-state is called a successful behavior. Every successful behavior is 'part' of the overall agent process . Every partial process with a start state but no goal state is an unsuccessful behavior.
In the agent system ANIMAT we assume the following dependency between the drive and the energy of the whole system:
(4.109) | |||
(4.110) | |||
(4.111) |
Gerd Doeben-Henisch 2012-03-31