|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmdp.MDP<S,A>
jmdp.InfiniteMDP<S,A>
jmdp.DTMDP<S,A>
jmdp.DTMDPEv<S,A,E>
public abstract class DTMDPEv<S extends State,A extends Action,E extends Event>
This class represents an infinite horizon, discrete time, Markov Decision Process with events. It allows the definition of events that can occur in a given state and this makes the cost and probability definition easier to define than in the cases where no events are defined.
Field Summary |
---|
Fields inherited from class jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, probability, probabilitySolver, states |
Fields inherited from class jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
DTMDPEv(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem with events |
Method Summary | |
---|---|
abstract Events<E> |
activeEvents(S i,
A a)
Set of events that are active from state i given that action a is taken. |
double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i |
abstract double |
immediateCost(S i,
A a,
E e)
Reward received when the current state is i, the action taken is a and event e occurs. |
abstract double |
prob(S i,
E e)
Conditional probability. |
double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the action a |
abstract double |
prob(S i,
S j,
A a,
E e)
Conditional probability. |
States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
abstract States<S> |
reachable(S i,
A a,
E e)
Set of reachable states from state i given that action a is taken and event e occurs. |
Methods inherited from class jmdp.DTMDP |
---|
explore, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve |
Methods inherited from class jmdp.InfiniteMDP |
---|
feasibleActions, getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getSolver, setInterestRate |
Methods inherited from class jmdp.MDP |
---|
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DTMDPEv(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public double immediateCost(S i, A a)
DTMDP
immediateCost
in class DTMDP<S extends State,A extends Action>
public double prob(S i, S j, A a)
DTMDP
prob
in class DTMDP<S extends State,A extends Action>
public States<S> reachable(S i, A a)
DTMDP
reachable
in class DTMDP<S extends State,A extends Action>
public abstract double immediateCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract double prob(S i, S j, A a, E e)
i
- current statej
- state to reacha
- action taken (given)e
- event that occurs (given)
public abstract double prob(S i, E e)
i
- current statee
- event that occurs
public abstract States<S> reachable(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Events<E> activeEvents(S i, A a)
i
- current statea
- action taken
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |