|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmarkov.jmdp.MDP<S,A>
jmarkov.jmdp.InfiniteMDP<S,A>
jmarkov.jmdp.DTMDP<S,A>
jmarkov.jmdp.DTMDPEv<S,A,E>
S
- The States classA
- Actions classE
- Events classpublic abstract class DTMDPEv<S extends State,A extends Action,E extends Event>
This class represents an infinite horizon, discrete time, Markov Decision Process with events. It allows the definition of events that can occur in a given state and this makes the cost and probability definition easier to define than in the cases where no events are defined.
Field Summary |
---|
Fields inherited from class jmarkov.jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, numStates, probability, probabilitySolver, states |
Fields inherited from class jmarkov.jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
DTMDPEv(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem with events |
Method Summary | |
---|---|
abstract Events<E> |
activeEvents(S i,
A a)
Set of events that are active from state i given that action a is taken. |
double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i |
abstract double |
immediateCost(S i,
A a,
E e)
Cost incurred received when the current state is i, the action taken is a and event e occurs. |
abstract double |
prob(S i,
E e)
Conditional Event probability. |
double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the action a |
abstract double |
prob(S i,
S j,
A a,
E e)
Conditional destination probability. |
States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
abstract States<S> |
reachable(S i,
A a,
E e)
Set of reachable states from state i given that action a is taken and event e occurs. |
Methods inherited from class jmarkov.jmdp.DTMDP |
---|
generate, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve |
Methods inherited from class jmarkov.jmdp.InfiniteMDP |
---|
feasibleActions, getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getNumStates, getSolver, setInterestRate |
Methods inherited from class jmarkov.jmdp.MDP |
---|
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DTMDPEv(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public final double immediateCost(S i, A a)
DTMDP
immediateCost
in class DTMDP<S extends State,A extends Action>
i
- Current Statea
- Current Action
public final double prob(S i, S j, A a)
DTMDP
prob
in class DTMDP<S extends State,A extends Action>
i
- Current state.j
- Destination Statea
- Action
public final States<S> reachable(S i, A a)
DTMDP
reachable
in class DTMDP<S extends State,A extends Action>
i
- Current Statea
- Action taken
public abstract double immediateCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract double prob(S i, S j, A a, E e)
i
- current statej
- state to reacha
- action taken (given)e
- event that occurs (given)
public abstract double prob(S i, E e)
i
- current statee
- event that occurs
public abstract States<S> reachable(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Events<E> activeEvents(S i, A a)
i
- current statea
- action taken
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |