|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmdp.MDP<S,A>
jmdp.InfiniteMDP<S,A>
jmdp.CTMDP<S,A>
jmdp.CTMDPEv<S,A,E>
public abstract class CTMDPEv<S extends State,A extends Action,E extends Event>
This class represents an Infinite horizon, continuous time Markov Decision Process with events. It allows the definition of events that can occur in a given state and this makes the reward and probability definition easier than in the cases where no events are defined.
Field Summary |
---|
Fields inherited from class jmdp.CTMDP |
---|
activeState, exitRates, maxRate |
Fields inherited from class jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, probability, probabilitySolver, states |
Fields inherited from class jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
CTMDPEv(States<S> initial)
This constructor builds a continuous time MDP with events. |
Method Summary | |
---|---|
abstract Events<E> |
activeEvents(S i,
A a)
Set of events that are active from state i given that action a is taken. |
double |
continuousCost(S i,
A a)
Reward obtained continuously in time until the next transition from state i given that action a is taken. |
abstract double |
continuousCost(S i,
A a,
E e)
Reward obtained continuously in time during the sojourn time in state i until an action a is taken and a transition is triggered. |
double |
lumpCost(S i,
A a)
Reward instantaneously in the moment when action a is taken from state i. |
abstract double |
lumpCost(S i,
A a,
E e)
Reward instantaneously gained in the moment when action a is taken from state i. |
double |
rate(S i,
S j,
A a)
Rate of going from state i to state j by taking the action a |
abstract double |
rate(S i,
S j,
A a,
E e)
Rate. |
States<S> |
reachable(S i,
A a)
|
abstract States<S> |
reached(S i,
A a,
E e)
Set of reachable states from state i given that action a is taken and event e occurs. |
Methods inherited from class jmdp.CTMDP |
---|
exitRate, explore, getAllStates, getMaxRate, getSteadyStateProbabilities, oneStageReachable, reached, setConverter, solve |
Methods inherited from class jmdp.InfiniteMDP |
---|
feasibleActions, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getSolver, setInterestRate |
Methods inherited from class jmdp.MDP |
---|
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public CTMDPEv(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public double lumpCost(S i, A a)
CTMDP
lumpCost
in class CTMDP<S extends State,A extends Action>
public double continuousCost(S i, A a)
CTMDP
continuousCost
in class CTMDP<S extends State,A extends Action>
public double rate(S i, S j, A a)
CTMDP
rate
in class CTMDP<S extends State,A extends Action>
public States<S> reachable(S i, A a)
public abstract double rate(S i, S j, A a, E e)
i
- current statej
- state to reacha
- action taken (given)e
- event that occurs (given)
public abstract States<S> reached(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Events<E> activeEvents(S i, A a)
i
- current statea
- action taken
public abstract double lumpCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract double continuousCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |