|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmarkov.jmdp.MDP<S,A>
jmarkov.jmdp.InfiniteMDP<S,A>
jmarkov.jmdp.DTMDP<S,A>
jmarkov.jmdp.CT2DTConverter<S,A>
S
- stateA
- actionpublic class CT2DTConverter<S extends State,A extends Action>
This class formulates a DTMDP equivalent to a CTMDP.
Field Summary |
---|
Fields inherited from class jmarkov.jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, numStates, probability, probabilitySolver, states |
Fields inherited from class jmarkov.jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
CT2DTConverter(CTMDP<S,A> problem)
Constructor is not public because it should only be invoked by CTMDP in this same package. |
Method Summary | |
---|---|
double |
exitRate(S i,
A a)
This method calculates the exit rate for a given state and action. |
Actions<A> |
feasibleActions(S i)
Returns the set of actions available at this state. |
double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i |
double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the action a |
States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
Methods inherited from class jmarkov.jmdp.DTMDP |
---|
generate, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve |
Methods inherited from class jmarkov.jmdp.InfiniteMDP |
---|
getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getNumStates, getSolver, setInterestRate |
Methods inherited from class jmarkov.jmdp.MDP |
---|
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public CT2DTConverter(CTMDP<S,A> problem)
problem
- an infinite horizon continuous time problemMethod Detail |
---|
public double exitRate(S i, A a)
i
- current statea
- current action
public final double immediateCost(S i, A a)
DTMDP
immediateCost
in class DTMDP<S extends State,A extends Action>
i
- Current Statea
- Current Action
public final States<S> reachable(S i, A a)
DTMDP
reachable
in class DTMDP<S extends State,A extends Action>
i
- Current Statea
- Action taken
public final double prob(S i, S j, A a)
DTMDP
prob
in class DTMDP<S extends State,A extends Action>
i
- Current state.j
- Destination Statea
- Action
public final Actions<A> feasibleActions(S i)
InfiniteMDP
feasibleActions
in class InfiniteMDP<S extends State,A extends Action>
i
- Current State
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |