|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmdp.MDP<S,A>
jmdp.InfiniteMDP<S,A>
jmdp.CTMDP<S,A>
public abstract class CTMDP<S extends State,A extends Action>
This class represents a continuous time MDP. It should ONLY be used in INFINITE Problems. It must be extended in order to represent the appropriate structure for each INFINITE horizon MDP problem. The user must implement at least the functions that have been declared abstract. It is also necessary to create one of the extensions of the class Solver. By default, the program includes PolicyIterationSolver and ValueIterationSolver classes to solve infinite horizon problems. The FiniteSolver class is only for finite horizon problems. To solve the problem follow the instructions in each of the solvers's instructions.
PolicyIterationSolver
,
ValueIterationSolver
Field Summary | |
---|---|
protected S |
activeState
|
protected java.util.TreeMap<A,java.lang.Double> |
exitRates
|
protected double |
maxRate
|
Fields inherited from class jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, probability, probabilitySolver, states |
Fields inherited from class jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
CTMDP(States<S> initial)
Creates a new continuous time infinite horizon MDP Problem. |
Method Summary | |
---|---|
abstract double |
continuousCost(S i,
A a)
Reward obtained continuously in time until the next transition from state i given that action a is taken. |
protected double |
exitRate(S i,
A a)
Exit rate from state i given action a is taken |
protected States<S> |
explore(States<S> initSet)
|
States<S> |
getAllStates()
Complete set of states explored |
double |
getMaxRate()
|
ValueFunction<S> |
getSteadyStateProbabilities()
|
abstract double |
lumpCost(S i,
A a)
Reward instantaneously in the moment when action a is taken from state i. |
protected States<S> |
oneStageReachable(States<S> initSet)
|
abstract double |
rate(S i,
S j,
A a)
Rate of going from state i to state j by taking the action a |
abstract States<S> |
reached(S i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
void |
setConverter(CT2DTConverter<S,A> converter)
Sets the class in charge of making a DTMDP equivalent to the CTMDP |
Solution<S,A> |
solve(double interestRate)
Solves the problem with the given interest rate |
Methods inherited from class jmdp.InfiniteMDP |
---|
feasibleActions, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getSolver, setInterestRate |
Methods inherited from class jmdp.MDP |
---|
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected double maxRate
protected java.util.TreeMap<A extends Action,java.lang.Double> exitRates
protected S extends State activeState
Constructor Detail |
---|
public CTMDP(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public States<S> getAllStates()
getAllStates
in class InfiniteMDP<S extends State,A extends Action>
public void setConverter(CT2DTConverter<S,A> converter)
converter
- class that makes a DTMDP equivalent to the CTMDPpublic double getMaxRate()
protected double exitRate(S i, A a)
i
- current statea
- action taken
protected States<S> oneStageReachable(States<S> initSet)
protected States<S> explore(States<S> initSet)
explore
in class InfiniteMDP<S extends State,A extends Action>
public ValueFunction<S> getSteadyStateProbabilities()
public Solution<S,A> solve(double interestRate)
interestRate
- the interest rate parameter to solve the problem.public abstract double lumpCost(S i, A a)
public abstract double continuousCost(S i, A a)
public abstract States<S> reached(S i, A a)
public abstract double rate(S i, S j, A a)
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |