|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmarkov.jmdp.MDP<S,A>
jmarkov.jmdp.InfiniteMDP<S,A>
jmarkov.jmdp.DTMDP<S,A>
S
- State classA
- Action classpublic abstract class DTMDP<S extends State,A extends Action>
This class represents a discrete time infnite horizon MDP problem. It must be extended in order to represent the appropriate structure for each problem. The user must implement at least the functions that have been declared abstract.
PolicyIterationSolver
,
ValueIterationSolver
Field Summary |
---|
Fields inherited from class jmarkov.jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, numStates, probability, probabilitySolver, states |
Fields inherited from class jmarkov.jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
DTMDP(S initial)
Creates a new infinite horizon discrete time (MDP) Problem. |
|
DTMDP(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem. |
Method Summary | |
---|---|
protected StatesSet<S> |
generate()
|
ValueFunction<S> |
getSteadyStateProbabilities()
|
abstract double |
immediateCost(S i,
A a)
Cost incurred when taking action a from state i |
protected StatesSet<S> |
oneStageReachable(States<S> initSet)
TFinds the states reached in one step. |
abstract double |
prob(S i,
S j,
A a)
Probability of going from state i to state j by taking the action a |
abstract States<S> |
reachable(S i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
void |
setProbabilitySolver(ProbabilitySolver<S,A> solv)
|
Solution<S,A> |
solve(double interestRate)
Solves the problem with the given interest rate |
Methods inherited from class jmarkov.jmdp.InfiniteMDP |
---|
feasibleActions, getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getNumStates, getSolver, setInterestRate |
Methods inherited from class jmarkov.jmdp.MDP |
---|
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DTMDP(States<S> initial)
initial
- set of initial states for the exploration
algorithmpublic DTMDP(S initial)
initial
- An initial state for the exploration algorithmMethod Detail |
---|
public abstract double immediateCost(S i, A a)
i
- Current Statea
- Current Action
public abstract double prob(S i, S j, A a)
i
- Current state.j
- Destination Statea
- Action
public abstract States<S> reachable(S i, A a)
i
- Current Statea
- Action taken
protected StatesSet<S> oneStageReachable(States<S> initSet)
initSet
-
protected StatesSet<S> generate()
generate
in class InfiniteMDP<S extends State,A extends Action>
public ValueFunction<S> getSteadyStateProbabilities() throws SolverException
SolverException
public void setProbabilitySolver(ProbabilitySolver<S,A> solv)
solv
- Sets the solver that solves the steady state
probabilities.public final Solution<S,A> solve(double interestRate) throws SolverException
interestRate
- the interest rate parameter to solve the
problem.
SolverException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |