|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmdp.MDP<S,A>
jmdp.InfiniteMDP<S,A>
public abstract class InfiniteMDP<S extends State,A extends Action>
This class is a structural class and is not intended to be extended. It represents a general Infinite horizon MDP problem.
PolicyIterationSolver
,
ValueIterationSolver
Field Summary | |
---|---|
protected States<S> |
absorbingStates
|
protected long |
explorationTime
|
protected boolean |
hasAbsorbingState
|
protected ValueFunction<S> |
probability
|
protected ProbabilitySolver<S,A> |
probabilitySolver
|
protected States<S> |
states
|
Fields inherited from class jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
InfiniteMDP(States<S> initial)
Creates a new INFINITE Dynamic Programming (DP) Problem. |
Method Summary | |
---|---|
protected abstract States<S> |
explore(States<S> initSet)
|
abstract Actions<A> |
feasibleActions(S i)
Returns the set of actions available at this state. |
States<S> |
getAllStates()
Complete set of states explored |
protected AbstractAverageSolver<S,A> |
getDefaultAverageSolver()
|
protected AbstractDiscountedSolver<S,A> |
getDefaultDiscountedSolver()
|
protected AbstractInfiniteSolver<S,A> |
getDefaultSolver()
The class that extends MDP must define the default solver to use. |
AbstractInfiniteSolver<S,A> |
getSolver()
|
void |
setInterestRate(double interestRate)
Sets the interest rate to be used in the problem solving if the objective is to minimze the discounted cost. |
Methods inherited from class jmdp.MDP |
---|
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected States<S extends State> states
protected ValueFunction<S extends State> probability
protected ProbabilitySolver<S extends State,A extends Action> probabilitySolver
protected boolean hasAbsorbingState
protected States<S extends State> absorbingStates
protected long explorationTime
Constructor Detail |
---|
public InfiniteMDP(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public abstract Actions<A> feasibleActions(S i)
protected abstract States<S> explore(States<S> initSet)
public void setInterestRate(double interestRate)
interestRate
- effective interest rateprotected AbstractDiscountedSolver<S,A> getDefaultDiscountedSolver()
MDP.getDefaultSolver()
protected AbstractAverageSolver<S,A> getDefaultAverageSolver()
MDP.getDefaultSolver()
protected AbstractInfiniteSolver<S,A> getDefaultSolver()
MDP
getDefaultSolver
in class MDP<S extends State,A extends Action>
public States<S> getAllStates()
public AbstractInfiniteSolver<S,A> getSolver()
getSolver
in class MDP<S extends State,A extends Action>
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |