|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmdp.MDP<S,A>
jmdp.InfiniteMDP<S,A>
jmdp.DTMDP<StateEvent<S,E>,A>
jmdp.DTMDPEvA<S,A,E>
public abstract class DTMDPEvA<S extends State,A extends Action,E extends Event>
This class represents an infinite horizon, discrete time, Markov Decision Process with events, where actions depend on events. It allows the definition of events that can occur in a given state and this makes the cost and probability definition easier to define than in the cases where no events are defined.
Field Summary |
---|
Fields inherited from class jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, probability, probabilitySolver, states |
Fields inherited from class jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
DTMDPEvA(States<S> initial)
Creates a new infinite horizon discrete time (MDP) Problem with events |
Method Summary | |
---|---|
abstract Events<E> |
activeEvents(S i,
A a)
Set of events that are active from state i given that action a is taken. |
abstract Actions<A> |
feasibleAct(S i)
Returns the set of actions available at this state. |
Actions<A> |
feasibleActions(StateEvent<S,E> i)
Returns the set of actions available at this state. |
abstract double |
immediateCost(S i,
A a,
E e)
Reward received when the current state is i, the action taken is a and event e occurs. |
double |
immediateCost(StateEvent<S,E> i,
A a)
Cost incurred when taking action a from state i |
abstract double |
prob(S i,
E e)
Conditional probability. |
abstract double |
prob(S i,
S j,
A a,
E e)
Conditional probability. |
double |
prob(StateEvent<S,E> i,
StateEvent<S,E> j,
A a)
Probability of going from state i to state j by taking the action a |
abstract States<S> |
reachable(S i,
A a,
E e)
Set of reachable states from state i given that action a is taken and event e occurs. |
States<StateEvent<S,E>> |
reachable(StateEvent<S,E> i,
A a)
Set of states that can be reached from this state i, after taking the action a. |
Methods inherited from class jmdp.DTMDP |
---|
explore, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve |
Methods inherited from class jmdp.InfiniteMDP |
---|
getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getSolver, setInterestRate |
Methods inherited from class jmdp.MDP |
---|
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public DTMDPEvA(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
public States<StateEvent<S,E>> reachable(StateEvent<S,E> i, A a)
DTMDP
reachable
in class DTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
public double immediateCost(StateEvent<S,E> i, A a)
DTMDP
immediateCost
in class DTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
public double prob(StateEvent<S,E> i, StateEvent<S,E> j, A a)
DTMDP
prob
in class DTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
public Actions<A> feasibleActions(StateEvent<S,E> i)
InfiniteMDP
feasibleActions
in class InfiniteMDP<StateEvent<S extends State,E extends Event>,A extends Action>
public abstract double immediateCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract double prob(S i, S j, A a, E e)
i
- current statej
- state to reacha
- action taken (given)e
- event that occurs (given)
public abstract double prob(S i, E e)
i
- current statee
- event that occurs
public abstract States<S> reachable(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Events<E> activeEvents(S i, A a)
i
- current statea
- action taken
public abstract Actions<A> feasibleAct(S i)
i
- current state
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |