|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjmarkov.jmdp.MDP<S,A>
jmarkov.jmdp.InfiniteMDP<S,A>
jmarkov.jmdp.CTMDP<StateEvent<S,E>,A>
jmarkov.jmdp.CTMDPEvA<S,A,E>
S
- The staes classA
- Actions classE
- Events classpublic abstract class CTMDPEvA<S extends State,A extends Action,E extends Event>
This class represents an Infinite horizon, continuous time Markov Decision Process with events where actions depend on events. It allows the definition of events that can occur in a given state and this makes the cost and probability definition easier than in the cases where no events are defined.
Field Summary | |
---|---|
protected States<S> |
initSet
Initail set od States. |
Fields inherited from class jmarkov.jmdp.CTMDP |
---|
activeState, converter, maxRate |
Fields inherited from class jmarkov.jmdp.InfiniteMDP |
---|
absorbingStates, explorationTime, hasAbsorbingState, numStates, probability, probabilitySolver, states |
Fields inherited from class jmarkov.jmdp.MDP |
---|
finite, initial, reporter |
Constructor Summary | |
---|---|
CTMDPEvA(States<S> initial)
Creates a new continuous time infinite horizon MDP Problem with events |
Method Summary | |
---|---|
abstract Events<E> |
activeEvents(S i)
Set of events that are active from state i given that action a is taken. |
abstract double |
continuousCost(S i,
A a,
E e)
Reward obtained continuously in time during the sojourn time in state i until an action a is taken and a transition is triggered. |
double |
continuousCost(StateEvent<S,E> i,
A a)
Cost incurred continuously in time until the next transition from state i given that action a is taken. |
abstract Actions<A> |
feasibleAct(S i)
Returns the set of actions available at this state. |
Actions<A> |
feasibleActions(StateEvent<S,E> s)
Returns the set of actions available at this state. |
protected StatesSet<StateEvent<S,E>> |
generate()
|
abstract double |
lumpCost(S i,
A a,
E e)
Reward instantaneously gained in the moment when action a is taken from state i. |
double |
lumpCost(StateEvent<S,E> i,
A a)
Cost incurred instantaneously in the moment when action a is taken from state i. |
abstract double |
rate(S i,
S j,
A a,
E e)
Rate. |
double |
rate(StateEvent<S,E> i,
StateEvent<S,E> j,
A a)
Rate of going from state i to state j by taking the action a |
States<StateEvent<S,E>> |
reachable(StateEvent<S,E> i,
A a)
Set of States that can be reached from this state i, after taking the action a. |
abstract States<S> |
reached(S i,
A a,
E e)
Set of reachable states from state i given that action a is taken and event e occurs. |
Methods inherited from class jmarkov.jmdp.CTMDP |
---|
getAllStates, getMaxRate, getSteadyStateProbabilities, oneStageReachable, setConverter, solve |
Methods inherited from class jmarkov.jmdp.InfiniteMDP |
---|
getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getNumStates, getSolver, setInterestRate |
Methods inherited from class jmarkov.jmdp.MDP |
---|
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected States<S extends State> initSet
Constructor Detail |
---|
public CTMDPEvA(States<S> initial)
initial
- set of initial states for the exploration algorithmMethod Detail |
---|
protected StatesSet<StateEvent<S,E>> generate()
generate
in class CTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
public double lumpCost(StateEvent<S,E> i, A a)
CTMDP
lumpCost
in class CTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
i
- Statea
- Action
public double continuousCost(StateEvent<S,E> i, A a)
CTMDP
continuousCost
in class CTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
i
- Statea
- Action
public double rate(StateEvent<S,E> i, StateEvent<S,E> j, A a)
CTMDP
rate
in class CTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
i
- current statej
- Destination state.a
- Action taken
public States<StateEvent<S,E>> reachable(StateEvent<S,E> i, A a)
CTMDP
reachable
in class CTMDP<StateEvent<S extends State,E extends Event>,A extends Action>
i
- current Statea
- action taken
public Actions<A> feasibleActions(StateEvent<S,E> s)
InfiniteMDP
feasibleActions
in class InfiniteMDP<StateEvent<S extends State,E extends Event>,A extends Action>
s
- Current State
public abstract double rate(S i, S j, A a, E e)
i
- current statej
- state to reacha
- action taken (given)e
- event that occurs (given)
public abstract States<S> reached(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Events<E> activeEvents(S i)
i
- current state
public abstract double lumpCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract double continuousCost(S i, A a, E e)
i
- current statea
- action takene
- event that occurs
public abstract Actions<A> feasibleAct(S i)
i
- current state
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |