jmarkov.jmdp
Class CT2DTConverter<S extends State,A extends Action>

java.lang.Object
  extended by jmarkov.jmdp.MDP<S,A>
      extended by jmarkov.jmdp.InfiniteMDP<S,A>
          extended by jmarkov.jmdp.DTMDP<S,A>
              extended by jmarkov.jmdp.CT2DTConverter<S,A>
Type Parameters:
S - state
A - action

public class CT2DTConverter<S extends State,A extends Action>
extends DTMDP<S,A>

This class formulates a DTMDP equivalent to a CTMDP.

Author:
Andres Sarmiento and Germán Riaño - Universidad de Los Andes

Field Summary
 
Fields inherited from class jmarkov.jmdp.InfiniteMDP
absorbingStates, explorationTime, hasAbsorbingState, numStates, probability, probabilitySolver, states
 
Fields inherited from class jmarkov.jmdp.MDP
finite, initial, reporter
 
Constructor Summary
CT2DTConverter(CTMDP<S,A> problem)
          Constructor is not public because it should only be invoked by CTMDP in this same package.
 
Method Summary
 double exitRate(S i, A a)
          This method calculates the exit rate for a given state and action.
 Actions<A> feasibleActions(S i)
          Returns the set of actions available at this state.
 double immediateCost(S i, A a)
          Cost incurred when taking action a from state i
 double prob(S i, S j, A a)
          Probability of going from state i to state j by taking the action a
 States<S> reachable(S i, A a)
          Set of states that can be reached from this state i, after taking the action a.
 
Methods inherited from class jmarkov.jmdp.DTMDP
generate, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve
 
Methods inherited from class jmarkov.jmdp.InfiniteMDP
getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getNumStates, getSolver, setInterestRate
 
Methods inherited from class jmarkov.jmdp.MDP
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

CT2DTConverter

public CT2DTConverter(CTMDP<S,A> problem)
Constructor is not public because it should only be invoked by CTMDP in this same package.

Parameters:
problem - an infinite horizon continuous time problem
Method Detail

exitRate

public double exitRate(S i,
                       A a)
This method calculates the exit rate for a given state and action. It sums all rates for all reachable states under that action.

Parameters:
i - current state
a - current action
Returns:
The soujurn rate for a given state and action

immediateCost

public final double immediateCost(S i,
                                  A a)
Description copied from class: DTMDP
Cost incurred when taking action a from state i

Specified by:
immediateCost in class DTMDP<S extends State,A extends Action>
Parameters:
i - Current State
a - Current Action
Returns:
The cost incurred per transition

reachable

public final States<S> reachable(S i,
                                 A a)
Description copied from class: DTMDP
Set of states that can be reached from this state i, after taking the action a.

Specified by:
reachable in class DTMDP<S extends State,A extends Action>
Parameters:
i - Current State
a - Action taken
Returns:
The reachable states.

prob

public final double prob(S i,
                         S j,
                         A a)
Description copied from class: DTMDP
Probability of going from state i to state j by taking the action a

Specified by:
prob in class DTMDP<S extends State,A extends Action>
Parameters:
i - Current state.
j - Destination State
a - Action
Returns:
The probability.

feasibleActions

public final Actions<A> feasibleActions(S i)
Description copied from class: InfiniteMDP
Returns the set of actions available at this state.

Specified by:
feasibleActions in class InfiniteMDP<S extends State,A extends Action>
Parameters:
i - Current State
Returns:
set of Actions that can be taken at this state.