jmdp.solvers
Class CT2DTConverter<S extends State,A extends Action>

java.lang.Object
  extended by jmdp.MDP<S,A>
      extended by jmdp.InfiniteMDP<S,A>
          extended by jmdp.DTMDP<S,A>
              extended by jmdp.solvers.CT2DTConverter<S,A>
Type Parameters:
S - state
A - action

public class CT2DTConverter<S extends State,A extends Action>
extends DTMDP<S,A>

This class formulates a DTMDP equivalent to a CTMDP.

Author:
Andres Sarmiento and German Riano - Universidad de Los Andes

Field Summary
protected  S activeState
           
 
Fields inherited from class jmdp.InfiniteMDP
absorbingStates, explorationTime, hasAbsorbingState, probability, probabilitySolver, states
 
Fields inherited from class jmdp.MDP
finite, initial, reporter
 
Method Summary
 Actions<A> feasibleActions(S i)
          Returns the set of actions available at this state.
 double immediateCost(S i, A a)
          Cost incurred when taking action a from state i
 double prob(S i, S j, A a)
          Probability of going from state i to state j by taking the action a
 States<S> reachable(S i, A a)
          Set of states that can be reached from this state i, after taking the action a.
 
Methods inherited from class jmdp.DTMDP
explore, getSteadyStateProbabilities, oneStageReachable, setProbabilitySolver, solve
 
Methods inherited from class jmdp.InfiniteMDP
getAllStates, getDefaultAverageSolver, getDefaultDiscountedSolver, getDefaultSolver, getSolver, setInterestRate
 
Methods inherited from class jmdp.MDP
debug, getOptimalPolicy, getOptimalValueFunction, getReporter, isFinite, isSolved, operation, printSolution, printSolution, setReporter, setSolver, solve
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

activeState

protected S extends State activeState
Method Detail

immediateCost

public double immediateCost(S i,
                            A a)
Description copied from class: DTMDP
Cost incurred when taking action a from state i

Specified by:
immediateCost in class DTMDP<S extends State,A extends Action>

reachable

public States<S> reachable(S i,
                           A a)
Description copied from class: DTMDP
Set of states that can be reached from this state i, after taking the action a.

Specified by:
reachable in class DTMDP<S extends State,A extends Action>

prob

public double prob(S i,
                   S j,
                   A a)
Description copied from class: DTMDP
Probability of going from state i to state j by taking the action a

Specified by:
prob in class DTMDP<S extends State,A extends Action>

feasibleActions

public Actions<A> feasibleActions(S i)
Description copied from class: InfiniteMDP
Returns the set of actions available at this state.

Specified by:
feasibleActions in class InfiniteMDP<S extends State,A extends Action>