Uses of Interface
jmarkov.basic.JMarkovElement

Packages that use JMarkovElement
jmarkov Provides the basic elements to model continuous time Markov chains (CTMC). 
jmarkov.basic This package contains basic elements such as State, Event, Action that are used in jMarkov and jMDP. 
jmarkov.jmdp.solvers This package contins the framwork of solvers used by jMDP to solve Markov Decision Processes. 
jmarkov.solvers Provides classes for customizing a solver used by JMarkov to solve transient and steady state probabilities in different models. 
jphase This package provides capabilities for modeling Phase type distributions. 
 

Uses of JMarkovElement in jmarkov
 

Classes in jmarkov that implement JMarkovElement
 class GeomProcess<Sub extends State,E extends Event>
          The class GeomProcess represents a continuos or discrete Quasi Birth and Death process.
 class GeomRelState<Sub extends State>
          This class is used to build destinations which are relative to a given GeomState.
 class GeomState<Sub extends State>
          The actual Geometric model is build using this class.
 class MarkovProcess<S extends State,E extends Event>
          The abstract class SimpleMarkovProcess represents a Continuous or Discrete Time Markov Chain.
 class SimpleMarkovProcess<S extends State,E extends Event>
           
 

Uses of JMarkovElement in jmarkov.basic
 

Subinterfaces of JMarkovElement in jmarkov.basic
 interface PropertiesElement
          This interface is a wrapper for elements (States, Actions Events) that can be represented by an arry of integers.
 interface Transitions<S extends State>
           
 

Classes in jmarkov.basic that implement JMarkovElement
 class Action
          This class represents a single Action in Markov Decision Process (MDP).
 class DecisionRule<S extends State,A extends Action>
          This class represents a deterministic decision rule which assigns an action to every state.
 class Event
          The class Event allows the user to define the implementation of the Events that can alter the States of the Markov Chain.
 class PropertiesAction
          This class is an easy way to use a Action that is represented by an integer valued array.
 class PropertiesEvent
          This class is an easy way to use an event that is represented by an array of int.
 class PropertiesState
          The states are characterized by an array of integer-valued properties, whose meaning will change from implementation to implementation.
 class State
          The Class State represent a state in a MarkovProcess or MDP.
 class StateC
          State to model shortest path problems.
 class StateEvent<S extends State,E extends Event>
          This class represents a state compounded of a state and an event.
 class Transition<S extends State>
          This class represent a transition to a given state.
 class TransitionsSet<S extends State>
           
 class ValueFunction<S extends State>
          This structure matches each state with a double number representing its value function, or in some cases the steady state probabilities.
 

Uses of JMarkovElement in jmarkov.jmdp.solvers
 

Classes in jmarkov.jmdp.solvers that implement JMarkovElement
 class AbstractAverageSolver<S extends State,A extends Action>
          Structural class for average cost solvers to extend.
 class AbstractDiscountedSolver<S extends State,A extends Action>
          This is a structural class that must be extended by classes solving the dicounted cost minimization problem.
 class AbstractFiniteSolver<S extends State,A extends Action>
          Structural class for solvers to extend in order to solve finite horizon problems.
 class AbstractInfiniteSolver<S extends State,A extends Action>
          Structural class to be extended by solvers in order to solve infinite horizon problems
 class AbstractTotalSolver<S extends State,A extends Action>
          Structural class to be extended by solvers in order to solve the total cost criteria for an infinite horizon problem
 class FiniteSolver<S extends State,A extends Action>
          This class belongs to the set of default solvers included in the jmdp package.
 class LPBCLAverageSolver<S extends State,A extends Action>
          This solver solves a average-cost infinite horizon MDP by building and solving a linear problem using as interface Xpress BCL.
 class LPBCLDiscountedSolver<S extends State,A extends Action>
          This solver solves a discounted infinite horizon MDP by building and solving a linear problem using as interface Xpress BCL.
 class MpsLpAverageSolver<S extends State,A extends Action>
          This class builds the Dual Linear Program for an average infinite horizon MDP in a MPS file.
 class MpsLpDiscountedSolver<S extends State,A extends Action>
          This class builds a Linear Program for a discounted infinite horizon MDP in a MPS file.
 class PolicyIterationSolver<S extends State,A extends Action>
          This class solves infinite horizon discounted problems using the policy iteration algorithm.
 class RelativeValueIterationSolver<S extends State,A extends Action>
          This class solves the average cost criteria for infinite horizon problems
 class Solver<S extends State,A extends Action>
          Structural class for every solver.
 class StochasticShortestPathSolver<S extends StateC,A extends Action>
          This solver gives a solution for the minimization of the total cost criterion for an infinite horizon MDP.
 class ValueIterationSolver<S extends State,A extends Action>
          This class belongs to the set of default solvers included in the jmdp package.
 

Uses of JMarkovElement in jmarkov.solvers
 

Classes in jmarkov.solvers that implement JMarkovElement
 class GeometricSolver
           
 class GeometrixSolver
           
 class JamaSolver
          Solver implementation for steady state, using JAMA
 class JamaTransientSolver
          This class claculate the transient probabilities.
 class MtjLogRedSolver
           
 class MtjSolver
          This class uses MTJ to solve Steady State probabilities.
 class SteadyStateSolver
          An abstract clas for steady state solver.
 class TransientSolver
          An abstract class for Transient solvers.
 

Uses of JMarkovElement in jphase
 

Subinterfaces of JMarkovElement in jphase
 interface ContPhaseVar
           
 interface DiscPhaseVar
           
 interface PhaseVar
          This interface defines the behaviour that any Phase-Type distribution should have
 

Classes in jphase that implement JMarkovElement
 class AbstractContPhaseVar
           
 class AbstractDiscPhaseVar
           
 class DenseContPhaseVar
          This class allows the creation and manipulation of Continuous Phase-type distributions represented by dense matrices.
 class DenseDiscPhaseVar
          This class allows the creation and manipulation of Discrete Phase-type distributions represented by dense matrices.
 class ErlangCoxianVar
          Phase-Type representation of an ErlangCoxian distribution as defined by Osogami and Harchol in "Closed form solutions for mapping general distributions to quasi-minimal PH distributions", 2005.
 class HyperErlangVar
           
 class SparseContPhaseVar
           
 class SparseDiscPhaseVar