|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use JMarkovElement | |
---|---|
jmarkov | Provides the basic elements to model continuous time Markov chains (CTMC). |
jmarkov.basic | This package contains basic elements such as State, Event, Action that are used in jMarkov and jMDP. |
jmarkov.jmdp.solvers | This package contins the framwork of solvers used by jMDP to solve Markov Decision Processes. |
jmarkov.solvers | Provides classes for customizing a solver used by JMarkov to solve transient and steady state probabilities in different models. |
jphase | This package provides capabilities for modeling Phase type distributions. |
Uses of JMarkovElement in jmarkov |
---|
Classes in jmarkov that implement JMarkovElement | |
---|---|
class |
GeomProcess<Sub extends State,E extends Event>
The class GeomProcess represents a continuos or discrete Quasi Birth and Death process. |
class |
GeomRelState<Sub extends State>
This class is used to build destinations which are relative to a given GeomState. |
class |
GeomState<Sub extends State>
The actual Geometric model is build using this class. |
class |
MarkovProcess<S extends State,E extends Event>
The abstract class SimpleMarkovProcess represents a Continuous or Discrete Time Markov Chain. |
class |
SimpleMarkovProcess<S extends State,E extends Event>
|
Uses of JMarkovElement in jmarkov.basic |
---|
Subinterfaces of JMarkovElement in jmarkov.basic | |
---|---|
interface |
PropertiesElement
This interface is a wrapper for elements (States, Actions Events) that can be represented by an arry of integers. |
interface |
Transitions<S extends State>
|
Classes in jmarkov.basic that implement JMarkovElement | |
---|---|
class |
Action
This class represents a single Action in Markov Decision Process (MDP). |
class |
DecisionRule<S extends State,A extends Action>
This class represents a deterministic decision rule which assigns an action to every state. |
class |
Event
The class Event allows the user to define the implementation of the Events that can alter the States of the Markov Chain. |
class |
PropertiesAction
This class is an easy way to use a Action that is represented by an integer valued array. |
class |
PropertiesEvent
This class is an easy way to use an event that is represented by an array of int. |
class |
PropertiesState
The states are characterized by an array of integer-valued properties, whose meaning will change from implementation to implementation. |
class |
State
The Class State represent a state in a MarkovProcess or MDP. |
class |
StateC
State to model shortest path problems. |
class |
StateEvent<S extends State,E extends Event>
This class represents a state compounded of a state and an event. |
class |
Transition<S extends State>
This class represent a transition to a given state. |
class |
TransitionsSet<S extends State>
|
class |
ValueFunction<S extends State>
This structure matches each state with a double number representing its value function, or in some cases the steady state probabilities. |
Uses of JMarkovElement in jmarkov.jmdp.solvers |
---|
Classes in jmarkov.jmdp.solvers that implement JMarkovElement | |
---|---|
class |
AbstractAverageSolver<S extends State,A extends Action>
Structural class for average cost solvers to extend. |
class |
AbstractDiscountedSolver<S extends State,A extends Action>
This is a structural class that must be extended by classes solving the dicounted cost minimization problem. |
class |
AbstractFiniteSolver<S extends State,A extends Action>
Structural class for solvers to extend in order to solve finite horizon problems. |
class |
AbstractInfiniteSolver<S extends State,A extends Action>
Structural class to be extended by solvers in order to solve infinite horizon problems |
class |
AbstractTotalSolver<S extends State,A extends Action>
Structural class to be extended by solvers in order to solve the total cost criteria for an infinite horizon problem |
class |
FiniteSolver<S extends State,A extends Action>
This class belongs to the set of default solvers included in the jmdp package. |
class |
LPBCLAverageSolver<S extends State,A extends Action>
This solver solves a average-cost infinite horizon MDP by building and solving a linear problem using as interface Xpress BCL. |
class |
LPBCLDiscountedSolver<S extends State,A extends Action>
This solver solves a discounted infinite horizon MDP by building and solving a linear problem using as interface Xpress BCL. |
class |
MpsLpAverageSolver<S extends State,A extends Action>
This class builds the Dual Linear Program for an average infinite horizon MDP in a MPS file. |
class |
MpsLpDiscountedSolver<S extends State,A extends Action>
This class builds a Linear Program for a discounted infinite horizon MDP in a MPS file. |
class |
PolicyIterationSolver<S extends State,A extends Action>
This class solves infinite horizon discounted problems using the policy iteration algorithm. |
class |
RelativeValueIterationSolver<S extends State,A extends Action>
This class solves the average cost criteria for infinite horizon problems |
class |
Solver<S extends State,A extends Action>
Structural class for every solver. |
class |
StochasticShortestPathSolver<S extends StateC,A extends Action>
This solver gives a solution for the minimization of the total cost criterion for an infinite horizon MDP. |
class |
ValueIterationSolver<S extends State,A extends Action>
This class belongs to the set of default solvers included in the jmdp package. |
Uses of JMarkovElement in jmarkov.solvers |
---|
Classes in jmarkov.solvers that implement JMarkovElement | |
---|---|
class |
GeometricSolver
|
class |
GeometrixSolver
|
class |
JamaSolver
Solver implementation for steady state, using JAMA |
class |
JamaTransientSolver
This class claculate the transient probabilities. |
class |
MtjLogRedSolver
|
class |
MtjSolver
This class uses MTJ to solve Steady State probabilities. |
class |
SteadyStateSolver
An abstract clas for steady state solver. |
class |
TransientSolver
An abstract class for Transient solvers. |
Uses of JMarkovElement in jphase |
---|
Subinterfaces of JMarkovElement in jphase | |
---|---|
interface |
ContPhaseVar
|
interface |
DiscPhaseVar
|
interface |
PhaseVar
This interface defines the behaviour that any Phase-Type distribution should have |
Classes in jphase that implement JMarkovElement | |
---|---|
class |
AbstractContPhaseVar
|
class |
AbstractDiscPhaseVar
|
class |
DenseContPhaseVar
This class allows the creation and manipulation of Continuous Phase-type distributions represented by dense matrices. |
class |
DenseDiscPhaseVar
This class allows the creation and manipulation of Discrete Phase-type distributions represented by dense matrices. |
class |
ErlangCoxianVar
Phase-Type representation of an ErlangCoxian distribution as defined by Osogami and Harchol in "Closed form solutions for mapping general distributions to quasi-minimal PH distributions", 2005. |
class |
HyperErlangVar
|
class |
SparseContPhaseVar
|
class |
SparseDiscPhaseVar
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |