The Role of Information in System Stability with Partially Observable Servers

Show simple item record

dc.contributor.advisor Methodology and Computing in Applied Probability 22(3):949-968 16 Nov 2019 Asanjarani, Azam Nazarathy, Yoni 2021-11-02T03:41:05Z 2021-11-02T03:41:05Z 2019-11-16
dc.identifier.issn 1387-5841
dc.description.abstract We present a methodology for analyzing the role of information on system stability. For this we consider a simple discrete-time controlled queueing system, where the controller has a choice of which server to use at each time slot and server performance varies according to a Markov modulated random environment. At the extreme cases of information availability, that is when there is either full information or no information, stability regions and maximally stabilizing policies are trivial. But in the more realistic cases where only the environment state of the selected server is observed, only the service successes are observed or only queue length is observed, finding throughput maximizing control laws is a challenge. To handle these situations, we devise a Partially Observable Markov Decision Process (POMDP) formulation of the problem and illustrate properties of its solution. We further model the system under given decision rules, using Quasi-Birth-and-Death (QBD) structure to find a matrix analytic expression for the stability bound. We use this formulation to illustrate how the stability region grows as the number of controller belief states increases. The example that we consider in this paper is a case of two servers where the environment of each is modulated like a Gilbert-Elliot channel. As simple as this case seems, there appear to be no closed form descriptions of the stability region under the various regimes considered. However, the numerical approximations to the POMDP Bellman equations together with the numerical solutions of the QBDs, both of which are in agreement, hint at a variety of structural results.
dc.publisher Springer Science and Business Media LLC
dc.rights Items in ResearchSpace are protected by copyright, with all rights reserved, unless otherwise indicated. Previously published items are made available in accordance with the copyright policy of the publisher.
dc.subject Science & Technology
dc.subject Physical Sciences
dc.subject Statistics & Probability
dc.subject Mathematics
dc.subject System stability
dc.subject POMDP
dc.subject Control
dc.subject Queueing systems
dc.subject Optimal
dc.subject Bellman equations
dc.subject QBD
dc.subject Information
dc.subject Markov models
dc.subject POLICIES
dc.subject math.OC
dc.subject math.OC
dc.subject math.OC
dc.subject math.OC
dc.subject 0102 Applied Mathematics
dc.subject 0103 Numerical and Computational Mathematics
dc.subject 0104 Statistics
dc.title The Role of Information in System Stability with Partially Observable Servers
dc.type Report
dc.identifier.doi 10.1007/s11009-019-09750-4
pubs.begin-page 949
pubs.volume 22 2021-10-21T06:44:54Z
dc.rights.holder Copyright: The author en
pubs.end-page 968
pubs.publication-status Published
dc.rights.accessrights en
pubs.subtype Working Paper
pubs.elements-id 740841
dc.identifier.eissn 1573-7713

Files in this item

Find Full text

This item appears in the following Collection(s)

Show simple item record


Search ResearchSpace