This document presents two stochastic inventory models (Models A and B) with randomly varying environments. Model A has a maximum demand size (M) that is greater than the maximum supply size (N) across environments. The state of the inventory system is represented by a continuous time Markov chain. Model A's infinitesimal generator matrix is partitioned into blocks to exhibit a matrix geometric structure. Stationary probabilities, expected values, and variances are derived for the number of demands waiting and inventory levels using the matrix geometric results.