state feedback; closed-loop system; Markovian switching systems; input constraint; state constraint; Hidden Markov model; numerical simulations