Markov route decision in embedded communication middleware

Combining with the theory of Markov decision process, a finite horizon model to resolve the routing problem is established in view of the features of embedded equipment interconnection environment and embedded communication middleware. The backward recursion iterative algorithm of Markov finite horizon model is modified, and Markov Finite Horizon Decision Routing (MFHDR) algorithm is then proposed. MFHDR algorithm is characteristic by distributed computing and self-studying, thus reduces work intensity of single embedded equipment, balances workload between each equipment, and has a better time and space complexity and is loop-free.