%0 Journal Article %T Cell range expansion using distributed Q-learning in heterogeneous networks %A Toshihito Kudo and Tomoaki Ohtsuki %J EURASIP Journal on Wireless Communications and Networking %D 2013 %I %R 10.1186/1687-1499-2013-61 %X In this article, we propose a scheme to determine the bias value of each UE by using Q-learning algorithm where each UE learns its bias value that minimizes the number of outage UEs from its past experience independently. Simulation results show that, compared to the scheme using optimal common bias value, the proposed scheme reduces the number of outage UEs and improves network throughput. %U http://jwcn.eurasipjournals.com/content/2013/1/61/abstract