1: \begin{abstract}

2: This paper investigates the energy-efficient power allocation for a two-tier, underlaid femtocell network. The behaviors of the Macrocell 

3: Base Station (MBS) and the Femtocell Users (FUs) are modeled hierarchically as a Stackelberg game. The MBS guarantees its own QoS requirement

4: by charging the FUs individually according to the cross-tier interference, and the FUs responds by controlling the local transmit power 

5: non-cooperatively. Due to the limit of information exchange in intra- and inter-tiers, a self-learning based strategy-updating mechanism is 

6: proposed for each user to learn the equilibrium strategies. In the same Stackelberg-game framework, two different scenarios based on the 

7: continuous and discrete power profiles for the FUs are studied, respectively. The self-learning schemes in the two scenarios are designed 

8: based on the local best response. By studying the properties of the proposed game in the two situations, the convergence property of the 

9: learning schemes is provided. The simulation results are provided to support the theoretical finding in different situations of the proposed 

10: game, and the efficiency of the learning schemes is validated.

11: \end{abstract}

12: