1: \begin{abstract}

2: From large-scale organizations to decentralized political systems, hierarchical strategic decision making is commonplace.

3: We introduce a novel class of \emph{structured hierarchical games (SHGs)} that formally capture such hierarchical strategic interactions.

4: In an SHG, each player is a node in a tree, and strategic choices of players are sequenced from root to leaves, with root moving first, followed by its children, then followed by their children, and so on until the leaves.

5: A player's utility in an SHG depends on its own decision, and on the choices of its parent and \emph{all} the tree leaves.

6: SHGs thus generalize simultaneous-move games, as well as Stackelberg games with many followers. 

7: We leverage the structure of both the sequence of player moves as well as payoff dependence to develop a gradient-based back propagation-style algorithm, which we call \emph{Differential Backward Induction (DBI)}, for approximating equilibria of SHGs.

8: We provide a sufficient condition for convergence of DBI and 

9: demonstrate its efficacy in finding approximate equilibrium solutions to several SHG models of hierarchical policy-making problems.

10: \end{abstract}

11: