1: \begin{abstract}

2: Federated Learning (FL) recently emerges as a paradigm to train a global machine learning model across distributed clients without sharing raw data.

3: Knowledge Graph (KG) embedding represents KGs in a continuous vector space, serving as the backbone of many knowledge-driven applications.

4: As a promising combination, federated KG embedding can fully take advantage of knowledge learned from different clients while preserving the privacy of local data.

5: However, realistic problems such as data heterogeneity and knowledge forgetting still remain to be concerned.

6: In this paper, we propose \modelname, a novel FL framework for heterogeneous KG embedding learning and unlearning.

7: To cope with the drift between local optimization and global convergence caused by data heterogeneity, we propose mutual knowledge distillation to transfer local knowledge to global, and absorb global knowledge back.

8: Moreover, we present an unlearning method based on cognitive neuroscience, which

9: combines retroactive interference and passive decay to erase specific knowledge from local clients and propagate to the global model by reusing knowledge distillation.

10: We construct new datasets for assessing realistic performance of the state-of-the-arts.

11: Extensive experiments show that \modelname achieves superior results in both link prediction and knowledge forgetting.

12: \end{abstract}

13: