Asymmetric Clustering in Federated Continual Learning