Interpretability of Deep Models Across different Architectures and Modalities