Algorithms increasing the transparence and explain ability of neural networks are gaining more popularity. Applying them to custom neural network architectures and complex medical problems remains challenging. In this work, several algorithms such as integrated gradients and grad came were used to generate additional explainable outputs for the classification of lung perfusion changes and mucus plugging in cystic fibrosis patients on MRI. The algorithms are applied on top of an already …