Medical data arise from the complex interaction between patients and healthcare systems. This data-generating process often constitutes an informative process. Prediction models often ignore this process, potentially hampering performance and transportability when this interaction evolves. This work explores how current practices may suffer from shifts in this clinical presence process and proposes a multi-task recurrent neural network to tackle this issue. The proposed joint modelling performs similarly to state-of-the-art predictive models on a real-world prediction task. More importantly, the approach appears more robust to change in the clinical presence setting. This analysis emphasises the importance of modelling clinical presence to improve performance and transportability.