# Differing results from pumas versions

**URL:** https://discourse.pumas.ai/t/differing-results-from-pumas-versions/888
**Category:** Estimation
**Created:** [June 14, 2023, 8:52pm UTC](https://discourse.pumas.ai/t/differing-results-from-pumas-versions/888 "2023-06-14T20:52:02Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Blangev1](https://avatars.discourse-cdn.com/v4/letter/b/58f4c7/32.png) [@Blangev1](https://discourse.pumas.ai/u/Blangev1)
#### Post date: [June 14, 2023, 8:52pm UTC](https://discourse.pumas.ai/t/differing-results-from-pumas-versions/888/1 "2023-06-14T20:52:02Z")

</div>

Hello,  
When running an old analysis of drug y ( last run in September of 2021) I have gotten a different result for my Clearance values ( an about 5% difference in the typical value). I then plotted the old individual clearance values against the new individual clearance values and got a graph that was less tight than expected. Is this expected across these version changes/ is there a possible explanation? (Data has been confirmed to be the same and overall model did not change).  
 ![clearance question](https://canada1.discourse-cdn.com/flex030/uploads/pumas/original/1X/d583d3700b6f3c83d2b63d60ebd999f44671c67e.jpeg)  
Thank you in advance for your help!

---

<div class="post-metadata">

### Author: ![andreasnoack](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pumas.ai/andreasnoack/32/22_2.png) [@andreasnoack](https://discourse.pumas.ai/u/andreasnoack)
#### Post date: [June 15, 2023, 6:50am UTC](https://discourse.pumas.ai/t/differing-results-from-pumas-versions/888/2 "2023-06-15T06:50:19Z")

</div>

Hello Brooke,

We generally don’t expect results to change from one release to the next but sometimes we introduce improvements to e.g. the accuracy of the derivatives of the objective function or introduce a more efficient ODE solver. In rare cases, we might also fix bugs that could affect results. The more fundamental problem is that nonlinear mixed effects models are fairly sensitive. This means that relatively minor changes to how things are calculated might cause noticeable changes to the estimates. It’s hard or impossible to say if one of the results are more correct than the other. Their difference might just be a reflection of the sensitivity of the model. In particular so when the model has many parameters and relatively few observations. It might be beneficial to compare predictions from the old run and the new run. Predictions tend to be less sensitive than the parameter estimates.

Best  
Andreas Noack

---

<div class="post-metadata">

### Author: ![Blangev1](https://avatars.discourse-cdn.com/v4/letter/b/58f4c7/32.png) [@Blangev1](https://discourse.pumas.ai/u/Blangev1)
#### Post date: [June 15, 2023, 12:47pm UTC](https://discourse.pumas.ai/t/differing-results-from-pumas-versions/888/3 "2023-06-15T12:47:55Z")

</div>

I see, thank you very much.
