We study in this article the problem of model risk in VaR computations and document a procedure for correcting the bias due to specification and estimation errors. This practical method consists of “learning from model mistakes”, since it dynamically relies on an adjustment of the VaR estimates – based on a back-testing framework – such as the frequency of past VaR exceptions always matches the expected probability. We finally show that integrating the model risk into the VaR computations implies a substantial minimum correction to the order of 10–40% of VaR levels.