This paper proposes a variance upper bound based interval Kalman filter that enhances the interval Kalman filter based on the same principle proposed by Tran et al. (2017) for uncertain discrete time linear models. The systems under consideration are subject to bounded parameter uncertainties not only in the state and observation matrices, but also in the covariance matrices of the Gaussian noises. By using the spectral decomposition of a symmetric matrix and by optimizing the gain matrix of the proposed filter, we lower the minimal upper bound on the state estimation error covariance for all admissible uncertainties. This paper contributes with an improved algorithm that provides a less conservative error covariance upper bound than the approach proposed by Tran et al. (2017). The state estimates are determined using interval analysis in order to enclose the set of all possible solutions of the classical Kalman filter consistent with the uncertainties.