Calculation Rounding Error/Examples

From ProofWiki
Jump to navigation Jump to search

Examples of Calculation Rounding Errors

Arbitrary Example

Consider the equation:

$x = \dfrac 1 {1 - \cos 1 \degrees}$

Evaluating the calculation while rounding to $4$ decimal places gives:

$x = 5000$

but the true value is $6565.8$ to $1$ decimal place.

Hence the calculation rounding error of this calculation is $1.6565.8$, or some $24 \%$ or $31 \%$ relative error, depending on how the latter is calculated.