Pages

Tuesday, July 23, 2013

Precision and Rounding Calculation Results

Greetings,

The results of a calculation must not be more precise then the least precise data used.  In other words, the result of a calculation will have a number of significant figures (or decimal places for addition or subtraction) matching the lowest number of significant figures (or decimal places) in the problem.  It's  important to note that definitions and counted objects have an unlimited number of significant figures and therefore cannot limit the precision of a calculation result.  Counted among the definitions are conversions between metric prefixes of the same base unit and certain fundamental relationships; e.g. 2.54 cm = 1 inch and 1 cubic centimeter = 1 milliliter (mL).  

The following presentation shows the rounding rules described above.




That's all for this post!  My next post will cover combined operations and rounding results when scientific notation values are present.

Have a Good One!


A Publication of http://www.ExcellenceInLearning.biz

No comments:

Post a Comment

Comments or Questions? Feedback is always welcome!