For collaborative filtering, the average of all the ratings of a user is used as a sort of midline to relate the rating to other users. The justification for this is that some users are harder to please and will rate things lower than other people in general.
-James Cotter
