Both MI and LSI are dimensionality reduction techniques, MI is looking to reduce dimensions by looking at a subset of the original dimensions and does feature selection w.r.t. a classification task.
Content-Based recommending is based on information on the content of items rather than on other users' opinions, while collaborative filtering can think of users as vectors in the space of items.
