Augmented Reality based Calorie Counter

Imagine that you can point your phone to the things you eat for starter let say fruits, and it identifies what it is and gets you the calorific value. So in a day you will have photo journal of all the foods you have eaten along with the corresponding calories you have already consumed. For this you would be required to implement an content based image retrieval system that is being populated by the users of the app.