You have to do what works for you. Having them give advice is great but if it doesn't work for you, it doesn't work. As a former yo-yo dieter who used to always only need to lose 10 pounds and never could while listening to what diet "gurus" had to say, followed my own path and have lost almost 20 pounds and kept it off.

Trying to get the weight off is hard enough by itself, you shouldn't have to be not feeling good while doing it. Three pounds is great! I believe weight loss is individual. As long as you're healthy during your weight loss journey, what difference does it make that they feel you are not eating enough.