Or try this: Immediately bag up the core from the fruit you were eating so that it's sealed in an airtight manner. Make sure you wash your hands and around your mouth when you get done. That might be part of it. You could be leaving enough of the scent of the fruit on you that the flies can still 'smell' it even though you can't or aren't even aware of it!