Have you been able to watch during the warmest part of the day? If you leave for work before it warms and get home during the cooldown, your little bee buds will be dormant until it's warm enough.
Keep the faith, the critters will come and them fritters are yum!