The important part about sleep is that it is quality sleep at a time when your brain expects to sleep. Quality of sleep is far more important than the time of sleep or even duration of sleep. Your brain cycles through the stages of sleep best during your normal sleep times (circadian rhythm)

I go to sleep at about 2 am most nights. I get great sleep and wake between 7 and 8 am, refreshed. Some nights, I might be sleepy at 1 am.

I you don't fall asleep within 5 minutes of laying down, your brain is not ready to sleep. Learn about sleep hygiene and practice it daily. It can take months to establish a quality sleep pattern.