4 is pretty early but 10:40am is also just pretty late to wake up unless you're like, a teenager or something (or work odd hours). A lot of the day is already gone by then.
IMO it's nicest when you can keep your waking hours relatively close to the time the sun is up.