I dont think its that much uncomfortable. U can get buses, taxis plying from 4 am onwards from Hwh..
There are much more prestigious trains than JU-HWH express like MAS mail, TPJ-Hwh express, Azad Hind express etc.. they reach around 4 am. Its not such a big deal