You might have low cranking amps.
If you bought a cheap battery it might be struggling to run your car on the first start.
That might be why it started fine after your long drive.
Post up your spec on the battery
Is say this because it sounds all the same problem I have experienced before.