New Year celebrations started in ancient Babylon around 4000 years ago, and it was held in late March. Then over centuries, the Romans chose January 1 as the first day of the year, and initiated the tradition of decorating homes and exchanging gifts.