The standard date library stores both date and datetime instances as three separate pieces of data. The first is the ajd, better known as the Astronomical Julian Date.
There are two reasons why using the Astronomical Julian Date is slow. The first is that most users are going to be entering dates using the standard Gregorian calendar of years, months, and days, so you need to do a fairly expensive conversion calculation just to instantiate the object.