Looking at the average, you really can't judge any draft past 2012 because players have yet to hit their prime years.
But 2005-2012 were bad years for the Phillies, and set them up for failure for the rest of the decade.
As a big money team, they don't have to be a top 5 team, but they have to be above average to maintain long-term success. When you spend a decade in the bottom third, it reverberates for another decade (not just the lack of performance, but the lack of tradeable assets).