Django, MySQL, Time zones and how to fix it

I just stumpled upon an error while customizing the Admin in a new Django project where I first used Django 1.6:

Database returned an invalid value in QuerySet.dates(). Are time zone definitions and pytz installed?

After using my favourite search engine to get an idea what this means and ensuring I had pytz installed, I didn’t find anything which solved my problem.

…