[2.1.x] Reverted "Fixed #29324 -- Made Settings raise ImproperlyConfigured if SECRET_KEY is accessed and not set."

This reverts commit b3cffde5 due to
a regression and performance concerns.

Backport of 5cc81cd9 from master