We need to do this now because we now store the group field data directly
in the pivot cache, which is shared by all referencing tables.

Also, actions involving modification of the cache is not undoable, and
making it undoable would significantly increase Calc's runtime memory
footprint.  So, no way.