Is there a way to lock a filter in a pivot table but still allow users to add fields?

There is ONE FIELD that I need locked so that users cannot remove it from the pivot table. I have one large source of data in Excel and the field filter dictates what users have access to.

I already know how to turn off the selection so that they can't change the field, but if the field is moved away from the pivot table field list, all of the data is visible.

I want the pivot table to still be usable, filtering and adding other fields.

Any ideas, macros, or alternate suggestions?