Removing recent membership config doesn't remove settings

When loader configuration is set initially to be "recent memberships" and saved. Attempts to remove this configuration via the UI fail. You are able to set it back to "No, doesn't have loader configuration" but when you save and then open again the result is that it is set back to "Yes, has loader configuration". This appears to coincide with what is in the database also.