This is a dupe of a well known issue. We're working on an efficient way to persist the settings for all lists between sessions.
Closing out as per Jeff's request. The overall issue we want to direct people to is
CHD-1129 . So watch that for now to keep tabs on any progress.