Changing fields in search dropdown list

Supplier%20Details

I am trying to modify the above to show an additional field (In this case, I’ve added a new column in the Supplier DocType and I’m referencing it in the Search Fields field in the DocType) from the available doctype fields so I’ve added the new column name to “Search Fields” under Customize Form. This doesn’t change the behaviour that I am seeing above. Is Search Fields the wrong place to add new columns to show in the dropdown? If not, is this a caching issue that I’m seeing?

ERPNext V11.1.5