Fix:
After some initial troubleshooting, found out this binary hotfix in LCS, which fixes the following issue
https://fix.lcs.dynamics.com/Issue/Resolved/1118984?kb=3158762&bugId=3747718&qc=c33425bb1af0b37d6b1bdb5479e6693e13172c3a728756035b530422e296d3a8
Once you download the hotfix, just run it using the AXUpdateInstaller. It takes few mins depending on your AOS topology and servers to run this update.
Word of caution - As with any hotix (be it application or binary, always test on your TEST instances and leave it running for couple of weeks, monitor and only then deploy the hotfix to your PROD)
Notes form the hotfix description in LCS:
PROBLEM
After you apply the kernel hotfix KB3133925, when you execute the Automatic role assignment function, you receive the following error message:
"Duplicate request to load user role mappings detected."
DESCRIPTION OF CHANGE
The changes in the hotfix add the "AutoSkipXdsGeneration a_SkipXDS(ip);" line to start of AuthenticationContext.LoadRoles to ensure you can execute the Automatic role assignment function without any error messages.
