In the ACP I left the Reverse Order disabled. I then enabled it and it didn't change the order of the chat.
In my user setting I have Reverse Order unchecked.
By default the order should have changed when I adjusted the setting in ACP.
By the way, if Reverse Order is disabled in the ACP, do new chats appear on top or on the bottom?