“The code you supplied is not valid.” message on server

Problem: “The code you supplied is not valid.” is displayed, when I try to do 2 factor on prod server.
This works on the local copy of the prod server. How can I trouble shoot this?

Steps:
1. Choose 2 factor mobile

2. Download google authenticator

3. Scan the QR

4. Enter the code from the google authenticator

This works locally. I check the plugin setting and those are identical. This is a multisite.
Please help