Detailed description can be found here.
The most important part, easily overread:
The email address for your IdP users must be matching the Snowflake LOGIN_NAME value for the user.
If not, you'll end up with an error looking like this:

for the respective user when they try to log in.