Could it be that your phone is not compatible with passkeys? E.g. many Android phones don't have a TPM, isn't that a requirement for passkeys on Android?

As I said, it just works with iPhones and Yubikeys.

Oddly, passkeys work on my phone on the Nintendo site, of all places. I can't seem to get it to work on Github. So it does work, just not everywhere.