and git annex copy --to <remote> still asks for the remote's password. I've checked and I can ssh into the remote using that key with no problems, here's the --debug output:
Once it has asked for the password twice, it starts using the rsync options correctly to copy and the password is no longer needed, until the next "checking remote…". Maybe the "checking remote…" part ignores the configuration?
### What steps will reproduce the problem?
Use an rsync remote with annex-rsync-transport config set.
### What version of git-annex are you using? On what operating system?