We give honour where honour is due Rom 13:7.
Peter is talking about seeing unbelievers as people for whom Christ died and so respect their potential, their value in Him. To literally honour an unbeliever is to enable their rebellion by making them comfortable, confident and SelfAssured.
In the same sense, we love unbelievers based on their potential in Christ. Whereas we love fellow believers as part of ourselves.
God loves them that love Him Pro 8:17.