Believers are to follow peace with all men. So, the person who fights against you may be a believer, but they are not a follower of Christ.