DHCP conflict detection issue

I think you may be right. It is possible that originally they checked just by ICMP ping (compulsory by RFC) and now they are checking both ICMP and ARP (Optional by RFC). Reality is, that many devices refuse to answer ICMP on public interface so ICMP is not enough.
What makes me sad is, that I already saw a mobile phone refusing to answer ARP, unless it initiated the communication.