Unknown to Lily, Petunia, Vernon, or Marge, Lily was adopted into the Evans family from the Dursley family as a baby. When Harry's young, Vernon finds out and that changes things because yeah, Harry's a freak, but he's a Dursley, and family is everything to Dursleys.