I come from an interracial family: My father is from Nigeria, and so he is African-American, and my mother is American and white, so I rarely see skin color. It's never an issue for me.
If you go too soon, you can come unstuck with 50m left when the guys are going past you.