‘It’s pretty clear that the character of the family you grew up in is more important than the color of your skin,’ one expert said.