The Victor Haydel Creole Family, Family History