See my book Jesus, Mary, and Joseph: Family Trouble in the Infancy Gospels (Philadelphia: Univ. of Pennsylvania Press, 2017).