Born Marjorie Lee in Memphis, Tennessee, the future mathematician was a skilled tennis player and singer as well as showing early signs of mathematics talent. Her father, Lawrence Johnson Lee, was a railway postal clerk, and her mother died when Browne was two years old.