From American Modernism to museum archives and the legacy of her artistic family, R.H. Quaytman telescopes time and place