Ireland native Robert Miller and Scotland native Janet Todd married in Glasgow, Scotland, on December 28, 1829. They moved to New York before 1837 and lived in Warren County, Pennsylvania, by 1850. Two of their sons served in the Union Army during the Civil War: James T. Miller (111th Pennsylvania Infantry Regiment) and Robert E. Miller (151st Pennsylvania Infantry Regiment).
James T. Miller was a private in Companies B and D of the 111th Pennsylvania Infantry Regiment from 1861 until his death after the Battle of Peachtree Creek on July 20, 1864. He married Susan A. Main (February 16, 1829-May 10, 1919) on April 22, 1857, and they had two children, Ellen (b. 1857) and Robert J. (b. 1859). After his death, she lived in Cherry Creek, New York, where she married Civil War veteran Cyrenius Hall on May 20, 1869.