Amelia L. Lippincott was born in New York City on September 19, 1814, the daughter of William and Hannah Lippincott. She had 8 siblings: Benjamin, Clemence, William, Shepherd, John, Charles, Rachel, and Harriet. She attended the Moravian Seminary for Young Ladies at Bethlehem, Pennsylvania, in 1825. Her father owned land in Shrewsbury Township, New Jersey, and she occasionally vacationed at Red Bank, New Jersey, where she met Esek Hartshorne Williams, her future husband. They married in 1834 and lived in New York City and New Jersey, where Esek worked as a merchant. They had 7 children: William, George, Anna, Edwin, Bessie, Esek, and Benjamin.