Adam Philip Lipsic, Family