The identity of Pearl's father is still unknown, so who would take care of Pearl if she gets taken away? Yes, she could go to another family, but Pearl is all Hester's got. In Chapter six, I quote
"Heart-Smitten at this bewildering and baffling spell, that so often came between herself and her sole treasures, whom she had bought so dear, and who was all her world..."(Hawthorne 75). Hester