Finance and Business Is it biblical to baptize a baby? Is it biblical to baptize a baby? Based on their understanding of New Testament passages such as Colossians 2:11–12, Christians who baptise infants believe that infant baptism is the New Testament counterpart to the Old Testament circumcision.