So, when should one leave a church? John MacArthur is helpful on this point. He advises (and provides biblical rationale) that you should consider leaving a church if:

1. Heresy on some fundamental truth is being taught from the pulpit (Gal. 1:7–9).
The leaders of the church tolerate seriously errant doctrine from any who are given teaching authority in the fellowship (Rom. 16:17).
The church is characterized by a wanton disregard for Scripture, such as a refusal to discipline members who are sinning blatantly (1 Cor. 5:1–7).
2. Unholy living is tolerated in the church (1 Cor. 5:9–11).
The church is seriously out of step with the biblical pattern for the church (2 Thess. 3:6, 14).
The church is marked by gross hypocrisy, giving lip service to biblical Christianity but refusing to acknowledge its true power (2 Tim. 3:5).
The church is characterized by a wanton disregard for Scripture, such as a refusal to discipline members who are sinning blatantly (1 Cor. 5:1–7).
[b]3. The church is characterized by a wanton disregard for Scripture, such as a refusal to discipline members who are sinning blatantly (1 Cor. 5:1–7).

4. Unholy living is tolerated in the church (1 Cor. 5:9–11).

5. The church is seriously out of step with the biblical pattern for the church (2 Thess. 3:6, 14).

6. The church is marked by gross hypocrisy, giving lip service to biblical Christianity but refusing to acknowledge its true power (2 Tim. 3:5).

Even if it does become clear that leaving is best for us or our family, our attitude must be chastened and humble on the way out.