Lascoux and Schützenberger introduced Schubert and Grothendieck polynomials to study the cohomology and K-theory of the complete flag variety. We present explicit combinatorial rules for expressing Grothendieck polynomials in the basis of Schubert polynomials, and vice versa, using the bumpless pipe dreams (BPDs) of Lam, Lee, and Shimozono. A key advantage of BPDs is that they are naturally back stable, which allows us to give a combinatorial formula for expanding back stable Grothendieck polynomials in terms of back stable Schubert polynomials. We also provide pipe dream interpretations for the rules originally given by Lenart (Grothendieck to Schubert) and Lascoux (Schubert to Grothendieck), which were previously formulated in terms of binary triangular arrays. The key connection between the pipe dream and BPD change of basis formulas is the canonical bijection of Gao and Huang.