Text this: Bath-induced correlations in an infinite-dimensional Hilbert space