These thoughts are gathered from the before, during, and after of a workshop I led as part of a data visualization conference. Whether LLMs stick around or not, evaluating them through the lens of data visualization has changed the way I interact daily with these and other tech products. If we choose to (or must) use the technology for data visualization work, how do we mitigate these harms? If we choose to (or must) use the technology for data visualization work, we can mitigate some of this harm with pointed questions. This is the part that has drawn so many creative, critical, analytical thinkers to data visualization in the first place.