As a young minister in my early 20s, I was often admonished by the senior ministers to keep a guarded distance from laypeople. To get too close, they would say, is to become too familiar with a resulting loss of one's ministerial authority. They thought authority was protected by distance and diminished by relationships.
Oh, I think flower gardens are a lovely way to spend one's time. They add a little beauty to our world, and make for a wonderful visiting place for our beleaguered pollinators. I can see the delight in that.