Based on Chapter 21, why did the author of the Satcharitra initially refuse to visit the saint in Bandra?

In Chapter 21, the author, Hemadpant, shares a personal story about his time as a Magistrate in Bandra. He was repeatedly urged by a man named Inus to visit a famous Siddha, Pir Maulana. Hemadpant reveals that he refused to go because he felt it was beneath his prestige and he did not want to be pressured by others into going where thousands of people went. He later reflects on this decision, attributing his reluctance not to pride alone, but to 'ill-luck' that stood in his way, preventing him from attaining the saint's vision at that time.