What was Sai Baba's initial reaction to the Madrasi sannyasi, as described in Chapter 31?

Chapter 31 describes a confusing initial encounter for the sannyasi Vijayananda. After feeling pleased upon taking Sai Baba's darshan and prostrating at His feet, the sannyasi witnessed a sudden change. The text states that Baba's disposition was disturbed, and He abruptly said to the assembly, "send away this sannyasi; there is no companionship for work." Since Vijayananda was new to Shirdi and did not understand Baba's unique nature, he became distressed at heart by this seemingly unwelcome reception, even as he sat and watched the proceedings.