I read about someone named Bhagwantrao Kshirsagar. Why did Sai Baba say he was keeping both Vitthal and Baba hungry?

The story of Bhagwantrao Kshirsagar in Chapter 4 illustrates Sai Baba's deep concern for a devotee's spiritual duties. After his father, a great devotee of Vitthal and a friend of Baba's, passed away, Bhagwantrao stopped the family traditions. He ceased the daily worship and food offerings (Naivedya) to the household Vitthal idol and even skipped the annual death anniversary ceremony (Shraddha). When Bhagwantrao came to Shirdi, Baba said, "He never offers food (Naivedya); he keeps me hungry too. He keeps Vitthal hungry too." This was Baba's powerful way of reminding Bhagwantrao of his neglected responsibilities and guiding him back to the path of devotion his father had followed.