The Buddha stated in SN 6.2 that he doesn't have a teacher but instead look up to the Dhamma, and in MN22 he states:
Bhikkhus, when the gods with Indra, with Brahmā and with Pajāpati seek a bhikkhu who is thus liberated in mind, they do not find anything of which they could say: ‘The consciousness of one thus gone is supported by this.’ Why is that? One thus gone, I say, is untraceable here and now.
If the Buddha pointed more to Dhammaism than Buddhism, is taking refuge in the order of Buddha, Dhamma, Sangha - placing the messanger in the position of the message - a mistake along the lines of idolatry?