It's not justified by the suttas. Karaniya Metta Sutta gives instructions for the performance of metta. (Metta is the basis of Buddha's noble path.)
This is to be done by one skilled in aims who wants to break through
to the state of peace: Be capable, upright, & straightforward, easy to
instruct, gentle, & not conceited, content & easy to support, with
few duties, living lightly, with peaceful faculties, masterful,
modest, & no greed for supporters.
Do not do the slightest thing that the wise would later censure.
-- Karaniya Metta Sutta: Good Will
So how can one begin to transgress the path is such a wealth-amassing atmosphere with his mind focused on wealth? However, one can be living with all kinds of luxuries and be a self-realized sage. Krsna explained this to Arjuna in the second chapter of Bhagavad-gītā.
"Arjuna said: What are the symptoms of one whose consciousness is
thus merged in Transcendence? How does he speak, and what is his
language? How does he sit, and how does he walk?"
"The Blessed Lord said: O Pārtha, when a man gives up all
varieties of sense desire which arise from mental concoction, and when
his mind finds satisfaction in the self alone, then he is said to be
in pure transcendental consciousness. One who is not disturbed in
spite of the threefold miseries, who is not elated when there is
happiness, and who is free from attachment, fear and anger, is called
a sage of steady mind. He who is without attachment, who does not
rejoice when he obtains good, nor lament when he obtains evil, is
firmly fixed in perfect knowledge. One who is able to withdraw his
senses from sense objects, as the tortoise draws his limbs within the
shell, is to be understood as truly situated in knowledge. The
embodied soul may be restricted from sense enjoyment, though the taste
for sense objects remains. But, ceasing such engagements by
experiencing a higher taste, he is fixed in consciousness. The senses
are so strong and impetuous, O Arjuna, that they forcibly carry away
the mind even of a man of discrimination who is endeavoring to control
them. One who restrains his senses and fixes his consciousness upon Me
is known as a man of steady intelligence." -- Bhagavad-gītā 2.54-61
The justification comes from one's self. Arjuna asked Krsna what are the symptoms of the self-realized human being? Arjuna inquired about the external symptoms. Can his transcendental state of consiosunsess be recognized by external symptoms, seen with material senses? Is his transcendental state of consciousness reflected on his external actions?
Krsna replied from the point of view of consciousness or internal, subjective self-awareness. Real symptoms are seen in the quality of consciousness. This means one can be extremely materially opulent and still be situated in transcendental consciousness. On the other hand, one can be fooling himself by living like a hermit in a cave but actually contemplating the object of sense gratification. See?