B.G 3.06 and 07
karmēṁdriyāṇi saṁyamya ya āstē manasā smaran। iṁdriyārthān vimūḍhātmā mithyācāraḥ sa ucyatē ॥6॥
yastviṁdriyāṇi manasā niyamyārabhatēSrjuna। karmēṁdriyaiḥ karmayōgamasaktaḥ sa viśiṣyatē ॥7॥
He, who restraining the organs of action keeps on contemplating the objects of senses in the mind, is entirely deluded and is rightly described as a hypocrite. But, O Arjuna, he who controlling the indriyas (i.e. organs of senses and organs of action) by the mind, employs the organs of action with detachment, is the special one.
Gīta Bhāshya 3.06 and 07
As per one's capacity, it is necessary to sacrifice (tyāga), i.e. to engage in Karma-Yōga. Karma-Yōga is performing prescribed duties with detachment and is meant for all, including ascetics. Mind is instrumental and must be controlled to develop detachment while acting.
tathāpi śaktitaḥ tyāgaḥ kāryaḥ ityata āha - karmēṁdriyāṇi iti। mana ēva prayōjakam iti darśayitum anvayavyatirēkau āha- "manasā smaran manasā niyamyā" iti। karmayōgaṁ svavarṇāśramōcitam। na tu gr̥hasthakarmaiva iti niyamaḥ। saṁnyāsādividhānāt। sāmānyavacanācca ॥6,7॥
Even then, as per one's capacity, it is necessary to sacrifice (tyāgaḥ). Hence, 'karmēṁdriyāṇi', i.e. "by organs of action" verse.
To show the mind alone is instrumental, it is explained both by affirmation and negation by stating - 'remembered with the mind' and 'controlled by the mind'.
The Yōga of action is to be pursued by performing duties as per one's occupation (varna) and stage is life (ashrama). It is not specifically meant only for householders, such is the rule. Even the ascetics have their own duties. The prescribed action here is generic, (hence applies to all).