Manasara 19.8

19.8

āyatākāradhiṣṇyaṃ vā vaniteti prakīrtitam
puṃvimāne puruṣaṃ vanitāyāṃ vanitāṃ kṣipet

Or an oblong-shaped dwelling is proclaimed as female; / in a male temple tower one should place a male [deity], in a female one a female [deity];