In a highly unusual case pending before the Supreme Judicial Court, an order of nuns is suing Cardinal Sean P. O’Malley, the Roman Catholic archbishop of Boston, after years of trying in vain to withdraw from a church-run pension fund.