Is it permissible to withdraw money from a non-Islamic bank to save on costs, knowing that the salary is deposited into an Islamic bank, and is this considered dealing with a usurious bank?

There is no harm in withdrawing cash from usurious banks if the actual dealing is with an Islamic bank, because the usurious bank does not benefit from your money. It is better to avoid dealing with usurious banks as much as possible.