Are the fees deducted by Faisal Islamic Bank of Egypt for withdrawing money from an ATM belonging to another bank considered usury?

There is no harm in the bank deducting a fee for using an ATM not belonging to it, and this is not considered usury (riba). This is because it is a fee in exchange for the service of using the bank's ATM. These machines have a cost, and their owners are entitled to a fee from those who use them.