Is the ruling on Murabaha selling, in which the commodity does not physically enter into the seller's possession, and in which the purchase is made in installments at a price higher than the cash price, considered a sale of money for money with a commodity between them, or does it fall under the category of Riba (usury)?

That transaction is a murabaha sale due to the fulfillment of its conditions, including the company's ownership of the commodity. It is not necessary for the commodity to be moved from the store to the company for ownership to be established; what is important is for the commodity to enter into the company's possession. What Sheikh Ibn 'Uthaymeen (may Allah have mercy on him) said regarding the prohibition of a transaction in which the car did not enter into the possession of the installment provider is true, but this is different from our case. As for the two examples mentioned in the question, they are not murabaha sales; rather, they are usurious loans from the bank, which are forbidden to take and deal with.