Is taking working computer parts from the workplace without the administration's knowledge considered theft? And is using the computer that contains these parts unlawful (haram)?

It is not permissible to take usable parts from inoperable computers at work without the permission of the responsible authority, because they can be repaired or sold, and they have value. It is obligatory to return what was taken or to seek permission from whoever has the authority to grant it.