Will my sin and what I swore to be forgiven, and how can I forget what I did and rejoice in my pregnancy?

As long as you have repented and turned to Allah, you are on the right path. So, trust your Lord and have a good opinion of Him. Be keen on looking forward to the future and doing good deeds therein. Do not leave any room for Satan to bring back any memories that would disrupt your life; rather, seek refuge with Allah from him, because "sadness is a disease of the heart that prevents it from rising, progressing, and striving." This is in addition to remembering the blessing of pregnancy and being keen on occupying your time with what benefits you in your religion and your worldly life. You should also discuss the relationship with your husband, and each of you should observe the etiquettes of enjoyment and the needs of the other.