Are these feelings, which appear as shivers or a burning sensation in the heart upon remembering Allah, or sending blessings upon His Messenger, or reciting the Quran, or performing acts of worship, good or evil?

This feeling of love and goosebumps when Allah is mentioned and the Qur'an is recited is a sign of faith, and it is a piece of paradise on earth. Continue in this state and ask Allah for steadfastness, while noting that the love of Allah is not called 'ishq (passionate love/infatuation).