If you don't already own a digital multimeter, they're an invaluable device for troubleshooting during home repairs and especially automotive adventures.
While this relay has a high probability of being the source of your grief, there are other possibilities as well.
Parts replacement without analysis falls into the parts cannon methodology which is often expensive, not to mention, could potentially be a waste of time and money.
inexpensive digital multimeters
Many of the members here can assist you with troubleshooting and use of a DMM.
,