I would. Just because 1) it's not very difficult to do and you can do it now when the time fits into your schedule. 2) one of these days you'll forget to check your diff fluid and then possibly melt a bearing. Or 3) it could suddenly get worse.
I would degrease the area and make sure it's definitely the seal (not oil from something else). Sure looks like the seal, but I've been fooled before.