I felt that a few times while in a really bad flare. Not sure, but am thinking it maybe a sign that you're badly inflamed right now. Once the inflammation goes down, the sensation should. However, if it becomes bothersome I'd ask your advice nurse.
If I remember right, soaking in the tub might help some though...