Is it normal to bleed everytime you've been fingered?

My boyfriend started about a month or two ago and everytime he does it for the most part it bleeds. I thought it usually just bleeds the first time but its happening alot more frequently now. When he did it to me yesterday (well he did it several times) it started bleeding quite a bit. Also, when i woke up this morning i had blood stains on my pj's. BTW it is not my period, i just finished my period like a week ago. So is somthing going on? Is this serious? Should me and my boyfriend stop doing this?