JAPSPECGTUs

I was looking into my e-shaft b/c I couldn't fit the new PB in. I saw a chunk of the inner race in the back of the space. So I removed it and I belive the outer race is stuck. Did it explode or something?! See I blew my motor, took it out sent it off to be rebuilt, got it back several months later I am attempting to put a PB in and this happens. I rented a tool from Autozone and well, I don't want to be too harsh or too docile with removing the outer race. I have never done this before so...any advice? Thanks.