Swollen Stretched Ears?

Ok, so last night i took my 4g plugs out to wash my lobes. I took the right one out and it's all good. Then I pulled the left one out and I think I accidentally pulled it out too quickly. The back of the plugs that the o-ring is supposed to wrap around scuffed the inside of my ear and when I look inside the hole I can see torn skin. Like it's peeling the inner circumference of my stretched hole. So, its obvious that I torn the inside of my ear a little bit. So I got some neosporin and put some on my ear. I put the plugs back in afterwards. But now it's swollen! When I touch the lobe it does not hurt whatsoever. But it's definitely swollen and when i feel my lobe it feels like there's something inside it. I figured this would go away in a few hours seeing as I just tore my skin a little bit. But I woke up this morning and it's still a little swollen, it's improved since last night. But is this normal? Anyone ever experience something like this?