95 civic door panel removal

ok i know there is 1 plastic screw and 1 screw in the door where the automatic window switch is.......and thats it so far.....but what i cant figure out is how to get the door handle and lock plate off.....that little piece of plastic that surrounds the handel.......no screws and it feels like it might break it i pull too hard......can anyone give me info on removing the panels