Hope this helps someone.
So I had an unfortunate incident where I pulled the entire front moving part of the handle out of the handle base. The part that connects to the rods was still attached. With no way to get it back in except for removing the chrome handle, that's what I opted to do. However, after pulling unscrewing the chrome part of the handle and popping the handle "frame" back in, I found get the chrome part screwed back in. So I finally got a chance to fix it. I discovered all you have to do to get the inside panel off far enough to get at the handle really is to remove all the bolts that hold it on, about 13, pop the clips that hold the rods on, remove the speaker. Roll the window down until the clips are in both windows, push the clips in on both sides and pull up the window and tape it to the top of the door. Then you can pull the inside door panel out enough to get to the handle.
I followed most of this video until I got to the part where they started popping wires off. I had to drill a hole through the back of the handle to get the screws through and back into the chrome part of the handle.