Your gaps are coming together beautifully. I think most of us at this stage have the same problem with re-pop sheet metal, but as you found it seems like the more you take the panels off and put them back on the more tweaking you do and can end up getting them fairly close.
Keep at it.