Our favorite part of our honeymoon was our week in Paris. We had just spent a month lugging two huge bags around Europe and when we finally arrived at our little apartment it felt like we had come home.
We rented an apartment in Montmartre right above a little butcher shop. We watched movies, cooked at home and walked around the city stopping into random bars for a glass of wine or beer. We barely went outside of our 18th arrondissement except for twice to see the Eiffel Tower and the Arc de Triomphe and then another time to do some vintage shopping in Marais.
We didn't keep track of the names and places, but our advice is to rent a place and enjoy the city. Get bikes and ride around. Go out to dinner and relax. Just don't try and see everything at once. Just remind yourself this is going to be one of many trips to this wonderful city.