Rennie called for two qualities from his All Blacks, brutality and optimism, and they produced both but only in patches at One New Zealand Stadium in Christchurch on Saturday.
Errors of execution and discipline forced by an ambitious and relentless French team stripped of many of their leading players meant New Zealand were unable to secure their win until the dying seconds.
Scrumhalf Cam Roigard and winger Will Jordan scored two tries each as the All Blacks posted five tries to four, extending their winning streak at home against France to 17 years.
France rocked New Zealand with a try by winger Damien Penaud after two minutes in a movement which led to a yellow card for new All Blacks flyhalf Ruben Love.
The All Blacks then scored with 14 men to set alight a thrilling contest in which the lead see-sawed and France gave the hosts no breathing space.
Jordan's second try gave the All Blacks their peak lead at nine points with 10 minutes left but a final try to Matthieu Jalibert two minutes from the end cut the lead to two points and made the dying moments nail-biting.
"We played the best team in the world and the difference was only little details," France captain Maxime Lucu said. "The score was 34-32, it's nothing really. It's disappointing but we worked really hard."
Despite their constant attacking intent, errors induced by pressure and by the immaturity of new combinations prevented the All Blacks ever taking full control.
"It was tough. The French were quality tonight," All Blacks captain Ardie Savea said. "When we had the ball in our hands we were dangerous but there's a lot to work on in our defence."
France caught the All Blacks flat-footed with Penaud's opening try and when the TMO found Love guilty of a dangerous high tackle the All Blacks were 7-0 down and minus a player for 10 minutes.
New Zealand responded magnificently with a try in the eighth minute by Jordan after Savea won a penalty from a ruck turnover near the French line.
Lucu's 14th-minute penalty gave France a 10-5 lead but New Zealand rallied and produced a superb try finished by backrower Peter Lakai after a scrum inside their own 22.
Lucu recovered the lead with his second penalty but New Zealand's high tempo style, hard-running and quick ruck ball began to open opportunities.
From a lineout five metres out Roigard's shoulder fake sent the French defence wide, allowing him to score on halftime.
France scored first in the second half through Antoine Hastoy, who was freed by superb passing in close quarters by Jalibert and Theo Attisogbe.
The All Blacks replied in kind, with Roigard's second try coming from close passing.
Attisogbe then scored off Fabien Brau-Boirie's pass which cut New Zealand's lead to 26-25 and on the All Blacks' next, rare incursion into French territory, Love kicked a penalty to make it 29-25.
Jordan's second try in the 70th minute from an opportunity created by a counter-ruck seemed to give the All Blacks breathing space at 34-25 before Jalibert added the last try of the match.
