From a career point of view, it is probably not the worst idea ever. If he is hanging up his Tom Ford suit and Walther PPk, he's leaving at a relative high. I know some people didn't like SPECTRE, but it did okay and it didn't get Die Another Day levels of critical derision.
He's probably as well to make the break from Bond. There will always be a certain level of typecasting for anyone in that part, but he's probably the best actor to have played the role. He had a pretty diverse CV before he did Casino Royale and hopefully he can do the sorts of things that he wants to do now.
Also, you don't want to overstay your welcome. Much as I have a fondness for Roger Moore, he looked far too old for it by the time he was doing A View to a Kill.