Hmmm, but unless James had some special significance that hasn't been revealed yet, he was probably waiting to kill Harry to make his Horcrux--he only planned for seven, after all. Methinks he would've considered James too unimportant--getting rid of a pesky thorn in his side on the way to the real prize. But it's possible.