Another thing I've come across before:
Do you have an external signal from a seperate supply (common ground)
that goes into the PIC and is it on or switching when you power up? Such
as a PWM signal or serial comms. This has stopped my PICS from starting
up.

Quentin