The existence of the periodic solution for neural networks of two neurons with McCulloch-Pitts type signal functions and oscillatory initial value was proposed. By using the resultant techniques and method of analysis, resultant conditions which ensure the existence of periodic solution of the system with sign change of initial value were established. Furthermore, the stability of the periodic solution of the system with zero threshold was shown by example.