Knowledge representation of normal neural networks is generally distributed, so it is difficult for them to process structured knowledge. In this paper, we research on and design a high-structured neural network HSNN for solving these problems. The process of designing a HSNN is shown and the applications of HSNN in inheritance, non-monotonous reason and information retrieval are discussed.