Aimed at the problems that the edge is fuzzy and the visual effect is poor during the fusion of the infrared and visible images, a fusion algorithm based on NSCT is proposed. NSCT has shiftinvariance and a good direction selection, only thus can the algorithm fully capture the contour and more details of the image. Firstly, the NSCT is used to take multiscale, multidirection decomposition for the infrared and visible image, and then the edges of the low frequency image is extracted by using the isotropic Soble gradient operator ,and fused the low frequency coefficients by edge information to attain the low frequency fusion image. Meanwhile, the high frequency coefficients are fused by region energy to attain the high frequency fusion image. Finally, the fusion image is reconstructed by performing the inverse NSCT on the low frequency fusion image and the high frequency fusion image. The simulation experiments according to both the subjective and objective criteria ,including the information entropy ,space frequency and average gradient, show that the algorithm can get a good fusion image with more clearly details such as edges. Besides ,the fusion image is more conform to the requirements of human vision.