Video surveillance is an emerging field where it would become much more challenging when it concerns about the lighting conditions of the video taken at night time. Pedestrian detection would be very difficult under poor illumination condition and low contrast. The system proposes to improve the visual appearance and to bring out the finer details beyond the illuminated regions. With the help of day time reference image from day time video taken at same location with no camera motion, we adjust the illumination of night time video sequence