Image segmentation and classification plays an important role in many applications of medical-imaging by automating or facilitating the delineation of the regions of interest and their classification. Our aim is to provide a semi-automated or automated system to delineate and classify the brain stroke lesion from CT/MR scan images. Brain strokes are mainly of two types- hemorrhagic and ischemic. Hemorrhagic stroke occurs when a weakened blood vessel ruptures and iscehmic stroke occurs when there is an interruption of blood supply to the brain. Therefore, for their treatment accurate segmentation and classification system should exist.