This chapter provides a summary of the recent (especially since 2000) progress for the evaluation of image and video segmentation. It is seen that much more effort has been expended on this subject recently than several years ago. A number of works are based on previously proposed principles, and several works have made modifications to and improvements on previous techniques, still other works have presented a few new ideas. The generality and complexity of the evaluation methods and performance criteria used in these works have been thoroughly compared. As the research in this field is still on the rise, some existing problems and several future directions are also highlighted.