Abstract: Evaluation of defect detection ability of penetration testing can be characterized by the probability of detection. Through experiments, this paper analyzes and compares the ability to detect defects and the influencing factors from the following four aspects: penetration testing materials, testing methods and technologies, quality control and testing conditions.