Synthetic lethal screens have the potential to identify new vulnerabilities incurred by specific cancer mutations but have been hindered by lack of agreement between studies. In the case of KRAS, we identify that published synthetic lethal screen hits significantly overlap at the pathway rather than gene level. Analysis of pathways encoded as protein networks could identify synthetic lethal candidates that are more reproducible than those previously reported. Lack of overlap likely stems from biological rather than technical limitations as most synthetic lethal phenotypes are strongly modulated by changes in cellular conditions or genetic context, the latter determined using a pairwise genetic interaction map that identifies numerous interactions that suppress synthetic lethal effects. Accounting for pathway, cellular and genetic context nominates a DNA repair dependency in KRAS-mutant cells, mediated by a network containing BRCA1. We provide evidence for why most reported synthetic lethals are not reproducible which is addressable using a multi-faceted testing framework.