To demonstrate that Invitae's next-generation sequencing (NGS) analysis provides the high-quality results you are accustomed to, Invitae has validated our analytic results and clinical interpretations through a number of studies:
A systematic comparison of traditional and multi-gene panel testing for hereditary breast and ovarian cancer genes in more than 1000 patients
A study comparing Invitae’s panel test to traditional BRCA1 and BRCA2 tests in more than 1000 patients was undertaken in collaboration with the Stanford University School of Medicine and Massachusetts General Hospital. The study demonstrated 100% analytic sensitivity and specificity for Invitae’s panel compared to traditional genetic test results for both sequence alterations and deletions/duplications. Variant classifications were also highly (99.8%) concordant.
Multi-gene panels for hereditary breast and ovarian cancer risk assessment are gaining acceptance, not only as additions to but also as replacements for traditional BRCA1/2 testing. To help determine which tests are appropriate for any given patient, it is important to understand the analytic and clinical performance of these tests by comparison with traditional testing.
A total of 1105 individuals were tested using an Invitae 29-gene hereditary cancer panel. Sequence alterations and copy number deletions/duplications were determined by next-generation sequencing (NGS) using Invitae’s custom biochemical and bioinformatics methodologies. For these 1105 individuals, high-quality reference and confirmatory data were available for direct comparison. Variants were classified using a framework (Sherloc) based on the American College of Medical Genetics and Genomics 2015 guidelines using only publicly available and not proprietary data resources. Classifications were compared for 975 individuals for whom traditional BRCA1/2 test results from Myriad Genetics were available.
Table 1: Analytic concordance
Figure 1: Types of pathogenic variants observed
Table 2: Interpretation concordance for BRCA1/2
Invitae’s NGS panel test can provide analytic and clinical results highly comparable to those of traditional BRCA1/2 testing. For both sequence and deletion/duplication variants across many genes, 100% sensitivity and specificity was observed, as well as high interpretation concordance (99.8%). Panel tests can also uncover potentially actionable findings that may be otherwise missed. A detailed study of the clinical actionability of non-BRCA1/2 variants observed in these and other patients is reported separately.
This study is published in the Journal of Molecular Diagnostics, the official journal of the Association for Molecular Pathology.
Stephen E Lincoln, Yuya Kobayashi, Michael J Anderson, Shan Yang, Andrea J Desmond, Meredith A Mills, Geoffrey B Nilsen, Kevin B Jacobs, Federico A Monzon, Allison W Kurian, James M Ford, Leif W Ellisen, A systematic comparison of traditional and multi-gene panel testing for hereditary breast and ovarian cancer genes in more than 1000 patients. J Mol Diagn. 2015.
Download the Invitae hereditary cancer analytic validation one-page PDF of this information.
Next-generation sequencing (NGS) has largely replaced Sanger sequencing, an older technology, in clinical genetic tests. Compared to Sanger, NGS provides lower costs, higher throughput, and the ability to easily test multiple clinically relevant genes in each patient. In order to minimize the risk of false positives from NGS, a two-step approach is often used, whereby variants uncovered by NGS are confirmed by a separate assay (such as Sanger sequencing). Such confirmatory testing must be “orthogonal” to NGS: it needs to employ different biochemical operating principles and have an uncorrelated chance of error.
Confirmatory testing adds cost, manual labor, and time to the genetic testing process. The ACMG guidelines for NGS state that laboratories should have “extensive experience with NGS… before deciding that result confirmation with orthogonal technology can be eliminated.”1 It has been reported that confirmation of the highest quality NGS variant calls may be unnecessary.2–5 Moreover, naive use of confirmatory testing can in fact introduce more errors than it actually prevents.2
Confirmation is unnecessary and wasteful for high-confidence NGS variant calls
In collaboration with the Partners Laboratory for Molecular Medicine at Harvard and the National Institute of Standards and Technology (NIST), Invitae recently completed the largest study to date on the question of whether and when orthogonal confirmation of NGS results is required.6 By using both clinical samples (n = 80,000) as well as gold-standard reference samples from NIST, our study considered almost 200,000 variant calls with confirmatory data.
The results reaffirmed other, previous studies in demonstrating that not all variants require confirmation. We showed that high-confidence NGS variant calls can be identified using objective data quality metrics,6 and that this high-confidence population contains no false positives: 100% of the high-confidence variant calls were proven correct by orthogonal data. Many variants meet this “high confidence” criteria and thus do not benefit from confirmation (i.e., confirmation cannot further improve the accuracy of these calls). The remaining, lower confidence calls include a mixture of true and false positives: these cases require, and are resolved by, confirmatory testing.
A significant improvement over others’ approaches
The key question is how to consistently identify which NGS calls require confirmation. In this aspect, our study differs from prior publications. Our analysis shows that a battery of quality metrics (based on recommendations in the AMP/CAP NGS bioinformatics guidelines7) is required to catch 100% of false positives.6 Prior studies by other laboratories used only one or two metrics, such as quality score or read depth. We find that these simpler criteria miss some false positives, potentially allowing incorrect pathogenic variants to escape confirmation and be reported as real. We attribute this difference to the size of our study, which was 100 to 1,000 times larger than previous studies, permitting the development of more effective criteria. Our study also employed statistical confidence measures, a critical step that most prior studies did not perform.
False positive rate and sensitivity in variant calling
There is always a trade-off between sensitivity (the ability to detect variants that are real) and specificity (the ability to avoid false positives). In order to identify clinically important variants with high sensitivity, a wide net must be cast. However, in doing so, a population of lower confidence calls is also identified, some of which are true and some false. Any test that tries to eliminate confirmation by using very strict calling (aiming for high specificity without confirmation) will suffer a sensitivity penalty: true positives will be missed by such a test. Confirmation of some NGS calls continues to be a necessary component of sensitive genetic tests.
|High-confidence true positives||Meets highly stringent criteria||No benefit from confirmation|
|Candidate true positives||Does not meet stringent criteria||Require confirmation|
NGS variants that pass filtering can be placed into high-confidence and intermediate-confidence categories.6
Variant calls that require confirmation are of many different types, necessitating the use of multiple different confirmation methods. In addition to Sanger sequencing, array CGH, and MLPA, Invitae validated the Pacific Biosciences platform (PacBio) as a confirmation method, showing 100% concordance between PacBio and Sanger.8 PacBio’s technology is highly orthogonal to NGS and can test variants that are difficult for Sanger.9 Compared to Sanger sequencing, PacBio also provides higher throughput, a higher assay success rate, and improved quality control.8 By having multiple platforms available, Invitae can use the most appropriate method for each clinical case.
Confirmation significantly increases both cost and turnaround time for patients and clinicians making important healthcare decisions. Our large, interlaboratory study demonstrates that confirmation assays can be focused on a carefully selected subset of variants to deliver high test sensitivity and specificity.
Our team understands that the stakes for clinical genetic testing are high. Results can lead to irreversible action and emotional distress for patients and their families. We are committed to maintaining the highest quality, while continually improving our processes in a responsible and data-driven manner. We hope this study will inform a new standard of data-driven best practices for variant confirmation.
Download the Invitae confirmation for clinical genetic testing PDF of this white paper.
To demonstrate the value of multi-gene panels in hereditary cancer risk assessment, Invitae collaborated with Stanford University researchers James Ford, M.D. and Allison W. Kurian, MD, MSc. The results of this research, published in the Journal of Clinical Oncology, show that that multi-gene hereditary cancer panels can offer comparable performance to traditional BRCA1/2 genetic testing and can provide additional clinical benefit to doctors and patients seeking cancer risk assessment.
To learn more about this publication, visit our Clinical Actionability page.
Lynch syndrome, also known as hereditary non-polyposis colorectal cancer (HNPCC), is characterized by familial predisposition to cancers of the colon, endometrium, ovary, stomach, and urinary tract.1 Most cases of Lynch syndrome are caused by variants in MLH1, MSH2, and MSH6, but 4–11 percent of cases are caused by variants in PMS2.2-4
Testing for inherited variants in PMS2 is hampered by the presence of a pseudogene, PMS2CL, which has nearly identical homology to PMS2 in the final four exons of the gene (exons 12–15). Thus, sequence reads derived from hybridization capture in next-generation sequencing (NGS) methods cannot be unambiguously aligned to PMS2 or PMS2CL. Gene conversion between exons 12 and 15 of PMS2 and PMS2CL further complicates this issue.5
Why develop an NGS method?
Invitae is committed to making high-quality genetic testing affordable and accessible. Most laboratories perform multiplex ligation-dependent probe amplification (MLPA) to identify deletion/duplication variants, and use long-range PCR (LR-PCR) before sequencing to identify read-through variants and avoid interference from the PMS2CL pseudogene. This is a highly customized and resource-intensive approach to the analysis of a single gene in every sample. Having developed an approach that maximizes the use of our established workflows and capabilities, we are able to offer sequencing of this difficult but important region of PMS2 while maintaining our commitment to affordability.
Invitae's approach to PMS2
Invitae’s approach to the evaluation of exons 12–15 of PMS2 is a two-step process for read-through variants and a three-step process for deletions and duplications (Figure 1). The first step for both types of variants is a bioinformatics screen in which sequence reads derived from both PMS2 and the paralogous PMS2CL gene are analyzed for the presence of variants using PMS2 as the reference sequence. For read-through variants, non-benign variants identified in the screen are definitively assigned to PMS2 or PMS2CL using Sanger sequencing of LR-PCR products of PMS2 (exons 12–15) and PMS2CL (exons 3–6). For deletion/duplication variants, the second step is to confirm the bioinformatics screen call with MLPA, and to account for the possibility of gene conversion, a final step with LR-PCR is used to disambiguate the location of the variant.6
This approach was validated with samples known to have specific variants in these exons for both genes (reference set). For validation of the read-through method, we analyzed 32 unique samples carrying 205 true positive and 34,876 true negative variants in PMS2 or PMS2CL and demonstrated an accuracy, reproducibility, and analytical sensitivity and specificity of 100% (Table 1). For validation of the deletion/duplication method, we analyzed 28 unique samples carrying 90 true positive and 50 true negative individual exon variants in PMS2 or PMS2CL and demonstrated an accuracy, reproducibility, and analytical sensitivity and specificity of 100% (Table 2).
1. Lynch, HT, et al. Review of the Lynch syndrome: history, molecular genetics, screening, differential diagnosis, and medicolegal ramifications. Clinical Genetics. 2009; 76(1):1-18. PMID: 19659756
2. Gill, S, et al. Isolated loss of PMS2 expression in colorectal cancers: frequency, patient age, and familial aggregation. Clinical Cancer Research. 2005; 11:6466-6471. PMID: 16166421
3. Halvarsson, B, et al. The added value of PMS2 immunostaining in the diagnosis of hereditary nonpolyposis colorectal cancer. Familial Cancer. 2006; 5:353-358. PMID: 16817031
4. Truninger, K, et al. Immunohistochemical analysis reveals high frequency of PMS2 defects in colorectal cancer. Gastroenterology. 2005;128:1160-1171. PMID: 15887099
5. Hayward, BE, et al. Extensive gene conversion at the PMS2 DNA mismatch repair locus. Human Mutation. 2007; 28(5):424-30. PMID: 17253626
6. Vaughn CP, et al. Avoidance of pseudogene interference in the detection of 3’ deletions in PMS2. Human Mutation. 2011; 32(9):1063-71. PMID: 21618646
To learn more, please read our PMS2 sequencing and deletion/duplication validation statement.
Complete loss of SMN1 gene function results in spinal muscular atrophy (SMA), an early-onset debilitating neuromuscular disorder characterized by loss of motor neurons in the spinal cord. SMN1 has a near-identical gene copy named SMN2 also located on chromosome 5, approximately 800 kilobases from SMN1. The coding regions of SMN2 and SMN1 differ from one another by a single nucleotide in exon 7*, which we term the gene-determining variant (GDV). This difference adversely affects splicing of the exon and leads to very little full length protein production from the SMN2 gene.
The majority of pathogenic changes in SMA are deletions of SMN1 or gene conversion of SMN1 to SMN2. In addition, rare inactivating sequence variants can occur in SMN1. About 95%–98% of individuals with SMA have zero copies of SMN1 and about 2%–5% are compound heterozygotes, with a deletion of SMN1 on one chromosome and a pathogenic sequence variant in SMN1 on the other chromosome. Notably, the number of SMN2 copies is highly variable among individuals. This number influences the SMA phenotype in patients with SMN1 loss, with severity decreasing and age of onset increasing as the number of SMN2 copies increases.1,2
Challenges in SMA testing and Invitae's NGS-based approach
Most laboratories traditionally diagnose SMA by performing multiplex ligation-dependent probe amplification (MLPA) or quantitative PCR (qPCR) to identify loss of SMN1 exon 7*. These approaches have significant technical limitations and are difficult to efficiently integrate into broader testing.
To address these limitations we developed a comprehensive next-generation sequencing (NGS)-based approach with a customized bioinformatics solution to offer simultaneous sequencing and copy number analysis of these difficult genes while maintaining our commitment to quality and affordability.
Invitae has developed a sophisticated assay and bioinformatics solution to accurately detect pathogenic changes in SMN1 and determine SMN2 copy number. First, we align sequencing reads derived from both SMN1 and SMN2 to an SMN1 reference sequence. We then measure total SMN1 + SMN2 copy number using a modified version of CNVitae, our custom-built copy number variant detection algorithm that utilizes NGS read counts. Once we have the total SMN1/2 copy number, individual SMN1 and SMN2 exon 7* copy numbers are determined using the exon 7* GDV. This simultaneous determination of SMN1 and SMN2 exon 7* copy numbers enables high confidence calls for both SMN1 and SMN2** (Figure 1).
We also use the exon 7* GDV to unambiguously place sequence variants in exon 7* of SMN1 and SMN2. The remaining exons (1–6) of SMN1 and SMN2 are identical in sequence, and therefore while we can accurately identify sequence and copy number variants in these exons, their true location within SMN1 or SMN2 cannot be determined. Even though disambiguation is not possible for variants in exons 1–6, their identification can inform the diagnosis of rare compound heterozygous affected individuals.
SMN1/2 exon 7* copy number variants are confirmed by ligation-dependent sequencing, an Invitae innovation that transforms traditional MLPA into a highly scalable NGS method. Sequence variants in exon 7* are confirmed using single-molecule PacBio sequencing, which enables the phasing of the variant with the GDV to unambiguously place the variant in either SMN1 or SMN2.
Figure 1: SMN1/2 bioinformatics method
Our SMN1/2 approach was validated on a set of nine samples available from an external commercial repository of biological samples. SMN1 exon 7* copy number information was previously determined through traditional methods, and SMN2 copy number was known for a subset of these samples.3 Our method showed 100% sensitivity and specificity for SMN1 and SMN2 copy number, and notably its higher resolution for determining SMN2 copy number enabled us to obtain accurate results for three samples for which copy number had been imprecisely determined with traditional methods previously.3
SMN1 and SMN2 population frequency
*Reference sequence NM_000344.3, which is used to describe SMN1 sequence variants, contains 8 protein-coding exons. Due to historical reasons, the second and third exons are conventionally referred to as exons 2a and 2b, and the subsequent exons are referred to as exons 3–7 (PMID: 8838816). At Invitae, systematic exon numbering is used for all genes, including SMN1 and SMN2. For this reason, the gene-differentiating exon conventionally referred to as exon 7 in the literature and in this whitepaper is referred to as exon 8 in our clinical reports.
**Copy number of SMN2 exon 7* is expected to represent copy number for the entire SMN2 gene, and will only be reported for individuals with a positive result in SMN1. CNVs limited to exons 1–6 of SMN1 or SMN2 will not be reported. This diagnostic assay cannot detect silent carriers (individuals that have 2 functional copies of SMN1 on one chromosome and zero copies on the other [0+2 carrier status]). Therefore a negative result greatly reduces but does not eliminate the chance that a person is a carrier. Of note, Invitae’s carrier screening test for SMA does include the single nucleotide polymorphism g.27134T>G associated with 2+0 carrier status.
1. Mailman MD et al. Molecular analysis of spinal muscular atrophy and modification of the phenotype by SMN2. Genet. Med. 2002;4:20–6. PMID: 11839954
2. Swoboda KJ et al. Natural history of denervation in SMA: relation to age, SMN2 copy number, and function. Ann Neurol. 2005;57:704– 12. PMID: 15852397
3. Stabley DL et al. SMN1 and SMN2 copy numbers in cell lines derived from patients with spinal muscular atrophy as measured by array digital PCR. Molecular Genetics & Genomic Medicine 2015;3(4):248- 257. PMID: 26247043
4. Hendrickson BC et al. Di erences in SMN1 allele frequencies among ethnic groups within North America. Journal of Medical Genetics 2009;46:641-644. PMID: 19625283
Download the one-page PDF of this white paper, which includes an appendix not shown here.
Invitae’s preimplantation genetic testing for aneuploidy (PGT-A) is an NGS-based assay that uses proprietary technology (FAST-SeqS) that allows for robust amplification and deep sequencing (~1 million reads) of over 20,000 regions (Line1 sites) across the genome to call whole-chromosome and segmental aneuploidy. Additionally, Invitae PGT assesses data from over 10,000 single-nucleotide polymorphic (SNP) sites across the genome to call haploidy, all forms of triploidy, other forms of polyploidy, in addition to many instances of uniparental isodisomy (UPiD).
Superior detection: Invitae PGT can accurately detect a wide-spectrum of abnormalities, including whole-chromosome aneuploidy, segmental aneuploidy (≥10 MB), polyploidy, and UPiD.1,2,3
Comprehensive coverage: Unlike most NGS-based PGT assays (which use whole-genome amplification (WGA)), Invitae PGT’s deep sequencing approach captures SNP information, allowing for the detection of haploidy, polyploidy, and UPiD for select chromosomes, abnormalities that are associated with poor reproductive outcomes and are incompletely detected by other NGS-based PGT technologies (Figures 1 and 2). Recent validation studies have confirmed that Invitae’s new PGT laboratory, located in San Francisco, California, is able to accurately detect whole-chromosome and segmental aneuploidy, polyploidy, and UPiD. The results of this validation are evidence of this assay’s reproducibility and robustness, as similar accuracy was reported from the former lab location in Cambridge, Massachusetts. This paper summarizes these validation experiments and results.
Identifying embryos with the greatest chance of implantation and live birth is vital to improving IVF success rates.
To date, all validation studies aimed at assessing Invitae PGT’s capabilities have been performed in the Cambridge, Massachusetts, laboratory. Invitae has recently built a new state-of-the-art PGT laboratory in San Francisco, California. Prior to accepting patient samples, a series of validation experiments were performed to confirm Invitae’s PGT assay performance in its new laboratory.
Samples from whole chromosome aneuploid (n=6), segmental aneuploid (n=121), triploid (n=5), UPiD (n=3), and known diploid cell lines (n=8, including both euploid and aneuploid samples) were run in replicate, and the resulting data were processed with the validated algorithms in the new San Francisco PGT laboratory. Sample calls were compared to the expected karyotypes to estimate analytical sensitivity and specificity for detection of whole- chromosome aneuploidy, segmental aneuploidy, polyploidy, and UPiD.
Launching an existing assay in a new location requires extensive validation, even if the technology is not changing. As expected, our assay performs similarly in both locations offering a high accuracy for the detection of euploid embryos. Invitae is now accepting patient PGT samples in our San Francisco laboratory. Reporting on haploidy, polyploidy, and UPiD in addition to whole-chromosome and segmental aneuploidy is essential to decreasing miscarriage rates in PGT-derived pregnancies (Figure 3).
Figure 3: Invitae PGT can detect the most frequent causes of miscarriage due to chromosome abnormalities
1. Gole J et al. Fertil Steril. 2016;105(2):e25
2. Umbarger MA et al. Fertil Steril. 2016;106(3):e152.
3. Umbarger MA et al. Fertil Steril 2017;108(3):e270.
4. Levy B et al. Obstet Gynecol. 2014;124(2 Pt 1):202-9.
Download the PDF of this white paper.
We are happy to share more details on any of our validation studies with you. Please contact Client Services to request additional information.