Search tips
Search criteria 


Logo of peerjLatest ArticlesFor AuthorsEditorial BoardPeerJPeerJ
PeerJ. 2017; 5: e3091.
Published online 2017 March 16. doi:  10.7717/peerj.3091
PMCID: PMC5357343

Effect of method of deduplication on estimation of differential gene expression using RNA-seq

Academic Editor: Vsevolod Makeev



RNA-seq is a useful tool for analysis of gene expression. However, its robustness is greatly affected by a number of artifacts. One of them is the presence of duplicated reads.


To infer the influence of different methods of removal of duplicated reads on estimation of gene expression in cancer genomics, we analyzed paired samples of hepatocellular carcinoma (HCC) and non-tumor liver tissue. Four protocols of data analysis were applied to each sample: processing without deduplication, deduplication using a method implemented in SAMtools, and deduplication based on one or two molecular indices (MI). We also analyzed the influence of sequencing layout (single read or paired end) and read length. We found that deduplication without MI greatly affects estimated expression values; this effect is the most pronounced for highly expressed genes.


The use of unique molecular identifiers greatly improves accuracy of RNA-seq analysis, especially for highly expressed genes. We developed a set of scripts that enable handling of MI and their incorporation into RNA-seq analysis pipelines. Deduplication without MI affects results of differential gene expression analysis, producing a high proportion of false negative results. The absence of duplicate read removal is biased towards false positives. In those cases where using MI is not possible, we recommend using paired-end sequencing layout.

Keywords: RNA-seq, Differential expression, Deduplication, Cancer genomics, Hepatocarcinoma


Transcriptome sequencing (RNA-seq) is a powerful tool for the analysis of gene expression which is more sensitive and has a higher dynamic diapason than microarrays and which became a method of choice for both model and non-model organisms. It is also a promising method for clinical diagnostics (Byron et al., 2016). However, due to a higher sensitivity and a larger data output, it is more demanding with regard to experiment planning and data analysis, and more susceptible to artifacts than other high-throughput methods of gene expression analysis such as microarrays. One such artifact is the presence of duplicated reads. In RNA-seq analysis, the number of reads mapping to a certain transcript is assumed to reflect the number of molecules of this transcript in the sample. However, there are several reasons why this assumption is not always correct. First, most methods of library preparation include polymerase chain reaction (PCR) which is known to amplify some fragments more efficiently than others, depending on their GC content and length (Aird et al., 2011; Dabney & Meyer, 2012). Second, in Illumina technology, which is currently the most widely used for RNA-seq, there is a specific type of duplicate reads called optical duplicates. They arise from miscalling of a single cluster as two separate clusters. The newer series of HiSeq sequencers (3,000/4,000) uses patterned flowcells where clusters form at a fixed distance from each other. This apparently eliminates the problem of duplication caused by cluster miscalling but, because of a modified cluster generation protocol (exclusion amplification), there is a higher probability that one molecule of the library initiates two independent clusters (Anon, 2016; Hadfield, 2016). These factors can cause the number of reads to be biased and to not reflect accurately the initial transcript abundance. Such biases are especially critical for the highest and the lowest abundant transcripts.

Thus, there is a consensus that removal of duplicated reads (deduplication) is beneficial (Dozmorov et al., 2015). Methods of reads deduplication can be divided into two types. Methods of the first type are based on bioinformatical analysis only and are basically the removal of identical reads. Methods of the second type use extra experimental techniques, such as addition of random or quasi-random sequences, the so-called molecular identifiers (also called molecular indices or barcodes) (MI) (Kivioja et al., 2011; Fu et al., 2011; Fu et al., 2014). This allows one to distinguish between true duplicates and false duplicates—reads that correspond to different RNA molecules but are identical by chance—because the MI sequence is identical in true duplicates but different in fragments that are derived from different RNA molecules.

Currently, most studies implement methods of the first type. Here, there are two main approaches. In the first approach, all reads are compared against each other. As a result, clusters of identical (or nearly identical, if software can take into account sequencing errors) reads are identified, after which one read from each cluster is retained and others are discarded. A number of widely used programs are based on this approach, including BIGpre (Zhang et al., 2011), cd-hit-454 (Niu et al., 2010), FastUniq (Xu et al., 2012), Fulcrum (Burriesci, Lehnert & Pringle, 2012), JATAC (Balzer et al., 2013). These programs were developed and are used mainly for the 454 sequencing technology, where the number of reads is moderate (from thousands to millions) and it is feasible to make all-to-all read comparison. The second approach, widely used for high-output short-read technologies such as Illumina, is based on analysis of results of read mapping. First of all, reads are mapped on the reference sequence. After that, duplicate reads are found by searching reads mapped on the same positions in reference. This approach is used in some popular tools, such as SAMtools (Li et al., 2009), Picard (, Biobambam (Tischler & Leonard, 2014), SAMBLASTER (Faust & Hall, 2014).

Although MI can be helpful (Shiroguchi et al., 2012), they are not used as widely as they should. The first reason for this is that despite a wide choice of protocols and kits for library preparation, only few of them use MI (to our knowledge, only ThruPLEX Tag-seq and NEXTFlex qRNA-seq kit are available for transcriptome libraries). The second reason is the paucity of software that can handle MI. Several solutions are available (Gates & Ulintz, 2016; Girardot et al., 2016) ( but they are non-universal and lack flexibility.

RNA-seq is a promising tool for personal medicine, in particular for oncology, where it can help to infer affected regulatory pathways, to predict the response to therapy, and to detect gene fusions (Roychowdhury & Chinnaiyan, 2016). This urges the development of more effective protocols, both experimental and computational. Here, we report testing the influence of different methods of deduplication (with and without the use of MI) on the estimation of gene expression in a patient with hepatocellular carcinoma and development of scripts for handling MI in the pipeline of RNA-seq analysis.


Samples collection and RNA extraction

Tumor and adjacent non-cancerous liver tissues were collected and frozen in liquid nitrogen after surgical resection of T2N0M0 staged hepatitis-negative moderately differentiated HCC from 60 years old male patient with liver cirrhosis. Samples were collected with written informed consent, conforming to the ethical guidelines of the 1975 Declaration of Helsinki. The Ethics Committee of N.N. Blokhin Russian Cancer Research Center gave approval for the study. Clinical diagnosis was verified histologically. Total RNA was isolated from frozen tumor and liver samples in duplicates using PureLink RNA Mini Kit (Life Technologies) with on column DNase treatment (PureLink DNase Set; Life Technologies) according manufacturer protocol. RNA quality was checked using Agilent 2100 Bioanalyzer, all samples used for the analysis had RIN (RNA integrity number) >7.

Library preparation

Non-ribosomal RNA was separated using Ribo Zero Gold magnetic kit (Illumina). Libraries were prepared from depleted RNA using NEBNext Ultra RNA directional kit (New England Biolabs), with following modification: instead of adapter provided in the kit we used NextFlex molecular index adapter (Bioo Scientific). Libraries were sequenced on HiSeq2000 instrument (Illumina) with read length 101 from each end of fragment.

Sequencing data processing and construction of datasets

We generated four datasets: paired-end 100 (initial dataset, PE100)—experimental data, and three datasets derived from experimental data by cutting to 50 nt and/or by retention of one read in a pair—paired-end 50 (PE50), single read 100 (SE100) and single read 50 (SE50). All consequent steps of processing were identically applied for each dataset. First, 9 nt of reads were excluded from the read sequence by a custom script and stored for each read (respectively, for a read pair two indices were stored). Then, reads were preprocessed by Trimmomatic to remove adapter sequences (without quality control) and mapped to H. sapiens reference genome (processed version GRCh38) by TopHat2 (Kim et al., 2013). TopHat2 was executed with command line parameter:”–library-type fr-firststrand”. Mapped reads were used to produce four types of read counts after following procedures: without deduplication (ND), with deduplication without using index information as realized in SAMtools module rmdup (SAM), with deduplication based on single molecular index (1MI) or two molecular indices (2MI) (Fig. 1). In the case of deduplication without using index information, duplicated reads are defined as those that have the same mapping location, irrespective of orientation (for PE reads mapping positions of both direct and reverse reads must be identical to other pairs). In the case of deduplication using index information, duplicated reads are defined as having the same mapping location and the same MI sequence. For either dataset, a set of read counts was named as “sequencing layout_deduplication method”; for example, PE100_2MI or SE50_ND. In the case of PE100_1MI and PE50_1MI, an index from only one pair of reads was used. For SE100_2MI and SE50_2MI, both indices were counted as if two indices sequences or one longer, and 16-nt index were ligated to cDNA. ND read counts were obtained by extraction from the TopHat 2 output bam file with in-house script and then trimmed with quality threshold Q30 by Trimmomatic. Trimmed reads were mapped again with TopHat2 and read counts were generated by HTSeq. For deduplication without using index information (SAM), results of mapping were processed by the SAMtools rmdup module. Next, reads were extracted from the deduplicated SAM file with a custom script, trimmed for quality, mapped and counted as in the previous case. The 1MI and 2MI types of deduplicated read counts were the result of using a custom Perl script on the TopHat2 mapping BAM file. The script is based on two-stage algorithm. First, algorithm searches for reads with matching position on reference genome. These reads can possibly be duplicated and are referred here as duplicate-candidates. For paired-end reads, both members of pair must have positional matching in order to become a duplicate-candidate. After that, the matching of indices of duplicate-candidates is checked. If duplicate-candidates have the same index, all of them are marked as duplicate. For paired-end reads, both forward and reverse indices have to match for duplicates. Among all duplicates on certain genome position, the script extracts one representative read and discards other. After, deduplication reads were processed to generate read counts as for ND and SAM.

Figure 1
Data processing workflow.

DE genes identification

The samples were normalized by size factor within one set of read counts (for each type of read counts independently) (Anders & Huber, 2010).

DE genes were identified by the R package “DESeq2” (Love, Huber & Anders, 2014). The threshold for significantly differential expression was a false discovery rate (FDR) of 0.05 and fold change of 2.0.

Real-time PCR

Reverse transcription of total RNA was conducted using random hexanucleotide primers and MMLV Reverse transcriptase (Promega, Madison, WI, USA). Quantitative Real-time PCR analysis of SCD, Glo1 and PRKAR1A genes expression was carried out using SYBR Green I PCR kit (Syntol, Moscow, Russian Federation) and iCycler Thermal Cycler with iQ5 Multicolor Real-Time PCR Detection System, data were analyzed using iQ5 Optical System Software (Bio-Rad Laboratories, Hercules, CA, USA). TATA-binding protein (TBP) was used as housekeeping reference gene. Target-specific primers were designed using NCBI Primer-Blast tool ( and synthesized by Syntol (Russian Federation). Primer sequences and PCR conditions are listed in Table S4. Real-time PCR analysis was performed on two independently isolated pairs of HCC and non-tumor RNA samples in four independent repeats for each sample. A total of 45 cycles of amplification (30 s at 95 °C, 30 s at annealing temperature (Table S4), 30 s at 72 °C) were performed and reaction specificity was checked by melt curve analysis. Gene expression levels in each experiment were estimated using standard curve for fixed signal value. For each specimen, gene expression level was normalized to TBP expression and difference between values obtained for HCC and non-tumor samples was calculated.

Results and Discussion

For transcriptome sequencing, we have selected a HCC case for which several fresh-frozen samples of tumor and adjacent non-cancerous liver tissues were available. Samples were collected after tumor resection from the patient with an histologically verified HCC who did not receive preoperative chemo- or radiotherapy. RNA was isolated independently from two pieces of both HCC and non-tumor liver tissue. For each sample (HCC and corresponding non-tumor liver tissue, two replicates each), 33–37 millions of raw paired-end (PE) 100 nucleotide (nt) reads were obtained (for exact values, see Table S1). Each read contains a 8 nt quasi-random index sequence (96 × 96 combinations), and the 9th nucleotide arises from the adenylation of cDNA fragments prior to ligation and is always A. Thus, cDNA sequence itself starts from the 10th nucleotide. Ninety-six percent of reads had indices without mismatches, and only these reads were used (Table S1). The quantities of all barcodes in the initial adaptor mix were assumed to be equal; we checked if this is remained the case after ligation and PCR. Indeed, the distribution of indices within each sample was not significantly different from uniform (Pearson’s chi-squared test’s p-value > 0.5). Also, the distribution of indices was not significantly different between samples (Pearson’s chi-squared test’s p-value > 0.2). Thus, there was no sequence-specific bias resulting in preferential ligation and/or amplification of either index.

Out of these experimental data, we generated four datasets: paired end 100 + 100 nt (PE100), paired end 50 + 50 nt (PE50), single read 100 nt (SE100) and single read 50 nt (SE50), and applied four variants of deduplication—no deduplication (ND), with deduplication without using index information (SAM) and with deduplication based on single molecular index (1MI) or two indices (2MI) (for details see methods and Fig. 1), resulting in 16 sets of read counts (Table S2).

In order to compare the effects of deduplication with and without the use of MI, we first determined the proportions of reads that remain after deduplication for SAM, 1MI and 2MI sets of read counts and compared them with ND read counts. The distributions of the proportions of remaining reads were almost identical for PE100 and PE50, as well as for SE100 and SE50 (Fig. 2 and Fig. S1). Distributions for 1MI and 2MI were identical for PE100 and PE50 and have a significantly (t-test p-value < 2.2e−16) lower means compared to that of SAM (0.6 vs. 0.62, respectively). In the case of single reads independent of read length, 1MI had a slightly lower mean than 2MI (0.59 and 0.58, t-test p-value < 2.2e−16), and distributions of fraction of remaining reads for SAM were considerably wider with a lower mean (0.48).

Figure 2
The distribution of fraction of reads remaining after different types of deduplication (read count per gene after deduplication/read count per gene after deduplication) for (A) paired-end, 100 nt, (B) paired-end, 50 nt, (C) single-end, 100 nt, (D) single-end, ...

A crucial question is whether these reads are evenly distributed across the genes with different expression levels. True duplicates can occur for any library fragment. Thus, one can expect that if only true duplicates are removed, the distribution does not depend on the expression level. In contrast, false duplicates—reads that arise from different RNA molecules but are identical—are preferentially observed in highly expressed genes. In order to infer the effect of deduplication on genes with different levels of expression we first calculated Reads (for paired end datasets—fragments) Per kilobase of transcript per million mapped reads (RPKM/FPKM) values for ND dataset (RPKM was taken as a measure of gene expression because it is independent of length). Then, for each dataset we calculated the fraction of remaining reads across all RPKM.

As in the previous case, PE100 and PE50 show almost identical results (Figs. 3A, ,3B3B and Fig. S2). For single read data, the results are also very similar for different read lengths (SE100 and SE50). For PE reads the proportion of reads that remain after deduplication for 1MI and 2MI did not depend on the level of gene expression, whereas for SAM it was approximately 1.5 times lower for the most highly expressed genes (Figs. 3A, ,3B),3B), indicating that a substantial proportion of the removed reads are not true duplicates but independent reads. In the case of single-end reads, all the three methods of deduplication produced different results. For SE100_2MI and SE50_2MI the proportion of remaining reads was identical to PE_2MI deduplication and did not depend on gene coverage (Figs. 3C, ,3D).3D). The 1MI for single-end reads produced a slight decrease of the proportion of retained reads for genes with high coverage (Figs. 3C, ,3D).3D). The SAM type of deduplication on single reads demonstrated a dramatic decrease of the proportion of remaining reads already at RPKM 100 (Figs. 3C, ,3D).3D). This shows that most reads removed in SE50_SAM and SE100_SAM datasets are not true duplicates.

Figure 3
The dependence of fraction of reads remaining after deduplication on gene expression level for (A) paired-end, 100 nt, (B) paired-end, 50 nt, (C) single-end, 100 nt, (D) single -end, 50 nt read datasets non-tumor tissue sample, replicate 1.

In order to assess the impact of deduplication on the analysis of gene expression, differentially expressed (DE) genes were identified between HCC and non-tumor liver samples for each set of reads using DESeq2 (Love, Huber & Anders, 2014). PE100_2MI set was used as a standard due to the best performance of deduplication algorithm which uses two indices on 100 nt pair-end data. In PE100_2MI set, 2,656 down- and 1,829 upregulated DE genes were discovered in HCC sample compared to non-tumor liver tissue. The number of DE genes for all but SE50_SAM and SE100_SAM sets of reads was very close to PE100_2MI standard, with the difference being below 7%. For SE50_SAM and SE100_SAM the number of DE genes was lower than for the standard, for down- and upregulated genes by 20 and 30%, respectively (the full list of DE genes for all read sets is presented in Table S3). The percentage of gene lists intersection with PE100_2MI was calculated for each read set. Two values were assessed: the percentage of DE genes only in PE100_2MI (false negative, FN) and only in the compared read set (false positive, FP). Although having similar number of DE genes, sets of reads varied in their value of intersection with the standard (Fig. 4 and Table S3). PE100_1MI was almost identical to the standard and had low FN and FP percentage, 0.1 and 0.2, respectively. The rate of FN was also low (below 5%) in PE100_SAM, PE100_ND, SE100_2MI, SE100_1MI, and SE100_ ND. Consistently with a lower number of DE genes, SE50_SAM and SE100_SAM had extremely high levels of FN, 24.7% and 27.4%, respectively (Fig. 4). As expected, FNs are the most pronounced effect of deduplication. All 2MI and 1MI read sets and PE100_ SAM had a FP rate less than 5%. SE100_SAM and SE50_SAM had a lowest percentage of FP (1.1 and 1.2%, respectively). Only the absence of deduplication (Table S3 ) led to high FP rate for all types of reads (from 7.6 to 9.5%, Fig. 4). As mentioned above, for SE reads deduplication with SAMtools led to a sharp decrease of the proportion of remaining reads for high-coverage genes. Thus, we concluded that most of FNs affected highly expressed genes. Indeed, for example, gene ENSG00000000971 had 36 732,41 and 9 830,56 of mean-normalized read counts in PE100_2MI and 58 201.08 and 15 939.78 at PE100_ND for non-tumor liver and HCC tissues, respectively, and in both cases changes its expression is significant with fold change ~3.6 (Table S2). For SE50_SAM, the mean expression level of this gene is 3697.15 and 2068.26 for liver and HCC tissues, respectively, and the gene is not detected as DE. Such distortion of expression profiles of highly expressed genes is typical for the use of single reads deduplicated by SAMtools (median RPKM for FN is 8.3 in HCC and 4.7 in liver tissue, while median RPKM for genes that are identified as DE in both PE_2MI and SE_SAM is 1.0 in HCC and 1.3 in liver tissue). We chose three such genes, encoding stearoyl-CoA desaturase (SCD), glyoxalase I (Glo1) and protein kinase CAMP-dependent type I regulatory subunit alpha (PRKAR1A) that are significantly upregulated in tumor samples in all sets of reads with an exception of SE100_SAM and SE50_SAM, for real-time PCR assessment. Fold changes of these genes calculated by real-time PCR data well match sequencing-based ones (Table S4). Therefore, for accurate analysis of highly expressed genes using single-end reads deduplication using MI is essential and two MI or one longer MI are preferable. For experiments with single read data without MI we do not recommend deduplication at all; however, results should be interpreted with caution because they can include false positives.

Figure 4
Errors in DE genes detection for different reads length and types of deduplication (PE100_2MI used as a standard).

Incorrect results of estimation of differential expression can lead to erroneous biological interpretations. Among DE genes with high levels of expression that were identified in PE100_2MI and PE50_2MI sets of read counts, but not in SE100_ SAM and SE50_SAM ones, a significant number of genes which activation or repression was previously reported to be associated with malignant transformation or particularly HCC pathogenesis were observed. According to cBioPortal (Gao et al., 2013), analysis of TCGA provisional Liver Hepatocellular Carcinoma dataset which included 442 samples, 12 of 32 highly expressed genes with more than 3-folds activation in HCC identified by PE100_2MI but not by SE100_SAM and SE50_SAM read count sets were overexpressed or amplified in more than 10% of HCC cases. These genes encode EEF1D elongation factor deregulated in multiple cancers and modulating proliferation and epithelial-mesenchymal transition in oral squamous cell carcinoma; Glo1 glyoxalase required for HCC cells proliferation and survival which is upregulated or amplified in 48% of HCC samples; liver-specific target of WNT signaling pathway glutamine synthetase GLUL; PRKAR1A regulatory subunit of cAMP-dependent protein kinase encoded by TSE1 locus associated with regulation of hepatic differentiation, and some others (Flores et al., 2016; Zhang et al., 2014; Zucman-Rossi et al., 2007; Boshart et al., 1991).

Notably, SE100_SAM and SE50_SAM procedures failed to detect significant overexpression of multifunctional adapter protein-encoding gene SQSTM1 which regulates cellular growth, antioxidant defense, autophagy, and survival through interplay with numerous signaling molecules and pathways such as Nrf2, mTORC, ERK1, NF-kB, ubiquitin and many others (Taniguchi et al., 2016). Recently, SQSTM1 was shown to accumulate in liver with nonalcoholic steatohepatitis (NASH) and hepatocellular carcinoma and promote liver cancer through Nrf2-dependent metabolic reprogramming (Saito et al., 2016). Among significantly downregulated genes not identified by SE100_SAM and SE50_SAM methods, there were such genes as TMEM107, which encodes a transmembrane protein required for normal regulation of sonic hedgehog (Shh) signaling involved in hepatocarcinogenesis; TXNIP, whose product is a potential tumor suppressor thioredoxin-interacting protein which participates in regulation in the course of oxidative stress, apoptosis, and cell proliferation in hepatic cells; secreted proteins transthyretin (TTR), orosomucoids (OSM)1 and 2, serum amyloids A (SAA) 1 and 2, serum amyloid P component (APCS), hemopexin (HPX) and complement factor H (CFH) whose deregulation is associated with a variety of liver pathologies and carcinogenesis or is linked to cancer prognosis (Christopher et al., 2012; Hamilton et al., 2014). In contrast to 100 nt read length variants, the usage of the 50 nt read length datasets (both PE and SE with any variant of deduplication or without it) failed to detect downregulation of neuronal growth regulator 1 NEGR1 recently described as a commonly regulated gene in multiple cancers but not previously reported to be deregulated in HCC. NEGR1 is raft-associated membrane protein involved in cell-to-cell recognition and adhesion that was shown to suppress cell proliferation, migration and invasiveness in ovarian adenocarcinoma cell line (Kim et al., 2014). A total of 50 nt read length datasets also failed to reveal deregulation of additional cancer-associated genes, particularly CDCA3 (cell division cycle associated 3) regulating cell cycle and modulating drug sensitivity in several types of cancer including HCC; formin family DIAPH3 influencing amoeboid migration of tumor cells and sensitivity to taxanes in breast cancer patients; candidate HCC prognostic factor KIAA0101 involved in cell cycle progression and DNA repair regulation; UDP glucuronosyltransferase UGT2B28; breast carcinoma amplified sequence BCAS4 and some others (Jang et al., 2013; Morley et al., 2015; Abdelgawad, Radwan & Hassanein, 2016).


We showed that the method of deduplication greatly affects all steps of RNA-seq data processing, from removal of duplicated reads to gene expression estimation. The type of reads (single read or paired-end) is also important, in contrast to read length. For single-end data, only deduplication with molecular indices guarantees correct identification of DE genes. The usage of pair-end reads and deduplication based on two indices can markedly increase the sensitivity and accuracy of DE analysis and identification of new diagnostic and prognostic markers and therapeutic targets for NGS-based cancer detection and treatment.

Supplemental Information


Table S1

Statistics of sequencing data, including raw reads and reads after processing (trimming, deduplication, alignment)

Table S2

Read counts for normal tissue and tumor samples and normalized read counts for each read set:

Table S3

DE genes statistics:

Number of down- and upregulated genes, fold changes of DE genes in each set of reads, intersections of DE gene lists for each read set with standard PE100_2UMI.


Table S4

Fold changes of RT-PCR-verified genes and sequences of primers used for RT-PCR:

Figure S1

The distribution of fraction reads remaining after different types of deduplication for non-tumor tissue sample, replicate 2 (block 1) and tumor samples, replicates 1 (block 2) and 2 (block 3)

Color legend is the same as in Fig. 1.


Figure S2

The dependence of fraction of remaining after deduplication reads on gene expression level for non-tumor tissue sample, replicate 2 (block 1) and tumor samples, replicates 1 (block 2) and 2 (block 3)

Color legend is the same as in Fig. 2.


The authors are grateful to Alexey S. Kondrashov for proofreading and editing the manuscript.

Funding Statement

The study was supported by the Ministry of Education and Science of Russia (project #14.607.21.0049, ID RFMEFI60714X0049). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

The following grant information was disclosed by the authors:

Ministry of Education and Science of Russia #14.607.21.0049ID RFMEFI60714X0049.

Additional Information and Declarations

Competing Interests

The authors declare there are no competing interests.

Author Contributions

Anna V. Klepikova analyzed the data, wrote the paper, prepared figures and/or tables.

Artem S. Kasianov analyzed the data, prepared figures and/or tables.

Mikhail S. Chesnokov performed the experiments.

Natalia L. Lazarevich performed the experiments, contributed reagents/materials/analysis tools, reviewed drafts of the paper.

Aleksey A. Penin conceived and designed the experiments, reviewed drafts of the paper, interpreted the results.

Maria Logacheva conceived and designed the experiments, contributed reagents/materials/analysis tools, wrote the paper, interpreted the results.

Human Ethics

The following information was supplied relating to ethical approvals (i.e., approving body and any reference numbers):

The Ethics Committee of N.N. Blokhin Russian Cancer Research Center gave approval for the study.

DNA Deposition

The following information was supplied regarding the deposition of DNA sequences:

Raw reads are deposited in NCBI Sequence Read Archive under bioproject PRJNA354977.

Data Availability

The following information was supplied regarding data availability:



Abdelgawad, Radwan & Hassanein (2016) Abdelgawad IA, Radwan NH, Hassanein HR. KIAA0101 mRNA expression in the peripheral blood of hepatocellular carcinoma patients: association with some clinicopathological features. Clinical Biochemistry. 2016;49:787–791. doi: 10.1016/j.clinbiochem.2015.12.016. [PubMed] [Cross Ref]
Aird et al. (2011) Aird D, Ross MG, Chen W-S, Danielsson M, Fennell T, Russ C, Jaffe DB, Nusbaum C, Gnirke A. Analyzing and minimizing PCR amplification bias in Illumina sequencing libraries. Genome Biology. 2011;12:R18. doi: 10.1186/gb-2011-12-2-r18. [PMC free article] [PubMed] [Cross Ref]
Anders & Huber (2010) Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biology. 2010;11:R106. doi: 10.1186/gb-2010-11-10-r106. [PMC free article] [PubMed] [Cross Ref]
Balzer et al. (2013) Balzer S, Malde K, Grohme MA, Jonassen I. Filtering duplicate reads from 454 pyrosequencing data. Bioinformatics. 2013;29:830–836. doi: 10.1093/bioinformatics/btt047. [PMC free article] [PubMed] [Cross Ref]
Boshart et al. (1991) Boshart M, Weih F, Nichols M, Schütz G. The tissue-specific extinguisher locus TSE1 encodes a regulatory subunit of cAMP-dependent protein kinase. Cell. 1991;66:849–859. doi: 10.1016/0092-8674(91)90432-X. [PubMed] [Cross Ref]
Burriesci, Lehnert & Pringle (2012) Burriesci MS, Lehnert EM, Pringle JR. Fulcrum: condensing redundant reads from high-throughput sequencing studies. Bioinformatics. 2012;28:1324–1327. doi: 10.1093/bioinformatics/bts123. [PMC free article] [PubMed] [Cross Ref]
Byron et al. (2016) Byron SA, Van Keuren-Jensen KR, Engelthaler DM, Carpten JD, Craig DW. Translating RNA sequencing into clinical diagnostics: opportunities and challenges. Nature Reviews Genetics. 2016;17:257–271. [PubMed]
Christopher et al. (2012) Christopher KJ, Wang B, Kong Y, Weatherbee SD. Forward genetics uncovers Transmembrane protein 107 as a novel factor required for ciliogenesis and Sonic hedgehog signaling. Developmental Biology. 2012;368:382–392. doi: 10.1016/j.ydbio.2012.06.008. [PMC free article] [PubMed] [Cross Ref]
Dabney & Meyer (2012) Dabney J, Meyer M. Length and GC-biases during sequencing library amplification: a comparison of various polymerase-buffer systems with ancient and modern DNA sequencing libraries. BioTechniques. 2012;52(2):87–94. [PubMed]
Dozmorov et al. (2015) Dozmorov MG, Adrianto I, Giles CB, Glass E, Glenn SB, Montgomery C, Sivils KL, Olson LE, Iwayama T, Freeman WM, Lessard CJ, Wren JD. Detrimental effects of duplicate reads and low complexity regions on RNA- and ChIP-seq data. BMC Bioinformatics. 2015;16(Suppl 13):S10. doi: 10.1186/1471-2105-16-S13-S10. [PMC free article] [PubMed] [Cross Ref]
Faust & Hall (2014) Faust GG, Hall IM. SAMBLASTER: fast duplicate marking and structural variant read extraction. Bioinformatics. 2014;30:2503–2505. doi: 10.1093/bioinformatics/btu314. [PMC free article] [PubMed] [Cross Ref]
Flores et al. (2016) Flores IL, Kawahara R, Miguel MCC, Granato DC, Domingues RR, Macedo CC, Carnielli CM, Yokoo S, Rodrigues PC, Monteiro BV, Oliveira CE, Salmon CR, Nociti FH, Lopes MA, Santos-Silva A, Winck FV, Coletta RD, Paes Leme AF. EEF1D modulates proliferation and epithelial-mesenchymal transition in oral squamous cell carcinoma. Clinical Science. 2016;130:785–799. doi: 10.1042/CS20150646. [PubMed] [Cross Ref]
Fu et al. (2011) Fu GK, Hu J, Wang P-H, Fodor SPA. Counting individual DNA molecules by the stochastic attachment of diverse labels. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:9026–9031. doi: 10.1073/pnas.1017621108. [PubMed] [Cross Ref]
Fu et al. (2014) Fu GK, Xu W, Wilhelmy J, Mindrinos MN, Davis RW, Xiao W, Fodor SPA. Molecular indexing enables quantitative targeted RNA sequencing and reveals poor efficiencies in standard library preparations. Proceedings of the National Academy of Sciences of the United States of America. 2014;111:1891–1896. doi: 10.1073/pnas.1323732111. [PubMed] [Cross Ref]
Gao et al. (2013) Gao J, Aksoy BA, Dogrusoz U, Dresdner G, Gross B, Sumer SO, Sun Y, Jacobsen A, Sinha R, Larsson E, Cerami E, Sander C, Schultz N. Integrative analysis of complex cancer genomics and clinical profiles using the cBioPortal. Science Signaling. 2013;6(269):pl1. doi: 10.1126/scisignal.2004088. [PMC free article] [PubMed] [Cross Ref]
Gates & Ulintz (2016) Gates C, Ulintz P. Connor—Deduplication based on custom inline DNA barcodes. 2016.
Girardot et al. (2016) Girardot C, Scholtalbers J, Sauer S, Su S-Y, Furlong EEM. Je, a versatile suite to handle multiplexed NGS libraries with unique molecular identifiers. BMC Bioinformatics. 2016;17:419. doi: 10.1186/s12859-016-1284-2. [PMC free article] [PubMed] [Cross Ref]
Hadfield (2016) Hadfield J. Increased read duplication on patterned flowcells- understanding the impact of exclusion amplification. 2016. [7 January 2017].
Hamilton et al. (2014) Hamilton JP, Potter JJ, Koganti L, Meltzer SJ, Mezey E. Effects of vitamin D3 stimulation of thioredoxin-interacting protein in hepatocellular carcinoma: TXNIP, vitamin D3 and HCC. Hepatology Research. 2014;44:1357–1366. doi: 10.1111/hepr.12302. [PMC free article] [PubMed] [Cross Ref]
Jang et al. (2013) Jang S-I, Lee Y-W, Cho C-K, Yoo H-S, Jang J-H. Identification of target genes involved in the antiproliferative effect of enzyme-modified ginseng extract in HepG2 hepatocarcinoma cell. Evidence-Based Complementary and Alternative Medicine. 2013;2013:1–8. [PMC free article] [PubMed]
Kim et al. (2013) Kim D, Pertea G, Trapnell C, Pimentel H, Kelley R, Salzberg SL. TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions. Genome Biology. 2013;14:R36. doi: 10.1186/gb-2013-14-4-r36. [PMC free article] [PubMed] [Cross Ref]
Kim et al. (2014) Kim H, Hwang J-S, Lee B, Hong J, Lee S. Newly identified cancer-associated role of human neuronal growth regulator 1 (NEGR1) Journal of Cancer. 2014;5:598–608. doi: 10.7150/jca.8052. [PMC free article] [PubMed] [Cross Ref]
Kivioja et al. (2011) Kivioja T, Vähärautio A, Karlsson K, Bonke M, Enge M, Linnarsson S, Taipale J. Counting absolute numbers of molecules using unique molecular identifiers. Nature Methods. 2011;9:72–74. doi: 10.1038/nmeth.1778. [PubMed] [Cross Ref]
Li et al. (2009) Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, Marth G, Abecasis G, Durbin R, 1000 Genome Project Data Processing Subgroup The sequence alignment/map format and SAMtools. Bioinformatics. 2009;25:2078–2079. doi: 10.1093/bioinformatics/btp352. [PMC free article] [PubMed] [Cross Ref]
Love, Huber & Anders (2014) Love MI, Huber W, Anders S. Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2. Genome Biology. 2014;15:550. doi: 10.1186/s13059-014-0550-8. [PMC free article] [PubMed] [Cross Ref]
Morley et al. (2015) Morley S, You S, Pollan S, Choi J, Zhou B, Hager MH, Steadman K, Spinelli C, Rajendran K, Gertych A, Kim J, Adam RM, Yang W, Krishnan R, Knudsen BS, Di Vizio D, Freeman MR. Regulation of microtubule dynamics by DIAPH3 influences amoeboid tumor cell mechanics and sensitivity to taxanes. Scientific Reports. 2015;5:12136. doi: 10.1038/srep12136. [PMC free article] [PubMed] [Cross Ref]
Niu et al. (2010) Niu B, Fu L, Sun S, Li W. Artificial and natural duplicates in pyrosequencing reads of metagenomic data. BMC Bioinformatics. 2010;11:187. doi: 10.1186/1471-2105-11-187. [PMC free article] [PubMed] [Cross Ref]
Roychowdhury & Chinnaiyan (2016) Roychowdhury S, Chinnaiyan AM. Translating cancer genomes and transcriptomes for precision oncology: translating genomics for precision oncology. CA: A Cancer Journal for Clinicians. 2016;66:75–88. doi: 10.3322/caac.21329. [PMC free article] [PubMed] [Cross Ref]
Saito et al. (2016) Saito T, Ichimura Y, Taguchi K, Suzuki T, Mizushima T, Takagi K, Hirose Y, Nagahashi M, Iso T, Fukutomi T, Ohishi M, Endo K, Uemura T, Nishito Y, Okuda S, Obata M, Kouno T, Imamura R, Tada Y, Obata R, Yasuda D, Takahashi K, Fujimura T, Pi J, Lee MS, Ueno T, Ohe T, Mashino T, Wakai T, Kojima H, Okabe T, Nagano T, Motohashi H, Waguri S, Soga T, Yamamoto M, Tanaka K, Komatsu M. p62/Sqstm1 promotes malignancy of HCV-positive hepatocellular carcinoma through Nrf2-dependent metabolic reprogramming. Nature Communications. 2016;7:12030. doi: 10.1038/ncomms12030. [PMC free article] [PubMed] [Cross Ref]
Shiroguchi et al. (2012) Shiroguchi K, Jia TZ, Sims PA, Xie XS. Digital RNA sequencing minimizes sequence-dependent bias and amplification noise with optimized single-molecule barcodes. Proceedings of the National Academy of Sciences of the United States of America. 2012;109:1347–1352. doi: 10.1073/pnas.1118018109. [PubMed] [Cross Ref]
Taniguchi et al. (2016) Taniguchi K, Yamachika S, He F, Karin M. p62/SQSTM1-Dr. Jekyll and Mr. Hyde that prevents oxidative stress but promotes liver cancer. FEBS Letters. 2016;590:2375–2397. doi: 10.1002/1873-3468.12301. [PMC free article] [PubMed] [Cross Ref]
Tischler & Leonard (2014) Tischler G, Leonard S. biobambam: tools for read pair collation based algorithms on BAM files. Source Code for Biology and Medicine. 2014;9:13. doi: 10.1186/1751-0473-9-13. [Cross Ref]
Xu et al. (2012) Xu H, Luo X, Qian J, Pang X, Song J, Qian G, Chen J, Chen S. FastUniq: a fast de novo duplicates removal tool for paired short reads. PLOS ONE. 2012;7:e52249. doi: 10.1371/journal.pone.0052249. [PMC free article] [PubMed] [Cross Ref]
Zhang et al. (2014) Zhang S, Liang X, Zheng X, Huang H, Chen X, Wu K, Wang B, Ma S. Glo1 genetic amplification as a potential therapeutic target in hepatocellular carcinoma. International Journal of Clinical and Experimental Pathology. 2014;7:2079–2090. [PMC free article] [PubMed]
Zhang et al. (2011) Zhang T, Luo Y, Liu K, Pan L, Zhang B, Yu J, Hu S. BIGpre: a quality assessment package for next-generation sequencing data. Genomics Proteomics Bioinformatics. 2011;9:238–244. doi: 10.1016/S1672-0229(11)60027-2. [PMC free article] [PubMed] [Cross Ref]
Zucman-Rossi et al. (2007) Zucman-Rossi J, Benhamouche S, Godard C, Boyault S, Grimber G, Balabaud C, Cunha AS, Bioulac-Sage P, Perret C. Differential effects of inactivated Axin1 and activated β-catenin mutations in human hepatocellular carcinomas. Oncogene. 2007;26:774–780. doi: 10.1038/sj.onc.1209824. [PubMed] [Cross Ref]

Articles from PeerJ are provided here courtesy of PeerJ, Inc