A comprehensive catalog of predicted functional upstream open reading frames in humans

Nucleic Acids Research, Apr 2018

Upstream open reading frames (uORFs) latent in mRNA transcripts are thought to modify translation of coding sequences by altering ribosome activity. Not all uORFs are thought to be active in such a process. To estimate the impact of uORFs on the regulation of translation in humans, we first circumscribed the universe of all possible uORFs based on coding gene sequence motifs and identified 1.3 million unique uORFs. To determine which of these are likely to be biologically relevant, we built a simple Bayesian classifier using 89 attributes of uORFs labeled as active in ribosome profiling experiments. This allowed us to extrapolate to a comprehensive catalog of likely functional uORFs. We validated our predictions using in vivo protein levels and ribosome occupancy from 46 individuals. This is a substantially larger catalog of functional uORFs than has previously been reported. Our ranked list of likely active uORFs allows researchers to test their hypotheses regarding the role of uORFs in health and disease. We demonstrate several examples of biological interest through the application of our catalog to somatic mutations in cancer and disease-associated germline variants in humans.

A PDF file should load here. If you do not see its contents the file may be temporarily unavailable at the journal website or you do not have a PDF plug-in installed and enabled in your browser.

Alternatively, you can download the file locally and open with any standalone PDF reader:


A comprehensive catalog of predicted functional upstream open reading frames in humans

Nucleic Acids Research A comprehensive catalog of predicted functional upstream open reading frames in humans Patrick McGillivray 2 Russell Ault 2 Mayur Pawashe 2 Robert Kitchen 1 Suganthi Balasubramanian 1 2 Mark Gerstein 0 1 2 0 Department of Computer Science, Yale University , New Haven, CT 06520 USA 1 Program in Computational Biology and Bioinformatics, Yale University , New Haven, CT 06520 , USA 2 Molecular Biophysics and Biochemistry Department, Yale University , New Haven, CT 06520 , USA Upstream open reading frames (uORFs) latent in mRNA transcripts are thought to modify translation of coding sequences by altering ribosome activity. Not all uORFs are thought to be active in such a process. To estimate the impact of uORFs on the regulation of translation in humans, we first circumscribed the universe of all possible uORFs based on coding gene sequence motifs and identified 1.3 million unique uORFs. To determine which of these are likely to be biologically relevant, we built a simple Bayesian classifier using 89 attributes of uORFs labeled as active in ribosome profiling experiments. This allowed us to extrapolate to a comprehensive catalog of likely functional uORFs. We validated our predictions using in vivo protein levels and ribosome occupancy from 46 individuals. This is a substantially larger catalog of functional uORFs than has previously been reported. Our ranked list of likely active uORFs allows researchers to test their hypotheses regarding the role of uORFs in health and disease. We demonstrate several examples of biological interest through the application of our catalog to somatic mutations in cancer and disease-associated germline variants in humans. INTRODUCTION Upstream open reading frames (uORFs) consist of a start codon in the 5 untranslated region of a gene (UTR) and an associated stop codon appearing before the stop codon of the main coding DNA sequence (CDS). An uORF may begin and end before the main gene coding sequence. Alternatively, if the upstream reading frame is out of frame with the CDS, it may overlap with the CDS (Figure 1A). uORFs are latent in mRNA transcripts and may undergo translation. An initial survey of the human genome identified uORFs contained in ∼10% of mRNA transcripts ( 1 ). More recent analyses identify uORFs in association with nearly half of all mRNA transcripts ( 2 ). The discovery that many translated uORFs utilize near-cognate start codons to the canonical ATG start codon has broadened estimates of uORF prevalence further ( 3–7 ). Presence of functional uORFs is generally thought to suppress translation of downstream genes ( 8–13 ) (Figure 1B). Proposed molecular mechanisms for modification of CDS translation by uORFs are numerous. These include translation reinitiation – the uORF and CDS are translated by the same ribosome in series––leakyscanning––ribosome recognition of an uORF and subsequent CDS translation, without uORF translation––and ribosome-stalling––decreased translation of the CDS due to ribosome retention at the upstream uORF ( 3,7,14 ). Differential translation of multiple protein products may occur in consequence to an uORF (15). It is also possible for an uORF to function as a short open reading frame, encoding a functional peptide ( 16–19 ). uORF function is not necessarily constant––uORFs may display differential function in stressed cells compared with non-stressed controls ( 20– 25 ). Study of uORF translation and function was historically limited to the experimental evaluation of individual uORFs ( 8,26 ). Genome-scale ribosome profiling studies have allowed for the identification of large populations of uORFs known to undergo translation ( 4,27,28 ). This mapping of translation initiation is sufficient to make an association between ribosomes and particular start codons and reading frames ( 29–31 ). We proceed on the assumption that the total universe of active uORFs is much larger than that identified through ribosome profiling experiments. In other words, we assume that ribosome profiling experiments have high specificity in identifying functional uORFs with a high false-negative rate (Figure 1C). Ribosome profiling experiments follow a challenging technical procedure, and it is uncertain whether all potentially active uORFs are measurable in a given sample (Figure 1D). This is consistent with a high false-negative rate. Other researchers have implicitly endorsed this hidden assumption when predicting translated uORFs in Saccharomyces cerevisiae and Arabidopsis thaliana, on the basis of DNA sequence and ribosome profiling data ( 32,33 ). A similar assumption is the basis for using patterns of ribosome profiling occupancy to maximize the number of inferred translation products in humans ( 34,35 ). Although many uORFs may indeed be functionally neutral – neither translated nor affecting the activity of the downstream CDS – we sought to distinguish active uORFs from functionally neutral uORFs on the basis of specific attributes. For our investigation of the prevalence of active uORFs in humans, we began with a genome-wide scan, searching for uORFs associated with protein-coding genes listed in the GENCODE genome annotation ( 36 ). uORFs beginning with ATG or a single nucleotide variant of ATG were identified. This scan yields a universe of uORFs numbering nearly 1.3 million. uORFs in this large set were classified as active according to similarity to uORFs occupied in ribosome profiling experiments. This classification was accomplished using a Na¨ıve-Bayes classifier, trained on 89 uORF attributes. We validated our predicted uORFs using a cross-validation method where two ribosome profiling experiments are used to predict the uORFs translated in a third experiment. We also validated our predictions by examining how gene level protein expression and local ribosome activity correlate with genetic variants that alter uORFs in 46 individuals. The 1000 Genomes Project’s database of human variation ( 37 ) and the NHGRI-EBI GWAS catalog ( 38 ) were used to provide a baseline for the functional consequence of our predicted active uORFs. The predictions we generated were also used to measure the functional impact of somatic mutations affecting uORFs in tissue-matched tumor samples ( 39 ). We provide a resource of predicted active uORFs for other scientists to use in their effort to understand uORF function in health and disease. MATERIALS AND METHODS Extracting uORFs from GENCODE uORFs were identified through genome-wide search performed on GENCODE Release 19, GENCODE’s GRCh37 human genome annotation ( 36 ). uORFs were defined as a start codon within the 5 UTR and a downstream stop codon before the end of the CDS. All three possible reading frames were examined. ATG and near-cognate start codons were included in this search [ATG, TTG, GTG, CTG, AAG, AGG, ACG, ATA, ATT, ATC]. The decision to scan all near-cognate start codons was motivated by prior investigations that highlight significant uORF translation initiation at near-cognate start codons ( 3–7 ). Ribosome profiling experiments as a reference set Three independent ribosome profiling experiments performed by Lee et al. ( 31 ), Fritsch et al. ( 30 ), and Gao et al. ( 29 ) were used to obtain an experimentally validated set of translated upstream open reading frames. All three of these studies identified translation initiation sites (TIS) through treatment of human cell lines with antibiotic translation inhibitors. These antibiotic treatments are designed to halt ribosomes in proximity to the start codon (12–13 nucleotides downstream). As such, these experiments can provide highresolution information about translation initiation sites in the human genome. The studies of Lee et al. and Gao et al. were performed on the HEK293 human cell line. The study of Fritsch et al. was performed on the THP-1 human cell line. All three experiments identified uORFs and included non-cognate start codons. These three experiments thus provide a platform for identifying common features of translated uORFs between experiments in the same tissue and also across tissue-types, under a shared annotation framework. A literature review of translated human uORFs In addition to ribosome profiling studies, confirmed translated uORFs were obtained from the biomedical literature ( 8,40,41 ). uORFs studied in humans that displayed functionality – demonstrated regulation of the CDS product – were added to the set of positive uORFs. In total, 33 uORFs associated with 33 separate genes were included from this literature review. Cleansing the dataset, by removal of N-terminal extensions and alternative translation initiation sites (aTISs), and isolation of unique uORFs N-terminal extensions of the CDS sequence may retain some functional activity of the primary gene protein product and were removed from the dataset. Any uORF start codon annotated as an alternative translation initiation site (aTIS) for the CDS was also removed from the dataset. A single uORF may be present on multiple transcripts. In order to avoid over-counting, uORFs were distinguished on the basis of their unique genomic coordinates. When a single uORF was present on multiple transcripts, we associated one transcript with the coordinates of that uORF as an identifier. 1-voted, 2-voted and unlabeled datasets uORFs were divided into three separate sets according to their experimental translation status: 2-voted: uORFs identified as translated in two or more ribosome profiling experiments, or through literature review. 1-voted: uORFs identified as translated in only one ribosome profiling experiment, or through literature review. Unlabeled: uORFs that were not identified as translated in any ribosome profiling experiment, or through literature review. Ribosome binding strength of uORF start codons We obtained transcript-level expression data from The Human Protein Atlas for the cell lines THP-1 and HEK 293 and used this data to normalize the footprinting reads from each experiment ( 42 ). According to the metric of normalized footprinting reads per start codon, we classified uORFs as (a) strong ribosome binding strength uORFs (>50th percentile binding strength among positive uORFs) and (b) weak ribosome binding strength uORFs (<50th percentile among positive uORFs). We then compared the experimental translation status for high binding strength uORFs to low binding strength uORFs. Mass spectrometry (MS) evidence of uORF translation We obtained short peptide sequences from The PeptideAtlas Project Tiered Human Integrated Search Proteome (THISP) database ( 43 ). This database pulls major sources of human protein sequences identified in MS experiments into an integrated resource. We used the 1 October 2016 build of the Human PeptideAtlas which contains 1,222,862 unique peptide sequences. We then performed a BLAST (blastx) search ( 44 ) of this peptide database against our genome-wide scan of uORFs from the GENCODE annotation. We required that positive matches have an expect (E) value <1 × 10−5, with no gaps in the mapped sequence, and occur in the same reading frame as the uORF. We also required that our positive matches not map to CDS regions. Estimating the total population of active uORFs Based on observed overlap among ribosome profiling experiments, an estimate for the total number of active uORFs was made using methods from population biology. In general, upon marking a number of items (M) in a population of size N, the number of marked items (R) in a randomly drawn subsequent sample of size C will roughly reflect the proportion of marked items in the total population, i.e.: A simple rearrangement yields an estimate of the total population size known as the Petersen estimate ( 45 ): R M ∼ C = N ˆ N = C M R ( 1 ) ( 2 ) where Nˆ is the population size estimate. We treated functional uORFs identified in ribosome profiling experiments as samplings of the total population of functional uORFs. If ribosome profiling experiments are examined sequentially such that functional uORFs identified in one experiment may be reidentified in subsequently examined experiments, the Schnabel equation (Equation 3) or Schumacher and Eschmeyer equation (Equation 4) provide a means of combining the multiple samplings to estimate the total functional uORF population size ( 46,47 ). The Schnabel equation is a weighted average of Petersen estimates: ˆ N = tS=1(Ct Mt) S t=1 Rt where S is a series of ribosome profiling experiments with t ∈ {1. . . S}, Ct the number of functional uORFs in a sample, Mt the cumulative number of functional uORFs identified prior to sampling t, and Rt the number of functional uORFs reidentified in sample t. Similarly, the Schumacher and Eschmeyer equation takes multiple Petersen estimates to provide a series of data points, Mt (x-coordinates) and Rt/Ct (y-coordinates). A least-squares fit to these data points is an estimate of the inverse of the population size: ˆ N = tS=1(Ct M2t) S t=1 Rt Mt Extraction of attributes associated with uORFs Feature data were extracted for each uORF. Features were chosen to cover a broad range of categories of data, including features associated with uORF position and length, conservation, functional metrics like RNA expression, and sequence-based signatures that may relate to translation. Eighty nine features were used in total. A complete listing of these features including descriptions is included as Supplemental Table S1. Feature discretization The minimum description length principle (MDLP) algorithm was used to discretize each of our chosen attributes ( 48 ). The MDLP algorithm minimizes information lost through discretization. MDLP discretization was implemented using the ‘discretization’ package available for R (http://cran.r-project.org/web/packages/ discretization/index.html). Prioritization of feature data The distribution for each feature was compared between positive and unlabeled uORFs using the Kolmogorov– Smirnov (KS) statistic. A greater KS statistic suggests the greater ability of that attribute to distinguish between positive and unlabeled uORFs. ( 3 ) ( 4 ) learning algorithm applied to positive and unlabeled examples ( 49 ): ( 5 ) ( 6 ) ( 7 ) Ppos Pneg N i = 1 N Ppos is the prior probability associated with positive uORFs. Ppos was chosen as the F1 score maximizing value (0.61). p( Ai | pos), and p( Ai |unl) represent the frequency of that attribute value among the positive and unlabeled sets respectively. ppos represents the probability the uORF is positive. pneg represents the probability the uORF is negative. We labeled an uORF as positive or negative according to the greater value between ppos and pneg. Consistent with this labeling, we scored the uORFs as log( ppos ) with a score of 0 pneg as the threshold between positive and negative uORFs. We note likely violation of the feature independence requirement of Na¨ıve-Bayes. However, empirical and theoretical study has demonstrated optimal classification performance, even where feature independence does not hold ( 50,51 ). Peptide feature score In addition to our uORF functional classification, we also calculated a peptide score for each uORF based on protein features that may be relevant to translated uORF peptides. The included features were protein length, the 20 amino acid frequencies, and evidence of protein translation from MS (Supplemental Table S1). These features were combined using a Na¨ıve-Bayes methodology similar to our main uORF score. Translation at lncRNA ORFs In order to begin an investigation of the function of translation of ORFs on lncRNA, we first completed genome-wide identification of ORFs on lncRNA using the GENCODE Release 19 lncRNA annotation. The studies of Fritsch et al., Lee et al. and Gao et al. do not comment on lncRNA translation initiation sites. We identified ORF translation sites on lncRNAs from these three studies as follows: after downloading signal tracks for these profiling experiments from the GWIPsViz browser ( 52 ), we intersected our genome-wide lncRNA ORFs with ribosome profiling reads. Similar to the threshold used by Lee et al., we identified the ORF as translated if ≥10 reads mapped to the start codon within ±1 nucleotide. Similar to our analyses of uORFs on coding transcripts, we identified a gold-standard positive set of ORFs as lncRNA ORFs that are found translated in at least two of three experiments. Classifying uORFs according to attributes Model validation We determined that attributes of an uORF were consistent with an active uORF according to a Na¨ıve-Bayes machine Our model was serially trained on two of three ribosome profiling datasets, using the trained model to extract the third withheld ribosome profiling dataset from among the unlabeled examples. The success of differentially trained models in this cross-validation was evaluated using ROC curves, with an area under the curve (AUC) calculated for each curve. As a biologic validation of our predicted uORFs, we examined the effect of alteration of a predicted active uORF’s start codon on gene protein levels and local ribosome occupancy. Both protein quantitation and local ribosome quantitative trait loci (cis-rQTL) for 62 Yoruba lymphoblastoid cell lines are available from the ribosome profiling and proteomic experiments of Battle et al. ( 53 ). SNV array data is available for all 62 individuals ( 54 ). However, in order to evaluate the greatest possible range of polymorphisms we chose to only examine 46 of the 62 individuals for whom variant calling based on whole genome sequencing is available through the 1000 Genomes Project. Protein expression change was evaluated in association with both gain of predicted positive uORFs (ATG and CTG) and loss of predicted positive uORFs. We analyzed uORF start codon gain and loss because of the clear relationship to uORF gain and loss. This is different from uORF stop codon gain and loss, which generally results in a change in length of the uORF sequence (uORF truncation and elongation). A change in length of a uORF may affect the translation of downstream coding sequences (e.g. via change in rate of leaky scanning or translation reinitiation). However, the effect of extension or truncation of a uORF on translation of the main CDS depends greatly on local context and is challenging to interpret in aggregate. Functional annotation clustering of genes associated with variants examined was performed using Database for Annotation, Visualization and Integrated Discovery v.6.8 (DAVID) ( 55 ). Natural variation and somatic mutation affecting predicted positive uORFs Single nucleotide variants (SNVs) that affect the start codons of predicted positive uORFs were identified using data from the 1000 Genomes Project Phase 3 callset ( 56 ). Measurement of comparative frequency of mutation among uORF start codons was taken as a measure of evolutionary conservation and functional significance of predicted positive uORFs. Ultra-rare, singleton variants from the Exome Aggregation Consortium (ExAC) catalog v.1 were also examined for their effect on predicted positive uORFs ( 57 ). A subset of SNVs affecting uORFs that are associated with disease and differential disease susceptibility were identified through a search of the NHGRI-EBI GWAS database ( 58 ), the Human Gene Mutation Database (HGMD) of published human inherited disease mutations ( 59 ), and the ClinVar database of variants with human phenotypic correlations ( 60 ). Furthermore, the study of Alexandrov et al. ( 39 ) provides a set of exomic somatic mutations by patient sample and cancer type. We used these mutations as a comparison standard for the healthy 1000 Genomes Project population. We identified start codons of our predicted positive uORFs altered by somatic mutation in cancer. These somatic mutations were annotated and prioritized according to their recurrence in patient samples, and according to their effect on Catalogue of Somatic Mutations in Cancer (COSMIC) cancer genes ( 61 ). RESULTS In silico identification based on a genome-wide search using the GENCODE Release 19 gene annotation model yielded 1,270,265 unique uORFs. Within this large set, we extracted the subset of uORFs identified as translated in the studies of Lee et al., Fritsch et al. and Gao et al. We further stratified this set of translated uORFs according to shared representation of uORFs among the three studies. uORFs identified in the intersection between two or more of these studies were used as the reference standard for functional uORFs. Literature review yielded 33 additional examples of active uORFs that were also included in the set of positive, functional uORFs. We followed the procedure outlined in Figure 2A to identify uORFs that are likely to be active. Distributions of attributes for positive, translated uORFs were compared with distributions of those same attributes observed in the set of unlabeled uORFs (Figure 2B). The KS statistic and corresponding P-value for each of the 89 attributes assessed in this study are provided in Supplemental Table S2. The top 15 attributes listed according to the magnitude of KS statistic are given in Figure 2C. This prioritization of features suggests how they influence the likelihood of uORF translation. Start and stop codons of functional uORFs are generally located in evolutionarily conserved sites as measured by GERP score suggesting a meaningful physiologic role. Active uORFs are on average closer to the CDS (203 nucleotides from the CDS start for positive uORFs, 318 nucleotides for unlabeled uORFs) and are associated with shorter 5 UTR regions (360 nucleotides for positive uORFs, 618 nucleotides for unlabeled uORFs). Positive uORFs also have on average fewer internal ATG and nearcognate start codons. This finding is consistent with prior work showing that longer 5 UTRs, in general, have less functional impact on CDS translation than shorter 5 UTRs after controlling for number of uORFs ( 62 ). Overlap between the three ribosome profiling experiments was found to be low. 28.3% of translated uORFs from Lee et al. (492/1,738), 26.6% of Fritsch et al. (662/2,485), and 51.2% of Gao et al. (500/976), are positively identified in at least one other ribosome profiling experiment. The number of uORFs shared between all three sets represents only 4.0% of uORFs (172/4,286) identified in these studies (Figure 3A). In order to determine if the affinity of ribosomes for the start codons was a factor in this observed overlap, we defined a proxy of ribosome binding strength as the number of footprinting reads per start codon, normalized by transcript expression. We defined both strong binding strength uORFs (>50th percentile binding strength among positive uORFs) and weak binding uORFs and weak ribosome binding strength uORFs (<50th percentile among positive uORFs). We found there is greater percent overlap among strong binding strength uORFs compared with weak binding strength uORFs (positively identified in at least one other experiment: Lee et al.––19.5% weak, 39.1% strong; Fritsch et al.––19.5% weak, 57.4% strong, Gao et al.––52.3% weak, 52.5% strong). In addition to ribosome profiling, mass spectrometry (MS) may be used to identify translated uORFs. However, prior work suggests that translated uORFs are poorly detected using MS techniques and ribosome profiling is the preferred methodology for their identification ( 63–65 ). This could be due to the fact that peptides encoded by uORFs are short and often not unique in the genome, or due to incomplete translation/rapid degradation following translation by nonsense mediated decay (NMD). With these limitations in mind, we completed a BLAST search of peptide sequences from the Human PeptideAtlas against our genome-wide uORFs extracted from the GENCODE annotation. 1,593 unique uORFs were identified with at least 1 mapped peptide sequence after removing all peptides also mapping to CDS regions. A list of uORFs with unique peptide mappings is included as Supplemental Table S3. If independent ribosome profiling experiments represent resampling of the same population, repeat identification of uORFs among experiments yields an estimate of the total number of functional uORFs. 10,000 functional uORFs are estimated in this way to be present in the human genome using the Schnabel equation (Equation 3) or Schumacher and Eschmeyer equation (Equation 4). This estimate of the total population of functional uORFs was made with respect to uORFs defined by their unique genomic coordinates. Thus, identical uORFs across multiple transcripts are not redundantly counted. CTG (30.5%) and ATG (34.6%) are the most prevalent start codons identified in ribosome profiling experiments. CTG (28.2%) and ATG (46.1%) continue to represent the majority of start codons in the intersection between ribosome profiling experiments (Figure 3B). Representation of every near-cognate start codon was found in intersections between studies, with the exception of AAG and AGG. This suggests that uORFs do not generally employ AAG and AGG as start codons. It has been previously suggested that identification of uORFs beginning with AAG or AGG in ribosome profiling experiments may represent false-positives ( 66 ). Discretized attributes of positive and unlabeled sets of uORFs were used to build a statistical classifier within a Naive-Bayes framework. The result of application of the classifier is shown in Figure 3C. 76.8% of 2-voted positive uORFs [590/768], 67.1% of 1-voted positive uORFs [2,379/3,543], and 14.7% of unlabeled uORFs [185,833/1,265,954] are ultimately classified as likely active. A total of 14.9% of all uORFs are identified as likely active [188,802/1,270,265]. A complete list of upstream open reading frames predicted to be active is provided as Supplemental Table S4. The 10% highest probability examples are also specified (Supplemental Table S5). In addition to our main uORF score used to predict active uORFs, we also calculated a peptide probability related to common protein features among ribosome-profiling study labelled functional uORFs (20 amino acid frequencies, peptide length, and MS evidence of translation). This peptide score was calculated separately from the main uORF score in order to distinguish post-translational features from features present in nucleotide sequences. It is presented as a probability that may be used to modify the main uORF score (see Supplemental Tables S4 and S5). Motivated by recent ribosome profiling studies showing evidence of translation at lncRNA ORFs ( 3,67–69 ), we identified 756 unique ORFs with evidence of translation on lncRNAs, of which 174 are 2-voted uORFs with evidence of translation in two or more studies (Supplemental Table S6). The largest number of these 2-voted lncRNA ORFs exhibit translation initiation at the canonical ATG start codon (55/174). However, translation initiation was observed at all near-cognate start codons. On average, these positive (2voted) translated lncRNA ORFs were slightly longer than uORFs––an average of 256 nucleotides for lncRNA ORFs versus 205 nucleotides for uORFs – and located slightly more distal to the 5 cap––an average of 401 nucleotides for lncRNA ORFs versus 280 nucleotides for uORFs. We did not apply our existing scoring algorithm to lncRNA ORFs, or include them in our training data, as there are several properties of lncRNA ORFs that are not shared by uORFs––most notably, an absence of known association and position with respect to coding regions. The relatively small number of gold standard positive (2-voted) lncRNA ORFs (174) compared with uORFs (741) further complicates development of a predictive score tailored to functional lncRNA ORF prediction. A large proportion of uORFs in the human genome begin with CTG start codons (19.3%). The greatest number of predicted positive uORFs are also initiated with a CTG start codon (30.0%). ATG has a lower comparative prevalence in the human genome and in the predicted positive set (6.7% and 8.4% respectively) (Figure 3D). Although it is theoretically possible for the uORF and the main ORF (CDS) to share the same stop codon (<10% of uORFs in our genome-wide scan), we excluded N-terminal extensions and annotated alternative translation initiation sites (aTISs) in our analyses as they may retain some function of the primary gene protein product. Thus, all predicted functional uORFs were isolated to the 5 UTR, or overlapping but out of frame with the CDS. The proportion of uORFs ultimately identified as positive from each ribosome profiling study is shown in Figure 3E. The results were similar for each of the ribosome profiling experiments, ∼70% in each case (72% of Gao et al., 71% of Lee et al., 70% of Fritsch et al.). As a validation of our technique, we serially excluded one of three ribosome profiling experiments from the positive training set, instead including the excluded set among unlabeled examples for subsequent retrieval (Figure 3F). The AUC for each of the ROC curves corresponding to these trials is similar: 0.77, 0.82, and 0.79. This shows that we are able to recover experimentally determined uORFs based on our training model. This also suggests a high false-negative rate for ribosome profiling studies as seen by the low overlap observed between ribosome profiling experiments. As experimental validation of our technique, we examined how natural variation affecting our predicted active uORFs alters protein level and ribosome localization in humans. We hypothesized that an active uORF altered by naturally occurring variants should create observable effect on ribosome occupancy and protein levels from that gene. The results of Battle et al., supplemented by genotype information from the 1000 Genomes Project, provide the basis for validation of our predictions in 46 human subjects (Supplemental Tables S7 and S8). In this study of natural variation amongst humans, SNVs causing gain of predicted positive ATG or CTG uORFs are associated with increase in downstream protein expression. Variants that cause loss of predicted positive uORFs are associated with decrease in downstream protein expression (Figure 4A). That is, there is a statistically significant difference in mean protein expression between variants causing uORF gain compared with uORF loss, among variants with approximate balance between individuals with and without the variant (Nloss = 133, Ngain = 17, t = 2.6, DOF = 307, P = 0.011, for variants shared by >10 individuals). This result is contradictory to the expectation that uORFs generally repress translation of protein downstream. A case study documenting the consequences of uORF gain for the EIF5A gene is provided in Supplemental Results (Supplementary Figure S1). We hypothesized that the observation of decreased protein levels upon uORF loss may relate to uORF–uORF repression: an uORF upstream of another uORF may repress the downstream uORF. The loss of one uORF allows a second uORF to act as a translational repressor of the downstream CDS. When we restricted our protein level analysis to uORFs least likely to repress downstream uORFs– uORFs directly overlapping the CDS – we observed a trend towards increases in protein levels with uORF loss (NCDSoverlap = 34, = 0.065; NCDSnon-overlap = 99, = – 0.055; P = 0.097, for variants shared by >10 individuals). This is consistent with the classical role of uORFs as translational repressors. The above analyses of the effect of uORF alteration on protein level were completed for short insertions and deletions (indels) in addition to SNVs. However, there is an additional challenge to interpreting the effect of indels affecting uORFs – indels have the potential to introduce multiple competing effects (e.g. simultaneous uORF gain and loss) and represent less than 3% of variants in the 1000 Genomes Project variant set examined. These results are provided separately in Supplemental Table S9. Functional annotation clustering of genes associated with variants affecting predicted positive uORFs showed greatest enrichment for ribosomal proteins including RPL24 (32 associated with uORF loss and 17 associated with uORF gain) and ribosome associated proteins including EIF3 (DAVID enrichment score 20.94, Nterms = 12, Ngenes(enrich.)/Ngenes(tot.) = 108/961, pmean(geom.) << 0.001). EIF3 and ribosomal proteins like RPL24 are thought to overcome uORF mediated repression in Arabidopsis thaliana through facilitation of translation reinitiation ( 70 ). For these same 46 human subjects, cis-rQTLs provide an inventory of variants with statistically significant effect on local ribosome occupancy. There is significant enrichment for rQTLs interrupting positively scored start codons (Figure 4B). If mutations hit uORFs randomly, 14.9% of the time they would hit a positively scored uORF. However, we observe that 48% of these rQTLs (21/44) interrupt positively scored start codons––a 3× higher rate. This indicates that many rQTLs may measure the direct effect of disruption of functional uORFs. The ATG start codon is relatively conserved among predicted positive start codons––it is rarely interrupted by 1000 Genomes Project variants (relative rate (RR) 0.03), suggesting its functional importance. This is consistent with prior analyses, which find that ATG is the most conserved upstream start codon ( 71 ). The CTG start codon, although more prevalent among predicted positive uORFs, is altered relatively frequently by natural human variants (RR 0.52) (Figure 4C). In exomic tumor samples from cancer patients, CTG is the most commonly modified predicted positive uORF start codon. ATG is interrupted at a RR of 0.25 in comparison to CTG (Figure 4d). The higher RR of interruption of both ATG and CTG in cancer as compared to germline variants––8-fold higher, and 2-fold higher respectively––further suggests functional consequences attributable to these uORFs. Ultra-rare (singleton) variants from the ExAC catalog v.1 were also scanned for alteration of uORF predicted positive start codons. The singleton variants from the ExAC catalog affecting predicted positive uORFs help highlight high-impact germline mutations affecting conserved uORF start codon sites (Supplemental Table S10). Exomic cancer mutations breaking the highest scored uORFs are listed in Supplemental Table S11. These mutations interrupt uORFs associated with well-studied oncogenes and tumor suppressors. MYC and BCL2 are the two genes associated with the greatest recurrence of uORF interruptions, and we identify recurrent mutation of positively scored uORFs associated with PTEN, TP53, ERCC1 and MSH5. An annotation of Supplemental Table S11 is provided indicating somatic variants that affect uORFs associated with COSMIC cancer genes, as well as recurrent somatic variants affecting uORFs that are recurrent across patient samples. These annotations indicate variants that are priorities for future follow-up analyses. We found that predicted functional uORFs located on genes associated with cell survival and cell differentiation are among those most frequently disrupted by mutation in cancer compared to expectation, suggesting an impact on tumor cell fitness (Supplementary Figure S2). Rates of predicted functional uORF interruption varied significantly across cancer types, indicating that uORF disruption has greater functional impact in certain cancers (Supplementary Figure S3). Genome-wide association study (GWAS) SNVs listed in the NHGRI-EBI GWAS database that impact our predicted uORFs are listed in Supplemental Table S12. GWAS diseases associated with SNVs interrupting positively scored uORFs include prevalent chronic conditions like asthma (rs3771180), and type 2 diabetes (rs1552224). We further scanned variants from the Human Gene Mutation Database (HGMD) of published human inherited disease mutations (Supplemental Table S13) and the ClinVar database of variants with human phenotypic correlations (Supplemental Table S14). These variant analyses implicate the possible influence of uORF alteration in a number of additional disease conditions such as Parkinson’s Disease and cancer-predisposing Lynch Syndrome. Additional variants associated with susceptibility and prognosis in cancer are found to interrupt positively scored uORFs, like rs779805 upstream of the VHL gene, and rs34330 upstream of CDKN1B. Although linkage disequilibrium and overlap among regulatory elements complicates interpretation of these GWAS studies, these diseaseassociated SNVs may owe their functional consequence to alteration of a translated uORF. DISCUSSION In this study, we identify 188,802 likely active upstream open reading frames from a genome-wide set of 1,270,265 unique uORFs. We further highlight the 10% of our predictions that are most likely to be functional as a high reliability subset. We began by assuming that ribosome profiling experiments have a high false negative rate for identification of functional uORFs. Our method applied the intersection of three ribosome profiling studies to form a reference set of known active uORFs. The low overlap between ribosome profiling experiments suggests a high false-negative rate in individual experiments. The finding that pairs of ribosome profiling experiments may be used to correctly identify the uORFs translated in a third experiment also suggests a high false negative rate. The large number of uORFs we identified as likely functional is consistent with this premise, but significant in comparison to other studies on the topic. There is precedent for our findings in comparisons of large-scale parallel experiments of interaction between biomolecules. The protein-protein interaction experiments of Uetz et al. aimed to produce a comprehensive, genomewide map of protein interactions ( 72 ). Subsequent experiments by Ito et al. with similar technique and scope showed low overlap with the results of Uetz et al. ( 73 ). It became clear that the universe of possible protein-protein interactions is much larger than identified in either experiment individually. Combining datasets improves the identification of these protein interactions ( 74 ). Our use of an intersection between ribosome profiling experiments provides some control against differences in experimental conditions and tissue specific results (three experiments and both HEK293 and THP-1 cells were examined). However, just as protein levels vary widely across celltypes ( 75 ), it may prove that the activity of uORFs varies considerably across cell types and cellular conditions. Analysis of cell-type specific and condition specific activity of uORFs may further expand estimates of the population of translated uORFs. Our study helps clarify how attributes of structure and context of a given uORF––including start codon, base composition, and relative position to the CDS––likely contribute to varying functionality among uORFs. Although ATG is the most common uORF start codon identified in ribosome profiling experiments, lower affinity near cognatestart codons may have great functional impact on the landscape of translation due to their overall abundance. An important validation of our predictions is the finding that alteration of predicted functional uORFs, as a consequence of germline genetic variation, impacts ribosome binding and protein levels in humans. Generally, we assume that uORFs act as translational repressors. However, the overall effect of uORF loss appears to be a decrease in downstream protein level. This is contrary to common view that uORFs act as translational repressors. Mechanisms have been studied where uORFs act to up-regulate expression of a downstream coding sequence (e.g. leaky-scanning, and translation reinitiation). Ribosomal reinitiation at an uORF on the ATF4 gene is one particularly well studied example of such a mechanism ( 76 ). Our analysis suggests that positive effect on translation may be a more common consequence for upstream open reading frames than was previously credited. The protein level changes we observed may also relate to multiple indirect effects of uORF repression such as (i) uORF–uORF interaction where one uORF acts to repress another uORF, (ii) variation affecting overlapping uORFs simultaneously and (iii) uORFs upstream of coding genes that themselves regulate translation. Indeed, the observation of enrichment of translational mediators and ribosomal proteins among our uORFs affected by genetic variation, suggests the possibility of cascading functional effects related to uORF gain or loss. Furthermore, among genes with multiple predicted positive uORFs, the presence of CDS-overlapping uORFs resulted in opposite effect on CDS translation compared to those uORFs entirely upstream of the CDSs. This observation suggests that the effect of interaction among uORFs is worthy of further study. In addition to our examination of uORFs on protein coding genes, we also observed significant translation initiation on lncRNA ORFs replicated across the studies we examined. As has been noted by other investigators, these ORFs may serve a function similar to uORFs––regulating translation from as yet undiscovered downstream coding sequences on lncRNAs. Alternatively, these lncRNA ORFs may themselves function as CDS regions, encoding short novel peptides that have been mis-annotated as non-coding ( 77 ). Our work supports a need for further investigation of the coding potential of these ‘non-coding’ transcripts. Limitations to our catalog include the possibility that post-transcriptional RNA editing could result in additional uORFs. Also, the mechanism of repeat associated nonATG translation, whereby translation may initiate at RNA repeat motifs in absence of a specific start codon, suggests there may exist uORFs that do not initiate translation at one of the near-cognate start codons we examined ( 78 ). Future work may be aimed towards clarifying to what extent these classes of translated uORFs exist. Our results suggest avenues for future research. Identification of human germline variants altering predicted positive uORFs reveals locations where the creation or destruction of an uORF is likely to alter protein levels. Employing this method, we identified disease-associated SNVs, including a number of GWAS SNVs, that likely owe their significance to alteration of a functional uORF. Our work could be used to help broaden knowledge of the role of uORFs in cancer beyond recently identified individual examples ( 79 ). Finally, we provide a catalog that can serve as a point of reference for other researchers engaged in the investigation of uORF function. DATA AVAILABILITY Source code and resources related to this analysis are made publicly available in a GitHub repository: https://github. com/gersteinlab/uORFs. SUPPLEMENTARY DATA Supplementary Data are available at NAR online. ACKNOWLEDGEMENTS The authors thank Dr. Antonio J. Giraldez for providing valuable feedback during manuscript preparation. FUNDING This work was supported by funding from the National Human Genome Research Institute of the National Institutes of Health [grant number 5R01HG008126-02]; and the AL Williams Professorship funds. Conflict of interest statement. None declared. 1. Kozak , M. ( 1987 ) An analysis of 5 -noncoding sequences from 699 vertebrate messenger RNAs . Nucleic Acids Res ., 15 , 8125 - 8148 . 2. Kochetov , A.V. , Sarai , A. , Rogozin , I.B. , Shumny , V.K. and Kolchanov , N.A. ( 2005 ) The role of alternative translation start sites in the generation of human protein diversity . Mol. Genet . Genomics, 273 , 491 - 496 . 3. Ingolia , N.T. , Lareau , L.F. and Weissman , J.S. ( 2011 ) Ribosome profiling of mouse embryonic stem cells reveals the complexity and dynamics of mammalian proteomes . Cell , 147 , 789 - 802 . 4. Ingolia , N.T. , Ghaemmaghami , S. , Newman , J.R.S. and Weissman , J.S. ( 2009 ) Genome-wide analysis in vivo of translation with nucleotide resolution using ribosome profiling . Science , 324 , 218 - 23 . 5. Ivanov , I.P. , Loughran , G. and Atkins , J.F. ( 2008 ) uORFs with unusual translational start codons autoregulate expression of eukaryotic ornithine decarboxylase homologs . Proc. Natl. Acad. Sci . U.S.A., 105 , 10079 - 10084 . 6. Ivanov , I.P. , Firth , A.E. , Michel , A.M. , Atkins , J.F. and Baranov , P.V. ( 2011 ) Identification of evolutionarily conserved non-AUG-initiated N-terminal extensions in human coding sequences . Nucleic Acids Res ., 39 , 4220 - 4234 . 7. Hinnebusch , A.G. , Ivanov , I.P. , Sonenberg , N. , Hinnebusch , A.G. , Kozak , M. , Starck , S.R. , Jiang , V. , Pavon-Eternod , M. , Prasad , S. , McCarthy , B. et al. ( 2016 ) Translational control by 5 -untranslated regions of eukaryotic mRNAs . Science , 352 , 1413 - 1416 . 8. Calvo , S.E. , Pagliarini , D.J. and Mootha , V.K. ( 2009 ) Upstream open reading frames cause widespread reduction of protein expression and are polymorphic among humans . Proc. Natl. Acad. Sci . U.S.A., 106 , 7507 - 7512 . 9. Johnstone , T.G. , Bazzini , A.A. , Giraldez , A.J. , Abra`mofff, M. , Magalha˜es, P. , Ram , S. , Altschul , S. , Erickson , B. , Alves , V. , Motta , F. et al. ( 2016 ) Upstream ORFs are prevalent translational repressors in vertebrates . EMBO J ., 35 , 706 - 723 . 10. Somers , J. , P o¨yry,T. and Willis , A.E. ( 2013 ) A perspective on mammalian upstream open reading frame function . Int. J. Biochem. Cell Biol ., 45 , 1690 - 1700 . 11. Meijer , H.A. and Thomas , A.A.M. ( 2002 ) Control of eukaryotic protein synthesis by upstream open reading frames in the 5 -untranslated region of an mRNA . Biochem. J. , 367 , 1 - 11 . 12. Barbosa , C. , Peixeiro , I. , Roma˜o, L. , Morris , D. , Geballe , A. , Calvo , S. , Pagliarini , D. , Mootha , V. , Mendell , J. , Sharifi , N. et al. ( 2013 ) Gene expression regulation by upstream open reading frames and human disease . PLoS Genet ., 9 , e1003529 . 13. Morris , D.R. and Geballe , A.P. ( 2000 ) Upstream open reading frames as regulators of mRNA translation . Mol. Cell . Biol., 20 , 8635 - 8642 . 14. Sonenberg , N. and Hinnebusch , A.G. ( 2009 ) Regulation of translation initiation in eukaryotes: mechanisms and biological targets . Cell , 136 , 731 - 745 . 15. Chua , J.J.E. , Schob , C. , Rehbein , M. , Gkogkas , C.G. , Richter , D. , Kindler , S. , Topisirovic , I. , Svitkin , Y.V. , Sonenberg , N. , Shatkin , A.J. et al. ( 2012 ) Synthesis of two SAPAP3 isoforms from a single mRNA is mediated via alternative translational initiation . Sci. Rep ., 2 , 277 - 298 . 16. Mackowiak , S.D. , Zauber , H. , Bielow , C. , Thiel , D. , Kutz , K. , Calviello , L. , Mastrobuoni , G. , Rajewsky , N. , Kempa , S. , Selbach , M. et al. ( 2015 ) Extensive identification and analysis of conserved small ORFs in animals . Genome Biol ., 16 , 179 . 17. Andrews , S.J. and Rothnagel , J.A. ( 2014 ) Emerging evidence for functional peptides encoded by short open reading frames . Nat. Rev. Genet ., 15 , 193 - 204 . 18. Oyama , M. , Itagaki , C. , Hata , H. , Suzuki , Y. , Izumi , T. , Natsume , T. , Isobe , T. and Sugano , S. ( 2004 ) Analysis of small human proteins reveals the translation of upstream open reading frames of mRNAs . Genome Res., 14 , 2048 - 2052 . 19. Bergeron , D. , Lapointe , C. , Bissonnette , C. , Tremblay , G. , Motard , J. and Roucou , X. ( 2013 ) An Out-of-frame overlapping reading frame in the Ataxin-1 coding sequence encodes a novel Ataxin-1 interacting protein . J. Biol. Chem ., 288 , 21824 - 21835 . 20. Starck , S.R. , Tsai , J.C. , Chen , K. , Shodiya , M. , Wang , L. , Yahiro , K. , Martins-Green , M. , Shastri , N. , Walter , P. , Walter , P. et al. ( 2016 ) Translation from the 5 untranslated region shapes the integrated stress response . Science , 351 , aad3867 . 21. Andreev , D.E. , O'Connor , P.B.F. , Zhdanov , A. V , Dmitriev , R.I. , Shatsky , I.N. , Papkovsky , D.B. and Baranov , P.V. ( 2015 ) Oxygen and glucose deprivation induces widespread alterations in mRNA translation within 20 minutes . Genome Biol., 16 , 90 . 22. Shalgi , R. , Hurt , J.A. , Krykbaeva , I. , Taipale , M. , Lindquist , S. and Burge , C.B. ( 2013 ) Widespread regulation of translation by elongation pausing in heat shock . Mol. Cell , 49 , 439 - 452 . 23. Wiita , A.P. , Ziv , E. , Wiita , P.J. , Urisman , A. , Julien , O. , Burlingame , A.L. , Weissman , J.S. and Wells , J.A. ( 2013 ) Global cellular response to chemotherapy-induced apoptosis . Elife , 2 , e01236 . 24. Gerashchenko , M.V. , Lobanov , A.V. and Gladyshev , V.N. ( 2012 ) Genome-wide ribosome profiling reveals complex translational regulation in response to oxidative stress . Proc. Natl. Acad. Sci . U.S.A., 109 , 17394 - 17399 . 25. Liu , B. , Han, Y. and Qian ,S.-B. ( 2013 ) Cotranslational response to proteotoxic stress by elongation pausing of ribosomes . Mol. Cell , 49 , 453 - 463 . 26. Kozak , M. ( 1986 ) Point mutations define a sequence flanking the AUG initiator codon that modulates translation by eukaryotic ribosomes . Cell , 44 , 283 - 292 . 27. Brar , G.A. and Weissman , J.S. ( 2015 ) Ribosome profiling reveals the what, when, where and how of protein synthesis . Nat. Rev. Mol. Cell Biol ., 16 , 651 - 664 . 28. Ingolia , N.T. ( 2014 ) Ribosome profiling: new views of translation, from single codons to genome scale . Nat. Rev. Genet ., 15 , 205 - 213 . 29. Gao , X. , Wan , J. , Liu , B. , Ma , M. , Shen , B. and Qian ,S.-B. ( 2014 ) Quantitative profiling of initiating ribosomes in vivo . Nat. Methods , 12 , 147 - 153 . 30. Fritsch , C. , Herrmann , A. , Nothnagel , M. , Szafranski , K. , Huse , K. , Schumann , F. , Schreiber , S. , Platzer , M. , Krawczak , M. , Hampe , J. et al. ( 2012 ) Genome-wide search for novel human uORFs and N-terminal protein extensions using ribosomal footprinting . Genome Res. , 22 , 2208 - 2218 . 31. Lee , S. , Liu , B. , Lee , S. , Huang , S.-X. , Shen , B. and Qian ,S.-B. ( 2012 ) Global mapping of translation initiation sites in mammalian cells at single-nucleotide resolution . Proc. Natl. Acad. Sci . U.S.A., 109 , E2424 - E2432 . 32. Selpi , S. , Bryant , C.H. , Kemp , G.J. , Sarv , J. , Kristiansson , E. , Sunnerhagen , P. , Mata , J. , Marguerat , S. , Ba¨hler,J., Pesole , G. et al. ( 2009 ) Predicting functional upstream open reading frames in Saccharomyces cerevisiae . BMC Bioinformatics , 10 , 451 . 33. Hu , Q. , Merchante , C. , Stepanova , A.N. , Alonso , J.M. and Heber , S. ( 2016 ) Genome-Wide search for translated upstream open reading frames in arabidopsis thaliana . IEEE Trans. Nanobiosci ., 15 , 148 - 157 . 34. Fields , A.P. , Rodriguez , E.H. , Jovanovic , M. , Stern-Ginossar , N. , Haas , B.J. , Mertins , P. , Raychowdhury , R. , Hacohen , N. , Carr , S.A. , Ingolia , N.T. et al. ( 2015 ) A Regression-Based analysis of Ribosome-Profiling data reveals a conserved complexity to mammalian translation . Mol. Cell , 60 , 816 - 827 . 35. Raj , A. , Wang , S.H. , Shim , H. , Harpak , A. , Li , Y.I. , Engelmann , B. , Stephens , M. , Gilad , Y. and Pritchard , J.K. ( 2016 ) Thousands of novel translated open reading frames in humans inferred by ribosome footprint profiling . Elife , 5 , e13328 . 36. Harrow , J. , Frankish , A. , Gonzalez , J.M. , Tapanari , E. , Diekhans , M. , Kokocinski , F. , Aken , B.L. , Barrell , D. , Zadissa , A. , Searle , S. et al. ( 2012 ) GENCODE: The reference human genome annotation for The ENCODE Project . Genome Res. , 22 , 1760 - 1774 . 37. McVean , G.A. , Altshuler (Co-Chair) , D.M. , Durbin (Co-Chair ) , R.M. , Abecasis , G.R. , Bentley , D.R. , Chakravarti , A. , Clark , A.G. , Donnelly , P. , Eichler , E.E. , Flicek , P. et al. ( 2012 ) An integrated map of genetic variation from 1,092 human genomes . Nature , 491 , 56 - 65 . 38. Welter , D. , MacArthur,J., Morales , J. , Burdett , T. , Hall , P. , Junkins , H. , Klemm , A. , Flicek , P. , Manolio , T. , Hindorff , L. et al. ( 2014 ) The NHGRI GWAS Catalog, a curated resource of SNP-trait associations . Nucleic Acids Res ., 42 , D1001 - D1006 . 39. Alexandrov , L.B. , Nik-Zainal , S. , Wedge , D.C. , Aparicio , S.A.J.R. , Behjati , S. , Biankin , A.V. , Bignell , G.R. , Bolli , N. , Borg , A. , Børresen-Dale , A.-L. et al. ( 2013 ) Signatures of mutational processes in human cancer . Nature , 500 , 415 - 421 . 40. Wen , Y. , Liu , Y. , Xu , Y. , Zhao , Y. , Hua , R. , Wang , K. , Sun , M. , Li , Y. , Yang , S. , Zhang ,X.-J. et al. ( 2009 ) Loss-of-function mutations of an inhibitory upstream ORF in the human hairless transcript cause Marie Unna hereditary hypotrichosis . Nat. Genet ., 41 , 228 - 233 . 41. Raveh-Amit , H. , Maissel , A. , Poller , J. , Marom , L. , Elroy-Stein , O. , Shapira , M. and Livneh , E. ( 2009 ) Translational control of protein kinase C by two upstream open reading frames . Mol. Cell . Biol., 29 , 6140 - 6148 . 42. Uhlen , M. , Fagerberg , L. , Hallstrom , B.M. , Lindskog , C. , Oksvold , P. , Mardinoglu , A. , Sivertsson , A. , Kampf , C. , Sjostedt , E. , Asplund , A. et al. ( 2015 ) Tissue-based map of the human proteome . Science , 347 , 1260419 . 43. Desiere , F. , Deutsch , E.W. , King , N.L. , Nesvizhskii , A.I. , Mallick , P. , Eng , J. , Chen , S. , Eddes , J. , Loevenich , S.N. and Aebersold , R. ( 2006 ) The PeptideAtlas project . Nucleic Acids Res ., 34 , D655 - D658 . 44. Altschul , S.F. , Gish , W. , Miller , W. , Myers , E.W. and Lipman , D.J. ( 1990 ) Basic local alignment search tool . J. Mol. Biol ., 215 , 403 - 410 . 45. Petersen , C.G.J. ( 1896 ) The yearly immigration of young plaice into the Limfjord from the German Sea . Rep. Danish Biol . Stat., 1895 , 1 - 48 . 46. Schnabel , Z.E. ( 1938 ) The estimation of total fish population of a lake . Am. Math. Mon. , 45 , 348 . 47. Schumacher , F.X. and Eschmeyer , R.W. ( 1943 ) The estimation of fish populations in lakes and ponds . J. Tennessee Acad. Sci. , 18 , 228 - 249 . 48. Fayyad , U. and Irani , K. ( 1993 ) Multi-interval discretization of continuous-valued attributes for classification learning . In: Thirteenth International Joint Conference on Artificial Intelligence . Vol. 2 , pp. 1022 - 1027 . 49. Liu , B. , Dai , Y. , Li , X. , Lee , W.S. and Yu , P.S. ( 2003 ) Building text classifiers using positive and unlabeled examples . In: Third IEEE International Conference on Data Mining. IEEE Comput. Soc , pp. 179 - 186 . 50. Rish , I. ( 2001 ) An empirical study of the naive Bayes classifier . In: Proceedings of IJCAI-01 Workshop on Empirical Methods in Artificial Intelligence . pp. 41 - 46 . 51. Zhang ,H. ( 2004 ) The Optimality of Naive Bayes . In: Proceedings of the 17th International FLAIRS conference (FLAIRS2004) . The AAAI Press , pp. 562 - 567 . 52. Michel , A.M. , Fox , G. , M. Kiran , A. , De Bo , C. , O'Connor , P.B.F. , Heaphy , S.M. , Mullan , J.P.A. , Donohue , C.A. , Higgins , D.G. and Baranov , P.V. ( 2014 ) GWIPS-viz: development of a ribo-seq genome browser . Nucleic Acids Res ., 42 , D859 - D864 . 53. Battle , A. , Khan , Z. , Wang , S.H. , Mitrano , A. , Ford , M.J. , Pritchard , J.K. , Gilad , Y. , Battle , A. , Mostafavi , S. , Zhu , X. et al. ( 2015 ) Genomic variation . Impact of regulatory variation from RNA to protein . Science , 347 , 664 - 667 . 54. Pickrell , J.K. , Marioni , J.C. , Pai , A.A. , Degner , J.F. , Engelhardt , B.E. , Nkadori , E. , Veyrieras ,J.-B., Stephens , M. , Gilad , Y. and Pritchard , J.K. ( 2010 ) Understanding mechanisms underlying human gene expression variation with RNA sequencing . Nature , 464 , 768 - 772 . 55. Huang , D.W. , Sherman , B.T. and Lempicki , R.A. ( 2008 ) Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources . Nat. Protoc ., 4 , 44 - 57 . 56. 1000 Genomes Project Consortium , Auton, A. , Brooks , L.D. , Durbin , R.M. , Garrison , E.P. , Kang , H.M. , Korbel , J.O. , Marchini , J.L. , McCarthy , S. , McVean , G.A. et al. ( 2015 ) A global reference for human genetic variation . Nature , 526 , 68 - 74 . 57. Lek , M. , Karczewski , K.J. , Minikel , E.V. , Samocha , K.E. , Banks , E. , Fennell , T. , O'Donnell-Luria , A.H. , Ware , J.S. , Hill , A.J. , Cummings , B.B. et al. ( 2016 ) Analysis of protein-coding genetic variation in 60,706 humans . Nature , 536 , 285 - 291 . 58. MacArthur ,J., Bowler , E. , Cerezo , M. , Gil , L. , Hall , P. , Hastings , E. , Junkins , H. , McMahon , A. , Milano , A. , Morales , J. et al. ( 2017 ) The new NHGRI-EBI Catalog of published genome-wide association studies (GWAS Catalog) . Nucleic Acids Res ., 45 , D896 - D901 . 59. Stenson , P.D. , Ball , E.V. , Mort , M. , Phillips , A.D. , Shiel , J.A. , Thomas , N.S.T. , Abeysinghe , S. , Krawczak , M. and Cooper , D.N. ( 2003 ) Human gene mutation database (HGMD ®): 2003 update . Hum. Mutat. , 21 , 577 - 581 . 60. Landrum , M.J. , Lee , J.M. , Benson , M. , Brown ,G., Chao , C. , Chitipiralla , S. , Gu , B. , Hart , J. , Hoffman , D. , Hoover , J. et al. ( 2016 ) ClinVar: public archive of interpretations of clinically relevant variants . Nucleic Acids Res ., 44 , D862 - D868 . 61. Forbes , S.A. , Beare , D. , Boutselakis , H. , Bamford , S. , Bindal , N. , Tate , J. , Cole , C.G. , Ward , S. , Dawson , E. , Ponting , L. et al. ( 2017 ) COSMIC: somatic cancer genetics at high-resolution . Nucleic Acids Res ., 45 , D777 - D783 . 62. Johnstone , T.G. , Bazzini , A.A. and Giraldez , A.J. ( 2016 ) Upstream ORFs are prevalent translational repressors in vertebrates . EMBO J ., 35 , 706 - 723 . 63. Olexiouk , V. , Crappe ´ , J. , Verbruggen , S. , Verhegen , K. , Martens , L. and Menschaert , G. ( 2016 ) sORFs.org: a repository of small ORFs identified by ribosome profiling . Nucleic Acids Res ., 44 , D324 - D329 . 64. Somers , J. , Po¨ yry,T. and Willis , A.E. ( 2013 ) A perspective on mammalian upstream open reading frame function . Int. J. Biochem. Cell Biol ., 45 , 1690 - 1700 . 65. Menschaert ,G., Van Criekinge , W. , Notelaers , T. , Koch , A. , Crappe´, J. , Gevaert , K. and Van Damme , P. ( 2013 ) Deep proteome coverage based on ribosome profiling aids mass Spectrometry-based protein and peptide discovery and provides evidence of alternative translation products and Near-cognate translation initiation events . Mol. Cell. Proteomics , 12 , 1780 - 1790 . 66. Michel , A.M. , Andreev , D.E. and Baranov , P.V. ( 2014 ) Computational approach for calculating the probability of eukaryotic translation initiation from ribo-seq data that takes into account leaky scanning . BMC Bioinformatics , 15 , 380 . 67. Ji , Z. , Song , R. , Regev , A. and Struhl , K. ( 2015 ) Many lncRNAs, 5 UTRs, and pseudogenes are translated and some are likely to express functional proteins . Elife , 4 , e08890 . 68. Aspden , J.L. , Eyre-Walker , Y.C. , Phillips , R.J. , Amin , U. , Mumtaz , M.A.S. , Brocard , M. and Couso , J.-P. ( 2014 ) Extensive translation of small Open Reading Frames revealed by Poly-Ribo-Seq . Elife, 3 , e03528 . 69. Bazzini , A.A. , Johnstone , T.G. , Christiano , R. , Mackowiak , S.D. , Obermayer , B. , Fleming , E.S. , Vejnar , C.E. , Lee , M.T. , Rajewsky , N. , Walther , T.C. et al. ( 2014 ) Identification of small ORFs in vertebrates using ribosome footprinting and evolutionary conservation . EMBO J ., 33 , 981 - 993 . 70. Xue , S. and Barna , M. ( 2012 ) Specialized ribosomes: a new frontier in gene regulation and organismal biology . Nat. Rev. Mol. Cell Biol ., 13 , 355 - 369 . 71. Churbanov , A. , Rogozin , I.B. , Babenko , V.N. , Ali , H. and Koonin , E.V. ( 2005 ) Evolutionary conservation suggests a regulatory function of AUG triplets in 5 -UTRs of eukaryotic genes . Nucleic Acids Res ., 33 , 5512 - 5520 . 72. Fields , S. , Uetz , P. , Giot , L. , Cagney , G. , Mansfield , T.A. , Judson , R.S. , Knight , J.R. , Lockshon , D. , Narayan , V. , Srinivasan , M. et al. ( 2000 ) A comprehensive analysis of protein-protein interactions in Saccharomyces cerevisiae . Nature , 403 , 623 - 627 . 73. Ito , T. , Chiba , T. , Ozawa , R. , Yoshida , M. , Hattori , M. and Sakaki , Y. ( 2001 ) A comprehensive two-hybrid analysis to explore the yeast protein interactome . Proc. Natl. Acad. Sci . U.S.A., 98 , 4569 - 4574 . 74. Jansen , R. and Gerstein , M. ( 2004 ) Analyzing protein function on a genomic scale: the importance of gold-standard positives and negatives for network prediction . Curr. Opin. Microbiol., 7 , 535 - 545 . 75. Ponte´n, F. , Gry , M. , Fagerberg , L. , Lundberg , E. , Asplund , A. , Berglund , L. , Oksvold , P. , Bj o¨rling,E., Hober , S. , Kampf , C. et al. ( 2009 ) A global view of protein expression in human cells, tissues, and organs . Mol. Syst. Biol ., 5 , 799 - 816 . 76. Vattem , K.M. and Wek , R.C. ( 2004 ) Reinitiation involving upstream ORFs regulates ATF4 mRNA translation in mammalian cells . Proc. Natl. Acad. Sci . U.S.A., 101 , 11269 - 11274 . 77. Ulitsky , I. and Bartel , D.P. ( 2013 ) lincRNAs: genomics, evolution, and mechanisms . Cell , 154 , 26 - 46 . 78. Green , K.M. , Linsalata , A.E. and Todd , P.K. ( 2016 ) RAN translation--What makes it run? Brain Res ., 1647 , 30 - 42 . 79. Wethmar , K. , Schulz , J. , Muro , E.M. , Talyan , S. , Andrade-Navarro , M.A. and Leutz , A. ( 2016 ) Comprehensive translational control of tyrosine kinase expression by upstream open reading frames . Oncogene , 35 , 1736 - 1742 .

This is a preview of a remote PDF: https://academic.oup.com/nar/article-pdf/46/7/3326/24677614/gky188.pdf

McGillivray, Patrick, Ault, Russell, Pawashe, Mayur, Kitchen, Robert, Balasubramanian, Suganthi, Gerstein, Mark. A comprehensive catalog of predicted functional upstream open reading frames in humans, Nucleic Acids Research, 2018, 3326-3338, DOI: 10.1093/nar/gky188