Sequence database setup: NCBI EST (OBSOLETE)
In late August 2016, NCBI removed gi numbers from the title lines of the EST Fasta files. This breaks the definitions on this page, so we advise you to switch to the EMBL EST files, which provide essentially the same coverage and have the advantage of being more evenly divided.
The information on this page is archived for historical purposes.
Overview
Three EST databases were compiled by the NCBI (National Center for Biotechnology Information). They contained "single-pass" cDNA sequences, or Expressed Sequence Tags, from the EST divisions of GenBank.
There were three EST databases: human, mouse, and others. This document uses the "others" database as an example. To work with the human or mouse databases, simply substitute the word "human" or "mouse" for "others". For example, the human compressed Fasta file is est_human.gz, the db_update.pl keyword is EST_human_from_NCBI, the recommended Mascot name is EST_human, etc.
As of April 2012, the compressed EST_others file from NCBI was 11 GB and the unpacked Fasta was 40 GB. Address space constraints mean that it is no longer possible to memory map this file or to build a taxonomy index using 32-bit executables. Even so, given sufficient disk space, you should still be able to search EST_others on a 32-bit system, provided you configure without memory mapping or taxonomy.
NCBI have no plans to split EST_others, so a more practical alternative is the set of 10 EMBL EST files, which are more evenly divided. As of April 2012, the largest (plants) was 4.3 GB compressed and 17 GB unpacked.
If you only require sequences for a particular organism, another possibility is to download an organism specific EST database.
Download
It is no longer possible to download these sequences databases from NCBI.
Taxonomy
Taxonomy for NCBI EST databases is predefined in mascot.dat. For EST_others, choose "dbEST FASTA using GI2TAXID". (There is no value in building taxonomy indexes for human or mouse because these are single organism databases.) The following taxonomy files are required:
ftp://ftp.ncbi.nlm.nih.gov/pub/taxonomy/gi_taxid_nucl.dmp.gz
ftp://ftp.ncbi.nlm.nih.gov/pub/taxonomy/taxdump.tar.gz
Note that the taxonomy files go into the taxonomy directory, not into the sequence database directory. Also, some files need to be unpacked (using tar) as well as uncompressed.
Unigene
NOTE: UniGene was retired by NCBI in July 2019, although the final UniGene builds are still available as static content from the FTP site
The NCBI UniGene indexes are created by automatically partitioning GenBank sequences into non-redundant sets of gene-oriented clusters. If UniGene indexes are available locally, results from Mascot searches of EST databases can be grouped and reported by gene family, rather than by raw EST accession numbers.
In Mascot 2.4, the following UniGene indexes are included in the predefined database definitions. To enable UniGene indexes in earlier versions, refer to your local copy of this help page
- EST_human
- Homo_sapiens
- EST_mouse
- Mus_musculus
- EST_others
- Anopheles_gambiae
- Arabidopsis_thaliana
- Bos_taurus
- Caenorhabditis_elegans
- Chlamydomonas_reinhardtii
- Danio_rerio
- Dictyostelium_discoideum
- Drosophila_melanogaster
- Hordeum_vulgare
- Oryza_sativa
- Rattus_norvegicus
- Takifugu_rubripes
- Triticum_aestivum
- Xenopus_laevis
- Zea_mays
Parse Rules
A typical Fasta title line was:
>gi|16764|emb|Z17609.1|Z17609 ATTS0183 Gif-SeedA+B Arabidopsis thaliana cDNA clone YAP043T 3′
The gi number is the most reliable identifier. Suitable parse rules are:
Accession from Fasta title: ">\(gi|[0-9]*\)"
Description from Fasta title: ">[^ ]* \(.*\)"
If an entry in EST_others represents multiple source database entries, the Fasta title lines are concatenated together with CTRL+A as the delimiter.