• Home
  • History
  • Annotate
Name Date Size #Lines LOC

..15-Mar-2021-

inc/ncbi/H15-Mar-2021-3,993980

json/H15-Mar-2021-3,6062,585

secure/H15-Mar-2021-6,3004,452

test-UUID/H15-Mar-2021-13182

utf8proc/H03-May-2022-20,37518,824

1.shH A D03-May-2022337 93

MakefileH A D03-May-20222.6 KiB10957

README.mdH A D15-Mar-20213 KiB3119

cleanup-jwt-tool.cppH A D15-Mar-20211.4 KiB377

cmdline-tst.cppH A D15-Mar-20212.2 KiB8243

cmdline.cppH A D03-May-202258.8 KiB1,8951,602

cmdline.hppH A D15-Mar-20216 KiB185102

config.cppH A D15-Mar-20213 KiB11868

config.hppH A D15-Mar-20212.7 KiB8930

constants.hppH A D15-Mar-20217.7 KiB265163

debug.hppH A D15-Mar-20213.6 KiB10264

env.cppH A D15-Mar-20217.8 KiB256193

env.hppH A D15-Mar-20213 KiB10147

env_vars.hH A D15-Mar-20212.8 KiB8314

exec-jwt-tool.cppH A D15-Mar-20213.1 KiB11369

fastq-dump.cppH A D15-Mar-20215.5 KiB198146

fastq-dump.hppH A D15-Mar-20212.2 KiB5315

fmt.cppH A D15-Mar-202123.3 KiB908642

fmt.hppH A D15-Mar-20217.8 KiB243163

globals.hppH A D15-Mar-20212.2 KiB6320

imp_fasterq_dump.cppH A D15-Mar-202110.1 KiB232186

imp_fastq_dump.cppH A D15-Mar-202117.3 KiB384298

imp_prefetch.cppH A D15-Mar-20218.8 KiB208139

imp_sam_dump.cppH A D15-Mar-202115.8 KiB347289

imp_sra_pileup.cppH A D15-Mar-20219.3 KiB210161

imp_srapath.cppH A D15-Mar-20216.3 KiB156107

imp_vdb_dump.cppH A D15-Mar-202115.3 KiB339290

init-jwt-tool.cppH A D15-Mar-202112 KiB432316

jwt-tool.cppH A D15-Mar-202121.4 KiB612467

jwt-tool.hppH A D15-Mar-20213.5 KiB13077

log-db.cppH A D15-Mar-20219.8 KiB326253

log-local.cppH A D15-Mar-20216.4 KiB206144

log-protocol.hppH A D15-Mar-20211.2 KiB7149

log-proxy.cppH A D15-Mar-20215 KiB182131

log.cppH A D15-Mar-20212.8 KiB10457

logger.cppH A D15-Mar-20214.2 KiB16189

logging.hppH A D15-Mar-20217.4 KiB272118

opt_string.hppH A D15-Mar-20212.9 KiB10646

parse_args.cppH A D15-Mar-202110 KiB320238

parse_args.hppH A D15-Mar-20213.6 KiB10843

proc.cppH A D15-Mar-20211.4 KiB395

proc.hppH A D15-Mar-20211.4 KiB396

proc.posix.cppH A D15-Mar-20219.9 KiB329225

proc.posix.hppH A D15-Mar-20216.5 KiB188105

proc.win32.cppH A D15-Mar-20218.8 KiB283217

proc.win32.hppH A D15-Mar-20214.3 KiB13063

run-source.cppH A D15-Mar-202131.1 KiB854697

run-source.hppH A D15-Mar-20215.3 KiB166102

service.cppH A D15-Mar-20217.5 KiB225173

service.hppH A D15-Mar-20213.3 KiB11366

split_path.cppH A D15-Mar-20212.5 KiB8446

split_path.hppH A D15-Mar-20211.7 KiB505

sratools.cppH A D15-Mar-202114.5 KiB444341

sratools.hppH A D15-Mar-20211.6 KiB4414

sratools.plH A D03-May-202271 KiB2,1781,781

sratools2.cppH A D15-Mar-20211.2 KiB260

sratools2.hppH A D15-Mar-20211.2 KiB281

support2.hppH A D15-Mar-202126 KiB676553

tool-args.cppH A D15-Mar-20219 KiB249209

tool-args.hppH A D15-Mar-20211.6 KiB497

tool-path.hppH A D15-Mar-20213.6 KiB11269

util.hppH A D15-Mar-20214.4 KiB14893

util.posix.hppH A D15-Mar-20212.8 KiB8351

util.win32.hppH A D15-Mar-20218.4 KiB228150

uuid.cppH A D15-Mar-20216.4 KiB181129

uuid.hppH A D15-Mar-20211.5 KiB456

which.cppH A D15-Mar-20219.7 KiB323247

which.hppH A D15-Mar-20212.5 KiB6310

README.md

1# Purpose
2
3To provide a central location for converting user-input accessions to
4location-appropriate URLs that can then be used directly by sra-toolkit.
5
6## Description:
7
8With the move of SRA data to various cloud platforms, there becomes more than one source for data. The sra-toolkit will need to respond to this in a reasonable way. Depending on the location of the user, some sources may be fast and cheap and others may be slow and costly to access. Moreover, not all sources will provide the exact same data, e.g. some sources might not provide original spot names and quality scores. There becomes a complicated and arbitrary matrix of choices.
9
10Additionally, users have expected to be able to act directly on accessions that are not runs, e.g. to run fastq-dump on an experiment accession and have that accession be automatically expanded to the set of run accessions. Currently, our tools simply attempt to act on whatever input they are given, leaving it to VDB to make sense of the request. This has lead to cryptic and unactionable error messages from VDB being presented to the user. VDB doesn't know the context of the request, so it is unable to generate an actionable error message. This needs to be done by the tool, preferably before any other action is attempted on the request. But this is a complicated process often requiring two-way interaction with the user before anything can be done.
11
12Rather than change all the tools to be able to perform these tasks, we will create a single tool to interact with the user. This new tool will determine the proper objects and tools to satisfy the user's requests. It will drive the tools with the correct URLs for the runs they are to work on.
13
14## Path resolution:
15
16The driver tool uses the following rules for locating the tools it is supposed to use:
17
181. Search the same directory as itself
192. Search the directories in the PATH environment variable
203. Search the current directory
21
22If the tool is not found, a message is printed.
23
24## Environment variables for logging and debugging:
25
261. `SRATOOLS_TRACE` - setting to 1 (or anything perl consider to be true) turns on TRACE printing to STDERR (not fully implemented). E.g. `SRATOOLS_TRACE=1 sratools info SRA000001`
272. `SRATOOLS_DEBUG` - setting to 1 (or anything perl consider to be true) turns on DEBUG printing to STDERR, less verbose than TRACE (not fully implemented). E.g. `SRATOOLS_DEBUG=1 sratools info SRA000001`
283. `SRATOOLS_VERBOSE=<1-5>` - turns on VERBOSE logging, 1 is less verbose than 5. E.g. `SRATOOLS_VERBOSE=1 sratools info SRA000001`
294. `SRATOOLS_IMPERSONATE=<path>` - force $0 to be this. Particularly useful for running the driver tool in its uninstalled state. E.g. this would cause the tool to run srapath: `SRATOOLS_IMPERSONATE=${HOME}/ncbi-outdir/sra-tools/linux/gcc/x86_64/dbg/bin/srapath perl sratools.pl SRA000001`
305. `SRATOOLS_DRY_RUN` - setting to 1 will cause the tool to print out the commands it would have executed. Setting `SRATOOLS_VERBOSE=1` will also cause it to print out the environment it would have set for each command.
31