|
Name |
|
Date |
Size |
#Lines |
LOC |
| .. | | 15-Mar-2021 | - |
| inc/ncbi/ | H | 15-Mar-2021 | - | 3,993 | 980 |
| json/ | H | 15-Mar-2021 | - | 3,606 | 2,585 |
| secure/ | H | 15-Mar-2021 | - | 6,300 | 4,452 |
| test-UUID/ | H | 15-Mar-2021 | - | 131 | 82 |
| utf8proc/ | H | 03-May-2022 | - | 20,375 | 18,824 |
| 1.sh | H A D | 03-May-2022 | 337 | 9 | 3 |
| Makefile | H A D | 03-May-2022 | 2.6 KiB | 109 | 57 |
| README.md | H A D | 15-Mar-2021 | 3 KiB | 31 | 19 |
| cleanup-jwt-tool.cpp | H A D | 15-Mar-2021 | 1.4 KiB | 37 | 7 |
| cmdline-tst.cpp | H A D | 15-Mar-2021 | 2.2 KiB | 82 | 43 |
| cmdline.cpp | H A D | 03-May-2022 | 58.8 KiB | 1,895 | 1,602 |
| cmdline.hpp | H A D | 15-Mar-2021 | 6 KiB | 185 | 102 |
| config.cpp | H A D | 15-Mar-2021 | 3 KiB | 118 | 68 |
| config.hpp | H A D | 15-Mar-2021 | 2.7 KiB | 89 | 30 |
| constants.hpp | H A D | 15-Mar-2021 | 7.7 KiB | 265 | 163 |
| debug.hpp | H A D | 15-Mar-2021 | 3.6 KiB | 102 | 64 |
| env.cpp | H A D | 15-Mar-2021 | 7.8 KiB | 256 | 193 |
| env.hpp | H A D | 15-Mar-2021 | 3 KiB | 101 | 47 |
| env_vars.h | H A D | 15-Mar-2021 | 2.8 KiB | 83 | 14 |
| exec-jwt-tool.cpp | H A D | 15-Mar-2021 | 3.1 KiB | 113 | 69 |
| fastq-dump.cpp | H A D | 15-Mar-2021 | 5.5 KiB | 198 | 146 |
| fastq-dump.hpp | H A D | 15-Mar-2021 | 2.2 KiB | 53 | 15 |
| fmt.cpp | H A D | 15-Mar-2021 | 23.3 KiB | 908 | 642 |
| fmt.hpp | H A D | 15-Mar-2021 | 7.8 KiB | 243 | 163 |
| globals.hpp | H A D | 15-Mar-2021 | 2.2 KiB | 63 | 20 |
| imp_fasterq_dump.cpp | H A D | 15-Mar-2021 | 10.1 KiB | 232 | 186 |
| imp_fastq_dump.cpp | H A D | 15-Mar-2021 | 17.3 KiB | 384 | 298 |
| imp_prefetch.cpp | H A D | 15-Mar-2021 | 8.8 KiB | 208 | 139 |
| imp_sam_dump.cpp | H A D | 15-Mar-2021 | 15.8 KiB | 347 | 289 |
| imp_sra_pileup.cpp | H A D | 15-Mar-2021 | 9.3 KiB | 210 | 161 |
| imp_srapath.cpp | H A D | 15-Mar-2021 | 6.3 KiB | 156 | 107 |
| imp_vdb_dump.cpp | H A D | 15-Mar-2021 | 15.3 KiB | 339 | 290 |
| init-jwt-tool.cpp | H A D | 15-Mar-2021 | 12 KiB | 432 | 316 |
| jwt-tool.cpp | H A D | 15-Mar-2021 | 21.4 KiB | 612 | 467 |
| jwt-tool.hpp | H A D | 15-Mar-2021 | 3.5 KiB | 130 | 77 |
| log-db.cpp | H A D | 15-Mar-2021 | 9.8 KiB | 326 | 253 |
| log-local.cpp | H A D | 15-Mar-2021 | 6.4 KiB | 206 | 144 |
| log-protocol.hpp | H A D | 15-Mar-2021 | 1.2 KiB | 71 | 49 |
| log-proxy.cpp | H A D | 15-Mar-2021 | 5 KiB | 182 | 131 |
| log.cpp | H A D | 15-Mar-2021 | 2.8 KiB | 104 | 57 |
| logger.cpp | H A D | 15-Mar-2021 | 4.2 KiB | 161 | 89 |
| logging.hpp | H A D | 15-Mar-2021 | 7.4 KiB | 272 | 118 |
| opt_string.hpp | H A D | 15-Mar-2021 | 2.9 KiB | 106 | 46 |
| parse_args.cpp | H A D | 15-Mar-2021 | 10 KiB | 320 | 238 |
| parse_args.hpp | H A D | 15-Mar-2021 | 3.6 KiB | 108 | 43 |
| proc.cpp | H A D | 15-Mar-2021 | 1.4 KiB | 39 | 5 |
| proc.hpp | H A D | 15-Mar-2021 | 1.4 KiB | 39 | 6 |
| proc.posix.cpp | H A D | 15-Mar-2021 | 9.9 KiB | 329 | 225 |
| proc.posix.hpp | H A D | 15-Mar-2021 | 6.5 KiB | 188 | 105 |
| proc.win32.cpp | H A D | 15-Mar-2021 | 8.8 KiB | 283 | 217 |
| proc.win32.hpp | H A D | 15-Mar-2021 | 4.3 KiB | 130 | 63 |
| run-source.cpp | H A D | 15-Mar-2021 | 31.1 KiB | 854 | 697 |
| run-source.hpp | H A D | 15-Mar-2021 | 5.3 KiB | 166 | 102 |
| service.cpp | H A D | 15-Mar-2021 | 7.5 KiB | 225 | 173 |
| service.hpp | H A D | 15-Mar-2021 | 3.3 KiB | 113 | 66 |
| split_path.cpp | H A D | 15-Mar-2021 | 2.5 KiB | 84 | 46 |
| split_path.hpp | H A D | 15-Mar-2021 | 1.7 KiB | 50 | 5 |
| sratools.cpp | H A D | 15-Mar-2021 | 14.5 KiB | 444 | 341 |
| sratools.hpp | H A D | 15-Mar-2021 | 1.6 KiB | 44 | 14 |
| sratools.pl | H A D | 03-May-2022 | 71 KiB | 2,178 | 1,781 |
| sratools2.cpp | H A D | 15-Mar-2021 | 1.2 KiB | 26 | 0 |
| sratools2.hpp | H A D | 15-Mar-2021 | 1.2 KiB | 28 | 1 |
| support2.hpp | H A D | 15-Mar-2021 | 26 KiB | 676 | 553 |
| tool-args.cpp | H A D | 15-Mar-2021 | 9 KiB | 249 | 209 |
| tool-args.hpp | H A D | 15-Mar-2021 | 1.6 KiB | 49 | 7 |
| tool-path.hpp | H A D | 15-Mar-2021 | 3.6 KiB | 112 | 69 |
| util.hpp | H A D | 15-Mar-2021 | 4.4 KiB | 148 | 93 |
| util.posix.hpp | H A D | 15-Mar-2021 | 2.8 KiB | 83 | 51 |
| util.win32.hpp | H A D | 15-Mar-2021 | 8.4 KiB | 228 | 150 |
| uuid.cpp | H A D | 15-Mar-2021 | 6.4 KiB | 181 | 129 |
| uuid.hpp | H A D | 15-Mar-2021 | 1.5 KiB | 45 | 6 |
| which.cpp | H A D | 15-Mar-2021 | 9.7 KiB | 323 | 247 |
| which.hpp | H A D | 15-Mar-2021 | 2.5 KiB | 63 | 10 |
README.md
1# Purpose
2
3To provide a central location for converting user-input accessions to
4location-appropriate URLs that can then be used directly by sra-toolkit.
5
6## Description:
7
8With the move of SRA data to various cloud platforms, there becomes more than one source for data. The sra-toolkit will need to respond to this in a reasonable way. Depending on the location of the user, some sources may be fast and cheap and others may be slow and costly to access. Moreover, not all sources will provide the exact same data, e.g. some sources might not provide original spot names and quality scores. There becomes a complicated and arbitrary matrix of choices.
9
10Additionally, users have expected to be able to act directly on accessions that are not runs, e.g. to run fastq-dump on an experiment accession and have that accession be automatically expanded to the set of run accessions. Currently, our tools simply attempt to act on whatever input they are given, leaving it to VDB to make sense of the request. This has lead to cryptic and unactionable error messages from VDB being presented to the user. VDB doesn't know the context of the request, so it is unable to generate an actionable error message. This needs to be done by the tool, preferably before any other action is attempted on the request. But this is a complicated process often requiring two-way interaction with the user before anything can be done.
11
12Rather than change all the tools to be able to perform these tasks, we will create a single tool to interact with the user. This new tool will determine the proper objects and tools to satisfy the user's requests. It will drive the tools with the correct URLs for the runs they are to work on.
13
14## Path resolution:
15
16The driver tool uses the following rules for locating the tools it is supposed to use:
17
181. Search the same directory as itself
192. Search the directories in the PATH environment variable
203. Search the current directory
21
22If the tool is not found, a message is printed.
23
24## Environment variables for logging and debugging:
25
261. `SRATOOLS_TRACE` - setting to 1 (or anything perl consider to be true) turns on TRACE printing to STDERR (not fully implemented). E.g. `SRATOOLS_TRACE=1 sratools info SRA000001`
272. `SRATOOLS_DEBUG` - setting to 1 (or anything perl consider to be true) turns on DEBUG printing to STDERR, less verbose than TRACE (not fully implemented). E.g. `SRATOOLS_DEBUG=1 sratools info SRA000001`
283. `SRATOOLS_VERBOSE=<1-5>` - turns on VERBOSE logging, 1 is less verbose than 5. E.g. `SRATOOLS_VERBOSE=1 sratools info SRA000001`
294. `SRATOOLS_IMPERSONATE=<path>` - force $0 to be this. Particularly useful for running the driver tool in its uninstalled state. E.g. this would cause the tool to run srapath: `SRATOOLS_IMPERSONATE=${HOME}/ncbi-outdir/sra-tools/linux/gcc/x86_64/dbg/bin/srapath perl sratools.pl SRA000001`
305. `SRATOOLS_DRY_RUN` - setting to 1 will cause the tool to print out the commands it would have executed. Setting `SRATOOLS_VERBOSE=1` will also cause it to print out the environment it would have set for each command.
31