Name | Date | Size | #Lines | LOC | ||
---|---|---|---|---|---|---|
.. | 03-May-2022 | - | ||||
README | H A D | 10-Feb-2022 | 946 | 24 | 16 | |
env_hdfs.h | H A D | 10-Feb-2022 | 11.6 KiB | 385 | 271 | |
setup.sh | H A D | 10-Feb-2022 | 547 | 10 | 6 |
README
1This directory contains the hdfs extensions needed to make rocksdb store 2files in HDFS. 3 4It has been compiled and testing against CDH 4.4 (2.0.0+1475-1.cdh4.4.0.p0.23~precise-cdh4.4.0). 5 6The configuration assumes that packages libhdfs0, libhdfs0-dev are 7installed which basically means that hdfs.h is in /usr/include and libhdfs in /usr/lib 8 9The env_hdfs.h file defines the rocksdb objects that are needed to talk to an 10underlying filesystem. 11 12If you want to compile rocksdb with hdfs support, please set the following 13environment variables appropriately (also defined in setup.sh for convenience) 14 USE_HDFS=1 15 JAVA_HOME=/usr/local/jdk-7u79-64 16 LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/jdk-7u79-64/jre/lib/amd64/server:/usr/local/jdk-7u79-64/jre/lib/amd64/:./snappy/libs 17 make clean all db_bench 18 19To run dbbench, 20 set CLASSPATH to include your hadoop distribution 21 db_bench --hdfs="hdfs://hbaseudbperf001.snc1.facebook.com:9000" 22 23 24