• Home
  • History
  • Annotate
Name Date Size #Lines LOC

..03-May-2022-

READMEH A D10-Feb-2022946 2416

env_hdfs.hH A D10-Feb-202211.6 KiB385271

setup.shH A D10-Feb-2022547 106

README

1This directory contains the hdfs extensions needed to make rocksdb store
2files in HDFS.
3
4It has been compiled and testing against CDH 4.4 (2.0.0+1475-1.cdh4.4.0.p0.23~precise-cdh4.4.0).
5
6The configuration assumes that packages libhdfs0, libhdfs0-dev are
7installed which basically means that hdfs.h is in /usr/include and libhdfs in /usr/lib
8
9The env_hdfs.h file defines the rocksdb objects that are needed to talk to an
10underlying filesystem.
11
12If you want to compile rocksdb with hdfs support, please set the following
13environment variables appropriately (also defined in setup.sh for convenience)
14   USE_HDFS=1
15   JAVA_HOME=/usr/local/jdk-7u79-64
16   LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/jdk-7u79-64/jre/lib/amd64/server:/usr/local/jdk-7u79-64/jre/lib/amd64/:./snappy/libs
17   make clean all db_bench
18
19To run dbbench,
20  set CLASSPATH to include your hadoop distribution
21  db_bench --hdfs="hdfs://hbaseudbperf001.snc1.facebook.com:9000"
22
23
24