Skip to content

mdashti/transactional-key-value-store-project

 
 

Repository files navigation

Transactional key-value store for YARN

Development of a YARN application for transactional key-value operations.

How to use it

If you are running the , ./configure.sh local to configure the slaves file. Otherwise, if you are running it on the cluster of the course, please run ./configure.sh N to run the system on N nodes.

  1. HDFS and YARN must be running
  2. Start the YARN Application with ./start.sh. The Client REPL will start.
  3. Try :benchmark, it's gonna be fun. Please be nice to our immature system

Example benchmark test: :benchmark t 100 r 10 k 500 ratio 20 4. Stop the YARN Application with :exit. 5. View all logs with ./printlogs.sh.

You can look at the example client source code in test/ch/epfl/tkvs/userclient/UserClient.java

Selecting the concurrency control

At the moment, the key-value store support 3 concurrency algorithms: 2PL, MVCC2PL and MVTO. To select one of them, write simple_2pl, mvcc2pl or mvto in ./config/algorithm. By default (in absence of the file for instance), MVTO will be used.

About

Development of a YARN application for transactional key-value operations.

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 91.6%
  • Shell 6.8%
  • Gnuplot 1.6%