A Giter8 template to demonstrate how you can read and write files to/from hadoop to/from your system.
-
Install Hadoop : One good link to do that is : Installation Steps - Hadoop
-
Start Hadoop by running command:
cd $HADOOP_HOME
./sbin/start-all.sh
- Set variables in Launcher.java class as specified below :
After hadoop server is running configure core-site.xml path and hdfs-site.xml path as per your hadoop setup on your local machine. Also set your storeLocation on hadoop as per your filestructure on hdfs.
- Clone project and Run
git clone git@github.com:SangeetaGulia/activator-hadoop-filesystem-api.git
- Run Project
cd activator-hadoop-filesystem-api
bin/activator "run-main com.knoldus.Launcher"
For any issue please raise a ticket @ Github Issue
Written in 2017 by Knoldus Software LLP
To the extent possible under law, the author(s) have dedicated all copyright and related and neighboring rights to this template to the public domain worldwide. This template is distributed without any warranty. See http://creativecommons.org/publicdomain/zero/1.0/.