java - Sqoop 1.99.7 Installation on Centos 7 -


i new hadoop eco system.

i in process of setting hadoop eco system on single node. hadoop system been setup , working fine along hbase , hive. to connect external sources of data, setting sqoop 1.99.7 server. finding difficult setup, documentation creating sort of confusion. can 1 me step step process... steps done me far ..

  1. java 1.7 version - available
  2. hadoop common - been setup , verified
  3. downloaded , installed sqoop version 1.99.7
  4. configured ~/.bashrc file export sqoop_home=/usr/lib/sqoop export path=$path:$sqoop_home/bin
  5. source bashrc file

now not clear, per documentation provided, on , stuck here last 1 day... 1. creating third party jars - have created directory /var/lib/sqoop2 using mkdir -p /var/lib/sqoop2

(creation did not give error , unable locate directory) hence copy mysql-jdbc* files, postgresql-jdbc not done. unable locate mysl-jdbc* files in server path

2. presume no action required configure sqoop_boot starp. properties , sqoop.properties

unless above steps completed, ca not start sqoop server. can 1 correct me on above needs done.. in advance.. sreeram

just add further, when start server, following output , sqoop server not start. remedy?

[root@localhost sqoop]# ./bin/sqoop.sh server start setting conf dir: /home/sreeram/sqoop/conf sqoop home directory: /home/sreeram/sqoop starting sqoop2 server... 2017-08-20 14:06:16,511 info  [main] core.sqoopserver (sqoopserver.java:initialize(55)) - initializing sqoop server. 2017-08-20 14:06:16,521 info  [main] core.propertiesconfigurationprovider (propertiesconfigurationprovider.java:initialize(99)) - starting config file poller thread slf4j: class path contains multiple slf4j bindings. slf4j: found binding in [jar:file:/home/sreeram/sqoop/server/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/staticloggerbinder.class] slf4j: found binding in [jar:file:/home/sreeram/apache-hive-2.3.0-bin/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/staticloggerbinder.class] slf4j: see http://www.slf4j.org/codes.html#multiple_bindings explanation. exception in thread "main" java.lang.runtimeexception: failure in server initialization     @ org.apache.sqoop.core.sqoopserver.initialize(sqoopserver.java:68)     @ org.apache.sqoop.server.sqoopjettyserver.<init>(sqoopjettyserver.java:67)     @ org.apache.sqoop.server.sqoopjettyserver.main(sqoopjettyserver.java:177) caused by: org.apache.sqoop.common.sqoopexception: mapreduce_0002:failure on submission engine initialization - invalid hadoop configuration directory (not directory or permission issues): /etc/hadoop/conf/     @ org.apache.sqoop.submission.mapreduce.mapreducesubmissionengine.initialize(mapreducesubmissionengine.java:97)     @ org.apache.sqoop.driver.jobmanager.initialize(jobmanager.java:257)     @ org.apache.sqoop.core.sqoopserver.initialize(sqoopserver.java:64)     ... 2 more

Comments

Post a Comment

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

i running os ububtu 16.04. ultimate goal able run php script cron job every minute. here php script located @ /var/www/html/tests/test/index.php : <?php $directorypath = $_server['document_root']."/tests/test/data/"; echo "directorypath: $directorypath<br><br>";//check $imagefilepathsarray = glob($directorypath . "*.{png,gif}", glob_brace); echo "<br><br>imagefilepathsarray: "; print_r($imagefilepathsarray);//check ?> when open php script in browser visiting url my-ip-address/tests/test/index.php , get: directorypath: /var/www/html/tests/test/data/ imagefilepathsarray:array( [0] => /var/www/html/tests/test/data/pic.png [1] => /var/www/html/tests/test/data/pic.gif ) before writing cron job in crontab file, need check if can run anywhere using terminal . opened ubuntu terminal @ /home/ location, , executed in terminal: sudo php /var/www/html/tests/test/index.php i got following out...
Read more

php - How can i create a user dashboard -

today have questions you, want create user dashboard site, include (obviously), users data, example -email -username -and others stuff how can information, , print them in html page? if can, how can these information via php sessions? shuld use session? example, if user login, , start new session ( session_start() ), how can data print in dashboard? should use php "project"? in advice, have day , thank time!
Read more

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -

i have jquery mobile page fixed full-screen toolbar, data-tap-toggle enabled. straight under toolbar have positioned banner should slide upwards when toolbar hiding , slide downward when toolbar showing. jquery mobile toggles toolbar applying , removing ui-fixed-hidden class - sadly, can't find in documentation of toolbar widget toggle , hide or show event that. how can detect when toolbar toggled, reposition banner? .banner { position: fixed; background-color: darkseagreen; top: 46px; min-height: 48px; width: 100%; text-align: center; line-height: 48px; } <!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"> <script src="https://code.jquery.com/jquery-1....
Read more