apache spark - Lost task 1.0 in stage 4.3 (cs-xx02): FetchFailed(BlockManagerId(2, cs-xx01, 9080), shuffleId=2, mapId=0, reduceId=1 -


when run spark, error appears:

lost task 1.0 in stage 4.3 (tid 2003, cs-xx02): fetchfailed(blockmanagerid(2, cs-xx01, portxx), shuffleid=2, mapid=0, reduceid=1, message=org.apache.spark.shuffle.fetchfailedexception: failed connect cs-xx01

caused by: java.io.ioexception: failed connect cs-xx01 @ org.apache.spark.network.client.transportclientfactory.createclient(transportclientfactory.java:228) @ org.apache.spark.network.client.transportclientfactory.createclient(transportclientfactory.java:179) @ org.apache.spark.network.netty.nettyblocktransferservice$$anon$1.createandstart(nettyblocktransferservice.scala:96) @ org.apache.spark.network.shuffle.retryingblockfetcher.fetchalloutstanding(retryingblockfetcher.java:140) @ org.apache.spark.network.shuffle.retryingblockfetcher.access$200(retryingblockfetcher.java:43) @ org.apache.spark.network.shuffle.retryingblockfetcher$1.run(retryingblockfetcher.java:170) @ java.util.concurrent.executors$runnableadapter.call(executors.java:471) @ java.util.concurrent.futuretask.run(futuretask.java:262) ... 3 more caused by: java.net.connectexception: connection refused: cs-xx01 @ sun.nio.ch.socketchannelimpl.checkconnect(native method) @ sun.nio.ch.socketchannelimpl.finishconnect(socketchannelimpl.java:739) @ io.netty.channel.socket.nio.niosocketchannel.dofinishconnect(niosocketchannel.java:224) @ io.netty.channel.nio.abstractniochannel$abstractniounsafe.finishconnect(abstractniochannel.java:289) @ io.netty.channel.nio.nioeventloop.processselectedkey(nioeventloop.java:528) @ io.netty.channel.nio.nioeventloop.processselectedkeysoptimized(nioeventloop.java:468) @ io.netty.channel.nio.nioeventloop.processselectedkeys(nioeventloop.java:382) @ io.netty.channel.nio.nioeventloop.run(nioeventloop.java:354) ...

lost task 0.0 in stage 10.2 (tid 3766, cs-xx01): fetchfailed(null, shuffleid=8, mapid=-1, reduceid=0, message= org.apache.spark.shuffle.metadatafetchfailedexception: missing output location shuffle 8


Comments

Post a Comment

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

i running os ububtu 16.04. ultimate goal able run php script cron job every minute. here php script located @ /var/www/html/tests/test/index.php : <?php $directorypath = $_server['document_root']."/tests/test/data/"; echo "directorypath: $directorypath<br><br>";//check $imagefilepathsarray = glob($directorypath . "*.{png,gif}", glob_brace); echo "<br><br>imagefilepathsarray: "; print_r($imagefilepathsarray);//check ?> when open php script in browser visiting url my-ip-address/tests/test/index.php , get: directorypath: /var/www/html/tests/test/data/ imagefilepathsarray:array( [0] => /var/www/html/tests/test/data/pic.png [1] => /var/www/html/tests/test/data/pic.gif ) before writing cron job in crontab file, need check if can run anywhere using terminal . opened ubuntu terminal @ /home/ location, , executed in terminal: sudo php /var/www/html/tests/test/index.php i got following out...
Read more

php - How can i create a user dashboard -

today have questions you, want create user dashboard site, include (obviously), users data, example -email -username -and others stuff how can information, , print them in html page? if can, how can these information via php sessions? shuld use session? example, if user login, , start new session ( session_start() ), how can data print in dashboard? should use php "project"? in advice, have day , thank time!
Read more

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -

i have jquery mobile page fixed full-screen toolbar, data-tap-toggle enabled. straight under toolbar have positioned banner should slide upwards when toolbar hiding , slide downward when toolbar showing. jquery mobile toggles toolbar applying , removing ui-fixed-hidden class - sadly, can't find in documentation of toolbar widget toggle , hide or show event that. how can detect when toolbar toggled, reposition banner? .banner { position: fixed; background-color: darkseagreen; top: 46px; min-height: 48px; width: 100%; text-align: center; line-height: 48px; } <!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"> <script src="https://code.jquery.com/jquery-1....
Read more