r - Do not see any running application on sever UI -


i'm trying connect spark server sparklyr locally. in practice, on server, open r session , execute 

library(sparklyr) library(dplyr) sc <- spark_connect(master = "local")

i no error message, when open server ui on

http://my.server.local:8080/

i not see running application. guess there issue ?

when open sparkr console directly, i'm able see running application. work sparklyr, how should ?

when starting local server, example:

fokkos-macbook-pro:~ fokkodriesprong$ sparkr  r version 3.4.1 (2017-06-30) -- "single candle" copyright (c) 2017 r foundation statistical computing platform: x86_64-apple-darwin16.7.0 (64-bit)  r free software , comes absolutely no warranty. welcome redistribute under conditions. type 'license()' or 'licence()' distribution details.    natural language support running in english locale  r collaborative project many contributors. type 'contributors()' more information , 'citation()' on how cite r or r packages in publications.  type 'demo()' demos, 'help()' on-line help, or 'help.start()' html browser interface help. type 'q()' quit r.  launching java spark-submit command /usr/local/cellar/apache-spark/2.2.0/libexec/bin/spark-submit   "sparkr-shell" /var/folders/dm/5qvjnrpx4m92318vwt4svfsh0000gn/t//rtmpgtr1tn/backend_port1227e57d8a425  using spark's default log4j profile: org/apache/spark/log4j-defaults.properties setting default log level "warn". adjust logging level use sc.setloglevel(newlevel). sparkr, use setloglevel(newlevel). 17/08/21 15:16:09 warn nativecodeloader: unable load native-hadoop library platform... using builtin-java classes applicable 17/08/21 15:16:13 warn objectstore: failed database global_temp, returning nosuchobjectexception   welcome     ____              __     / __/__  ___ _____/ /__    _\ \/ _ \/ _ `/ __/  '_/   /___/ .__/\_,_/_/ /_/\_\   version  2.2.0      /_/     sparksession available 'spark'. during startup - warning messages: 1: setting lc_collate failed, using "c"  2: setting lc_time failed, using "c"  3: setting lc_messages failed, using "c"  4: setting lc_monetary failed, using "c"  >

then spark ui should available @ http://localhost:4040/


Comments

Post a Comment

Popular posts from this blog

python - Operations inside variables -

this question has answer here: evaluating mathematical expression in string 12 answers i want make python script finds maximum possible output using 2 operations. problem says there syntax error @ 2nd last line, in b in there. how can fix it? x = 0 = int(input("1st number:")) c = int(input("2nd number:" )) e = int(input("3rd number:" )) in range(4): if == 0: b = "+" elif == 1: b = "-" elif == 2: b = "/" else: b = "*" j in range(4): if j == 0: d = "+" elif j == 1: d = "-" elif j == 2: d = "/" else: d = "*" k = b c d e print(k) if you're after variables e on single line, couldn...
Read more

Generic Map Parameter java -

i having lot of methods of type: public static list<eduusers> getdetails(class c, map<string, integer> params) { list<eduusers> details = null; session session = hibernateutil.getsessionfactory().opensession(); transaction tx = null; try { tx = session.begintransaction(); criteria cr = session.createcriteria(c); (map.entry<string, integer> entry : params.entryset()) { cr.add(restrictions.eq(entry.getkey(), entry.getvalue())); } details = cr.list(); tx.commit(); } catch (exception asd) { log.debug(asd.getmessage()); if (tx != null) { tx.commit(); } } { session.close(); } return details; } i trying have generic method them , have written far: public static <t> list<t> getdetails(class<t> c, class<t> b) { l...
Read more

arrays - What causes a java.lang.ArrayIndexOutOfBoundsException and how do I prevent it? -

what arrayindexoutofboundsexception mean , how rid of it? here code sample triggers exception: string[] name = {"tom", "dick", "harry"}; for(int = 0; i<=name.length; i++) { system.out.print(name[i] +'\n'); } your first port of call should documentation explains reasonably clearly: thrown indicate array has been accessed illegal index. index either negative or greater or equal size of array. so example: int[] array = new int[5]; int boom = array[10]; // throws exception as how avoid it... um, don't that. careful array indexes. one problem people run thinking arrays 1-indexed, e.g. int[] array = new int[5]; // ... populate array here ... (int index = 1; index <= array.length; index++) { system.out.println(array[index]); } that miss out first element (index 0) , throw exception when index 5. valid indexes here 0-4 inclusive. correct, idiomatic for statement here be: for (int index = 0; index <...
Read more