spring - Cannot get Remote Chunking to work for an existing batch job -


i need in getting spring batch remote chunking configuration work successfully. 2 approaches have been tried, according m.minella's youtube tutorial on remote chunking, original batch job configuration not require modified.

where according example here configuration of job has split based on given role, master or slave.

our current batch job configuration is:

<job id="samplejob" restartable="false"      xmlns="http://www.springframework.org/schema/batch">     <step id="settlementstep">         <tasklet task-executor="staskexecutor" throttle-limit="7">             <chunk reader="settlement_reader"                    processor="settlement_processor"                    writer="settlement_writer"                    commit-interval="1">             </chunk>         </tasklet>     </step> </job>  <bean id="settlementjobchunkhandler" class="org.springframework.batch.integration.chunk.remotechunkhandlerfactorybean">     <property name="chunkwriter" ref="settlementjobchunkwriter" />     <property name="step" ref="settlementstep" /> </bean>  <bean id="settlementjobchunkwriter" class="org.springframework.batch.integration.chunk.chunkmessagechannelitemwriter">     <property name="messagingoperations" ref="settlementjobmessagingtemplate"/>     <property name="replychannel" ref="settlementjob.replies.chunking" />     <property name="maxwaittimeouts" value="100" />     <property name="throttlelimit" value="100"/> </bean>  <bean id="settlementjobmessagingtemplate" class="org.springframework.integration.core.messagingtemplate">     <property name="defaultchannel" ref="settlementjob.requests.chunking" />     <property name="receivetimeout" value="100" /> </bean>  <int:channel id="settlementjob.replies.chunking">     <!--<int:queue/>     <int:interceptors>         <bean id="pollerinterceptor"                     class="org.springframework.batch.integration.chunk.messagesourcepollerinterceptor">             <property name="messagesource">                 <bean class="org.springframework.integration.jms.jmsdestinationpollingsource">                     <constructor-arg>                         <bean class="org.springframework.jms.core.jmstemplate">                             <property name="connectionfactory" ref="jmsconnectionfactory" />                             <property name="defaultdestinationname" value="queue-settlementjob-replies" />                             <property name="receivetimeout" value="100" />                         </bean>                     </constructor-arg>                 </bean>             </property>             <property name="channel" ref="settlementjob.incoming.chunking"/>         </bean>     </int:interceptors>--> </int:channel>  <int:channel id="settlementjob.requests.chunking"/> <int:channel id="settlementjob.incoming.chunking"/>  <bean id="settlementjobjmsdestinationpollingsource" class="org.springframework.integration.jms.jmsdestinationpollingsource">     <constructor-arg ref="jmstemplate"/> </bean>  <bean id="settlementjobrequests" class="org.apache.activemq.command.activemqqueue">     <constructor-arg index="0" value="queue-settlementjob-requests"/> </bean>  <bean id="settlementjobreplies" class="org.apache.activemq.command.activemqqueue">     <constructor-arg index="0" value="queue-settlementjob-replies"/> </bean>

the above configuration common , shared both master , slave.

master node configuration:

    <!-- master --> <int-jms:outbound-channel-adapter channel="settlementjob.requests.chunking"                                   connection-factory="jmsconnectionfactory"                                   destination="settlementjobrequests">     <int:poller fixed-rate="1000"/> </int-jms:outbound-channel-adapter>  <int-jms:message-driven-channel-adapter connection-factory="jmsconnectionfactory"                                         destination="settlementjobreplies"                                         channel="settlementjob.incoming.chunking"/>  <bean id="settlementjobmessageextractor" class="org.springframework.batch.integration.chunk.jmsredeliveredextractor"/>  <int:transformer input-channel="settlementjob.incoming.chunking" output-channel="settlementjob.replies.chunking"                  ref="settlementjobmessageextractor" method="extract"> </int:transformer>

slave node configuration:

<!-- slave configration --> <jms:listener-container connection-factory="jmsconnectionfactory" transaction-manager="transactionmanager"                         acknowledge="transacted" concurrency="8">     <jms:listener destination="queue-settlementjob-requests" response-destination="queue-settlementjob-replies"                   ref="settlementjobchunkhandler" method="handlechunk"/> </jms:listener-container>  <bean id="settlementjobchunkprocessor" class="org.springframework.batch.core.step.item.simplechunkprocessor">     <property name="itemprocessor" ref="settlement_processor"/>     <property name="itemwriter" ref="energy_writer"/> </bean>  <bean id="settlementjobchunkhandler" class="org.springframework.batch.integration.chunk.chunkprocessorchunkhandler">     <property name="chunkprocessor" ref="settlementjobchunkprocessor"/> </bean>

the above configuration per opencredo github link, however, issue not records reaching amq. job hangs without completing , processing records.

of more 1000 test records, 17 processed. on single node, no master, no slave config, i.e. vanilla non-remote-chunking configuration, same job processes records successfully.

what missing.


Comments

Post a Comment

Popular posts from this blog

python - Operations inside variables -

this question has answer here: evaluating mathematical expression in string 12 answers i want make python script finds maximum possible output using 2 operations. problem says there syntax error @ 2nd last line, in b in there. how can fix it? x = 0 = int(input("1st number:")) c = int(input("2nd number:" )) e = int(input("3rd number:" )) in range(4): if == 0: b = "+" elif == 1: b = "-" elif == 2: b = "/" else: b = "*" j in range(4): if j == 0: d = "+" elif j == 1: d = "-" elif j == 2: d = "/" else: d = "*" k = b c d e print(k) if you're after variables e on single line, couldn...
Read more

Generic Map Parameter java -

i having lot of methods of type: public static list<eduusers> getdetails(class c, map<string, integer> params) { list<eduusers> details = null; session session = hibernateutil.getsessionfactory().opensession(); transaction tx = null; try { tx = session.begintransaction(); criteria cr = session.createcriteria(c); (map.entry<string, integer> entry : params.entryset()) { cr.add(restrictions.eq(entry.getkey(), entry.getvalue())); } details = cr.list(); tx.commit(); } catch (exception asd) { log.debug(asd.getmessage()); if (tx != null) { tx.commit(); } } { session.close(); } return details; } i trying have generic method them , have written far: public static <t> list<t> getdetails(class<t> c, class<t> b) { l...
Read more

arrays - What causes a java.lang.ArrayIndexOutOfBoundsException and how do I prevent it? -

what arrayindexoutofboundsexception mean , how rid of it? here code sample triggers exception: string[] name = {"tom", "dick", "harry"}; for(int = 0; i<=name.length; i++) { system.out.print(name[i] +'\n'); } your first port of call should documentation explains reasonably clearly: thrown indicate array has been accessed illegal index. index either negative or greater or equal size of array. so example: int[] array = new int[5]; int boom = array[10]; // throws exception as how avoid it... um, don't that. careful array indexes. one problem people run thinking arrays 1-indexed, e.g. int[] array = new int[5]; // ... populate array here ... (int index = 1; index <= array.length; index++) { system.out.println(array[index]); } that miss out first element (index 0) , throw exception when index 5. valid indexes here 0-4 inclusive. correct, idiomatic for statement here be: for (int index = 0; index <...
Read more