Comments on: Spring Batch 2.0 New Feature Rundown http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/ The voice of SpringSource Wed, 08 Feb 2012 17:31:53 +0000 hourly 1 http://wordpress.org/?v=3.1.1 By: Dave Syer http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-161736 Dave Syer Tue, 07 Apr 2009 16:38:35 +0000 http://blog.springsource.com/?p=509#comment-161736 Well, there are some Batch-related questions in there, so you can try the Batch forum (http://forum.springsource.org/forumdisplay.php?f=41) for those. Try to provide some more detail about what you want / need to do. You can also try the Spring Integration forum (most of the message-heads hang out there now). Well, there are some Batch-related questions in there, so you can try the Batch forum (http://forum.springsource.org/forumdisplay.php?f=41) for those. Try to provide some more detail about what you want / need to do. You can also try the Spring Integration forum (most of the message-heads hang out there now).

]]> By: heina http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-161341 heina Mon, 06 Apr 2009 21:07:54 +0000 http://blog.springsource.com/?p=509#comment-161341 thank you for the quick reply. i found the spring jms forum is pretty abandon sorry i post here again. I found two issues, I use JmsItemReader and setup a pool for taskExecutor but i dont see 10 readers running. in 2.0 API, JmsTransactionManager, it seems like I only get one connection and one session. This transaction strategy will typically be used in combination with SingleConnectionFactory, which uses a single JMS Connection for all JMS access in order to avoid the overhead of repeated Connection creation, typically in a standalone application. Each transaction will then share the same JMS Connection, while still using its own individual JMS Session. transactionManager is required for this simple step bean. what is the best transaction manager for jms reader? really really appreicated. thank you for the quick reply. i found the spring jms forum is pretty abandon sorry i post here again.
I found two issues, I use JmsItemReader and setup a pool for taskExecutor but i dont see 10 readers running.
in 2.0 API, JmsTransactionManager, it seems like I only get one connection and one session.
This transaction strategy will typically be used in combination with SingleConnectionFactory, which uses a single JMS Connection for all JMS access in order to avoid the overhead of repeated Connection creation, typically in a standalone application. Each transaction will then share the same JMS Connection, while still using its own individual JMS Session.

transactionManager is required for this simple step bean. what is the best transaction manager for jms reader?

really really appreicated.

]]> By: Dave Syer http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-160902 Dave Syer Mon, 06 Apr 2009 06:34:56 +0000 http://blog.springsource.com/?p=509#comment-160902 JmsItemReader is nothing but a thin wrapper around a JmsTemplate, so I don't think Spring Batch is going to prevent you from improving your throughput. But as with all use of JMS and Spring, if performance is important you need to be careful with how your JMS provider supplies Connections and MessageConsumers: the latter in particular probably need to be cached. If you are using Spring 2.5.6 then the CachingConnectionFactory will do it, but I'd be surprised if MQ doesn't provide the same features natively. JmsItemReader is nothing but a thin wrapper around a JmsTemplate, so I don't think Spring Batch is going to prevent you from improving your throughput. But as with all use of JMS and Spring, if performance is important you need to be careful with how your JMS provider supplies Connections and MessageConsumers: the latter in particular probably need to be cached. If you are using Spring 2.5.6 then the CachingConnectionFactory will do it, but I'd be surprised if MQ doesn't provide the same features natively.

]]> By: heina http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-159513 heina Fri, 03 Apr 2009 16:58:27 +0000 http://blog.springsource.com/?p=509#comment-159513 Hi I use RC2.0 spring batch and Chunk-oriented Processing is exactly what I need. I use JmsItemReader to read IBM MQ message (commitInterval = 100) and found I can only GET 400 messages in 25 sec after I added taskExecutor in my SimpleStepFactoryBean. Have you guys test the preformance of JmsItemReader? How many message can it GET in one sec? thx Hi
I use RC2.0 spring batch and Chunk-oriented Processing is exactly what I need. I use JmsItemReader to read IBM MQ message (commitInterval = 100) and found I can only GET 400 messages in 25 sec after I added taskExecutor in my SimpleStepFactoryBean. Have you guys test the preformance of JmsItemReader? How many message can it GET in one sec?
thx

]]> By: Dave Syer http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-153122 Dave Syer Sat, 21 Mar 2009 15:23:32 +0000 http://blog.springsource.com/?p=509#comment-153122 Partitioning is all about running the same step in parallel in multiple processes (or threads) with the input data partitioned. See the use guide for more information (http://static.springframework.org/spring-batch/trunk/reference/). Please ask more questions on the forum (better chance of wide readership): http://forum.springframework.org/forumdisplay.php?f=41. Partitioning is all about running the same step in parallel in multiple processes (or threads) with the input data partitioned. See the use guide for more information (http://static.springframework.org/spring-batch/trunk/reference/).

Please ask more questions on the forum (better chance of wide readership): http://forum.springframework.org/forumdisplay.php?f=41.

]]> By: Amit http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-152786 Amit Fri, 20 Mar 2009 21:05:42 +0000 http://blog.springsource.com/?p=509#comment-152786 The framework really seems to be picking fast.Presently in 2.0Rc1 it seems the partitioning is happening at Step level.Few questions if you can throw a light on it? A. Does the framework support Job Level partitioning. A Job has 10 parallel steps, can it be configured to make it run 10 steps on different VM's? B. What is the suggested approach, Breaking in different jobs and then scaling up or breaking in steps? Thanks The framework really seems to be picking fast.Presently in 2.0Rc1 it seems the partitioning is happening at Step level.Few questions if you can throw a light on it?
A. Does the framework support Job Level partitioning. A Job has 10 parallel steps, can it be configured to make it run 10 steps on different VM's?
B. What is the suggested approach, Breaking in different jobs and then scaling up or breaking in steps?

Thanks

]]> By: David J. M. Karlsen http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-127114 David J. M. Karlsen Fri, 31 Oct 2008 14:48:42 +0000 http://blog.springsource.com/?p=509#comment-127114 "Spring Batch is immature enough " - I guess this was supposed to sound "Spring Batch is mature enough"? :-) "Spring Batch is immature enough " – I guess this was supposed to sound "Spring Batch is mature enough"? :-)

]]> By: Paul http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-126232 Paul Fri, 24 Oct 2008 08:29:47 +0000 http://blog.springsource.com/?p=509#comment-126232 This all looks very good, especially the parallel execution bit, which reminds me of the old JES 3 job netting. Now all you need to do is add support to the Spring IDE for visually realizing the structure of your parallel job net. If this were done it should be a relatively easy step to put in some visual monitoring of a batch stream (so you can see what is running, what has run, how long a task has taken etc), all in a GUI. This all looks very good, especially the parallel execution bit, which reminds me of the old JES 3 job netting. Now all you need to do is add support to the Spring IDE for visually realizing the structure of your parallel job net. If this were done it should be a relatively easy step to put in some visual monitoring of a batch stream (so you can see what is running, what has run, how long a task has taken etc), all in a GUI.

]]> By: Michael Moores http://blog.springsource.org/2008/10/21/spring-batch-20-new-feature-rundown/comment-page-1/#comment-125821 Michael Moores Tue, 21 Oct 2008 14:49:51 +0000 http://blog.springsource.com/?p=509#comment-125821 Thanks for the great overview. This will help me justify a migration now. I have made great progress with v1.x; but the new interfaces and integration with Spring Integration in v2.0 will greatly improve the development scalability. Thanks for the great overview.
This will help me justify a migration now.

I have made great progress with v1.x; but
the new interfaces and integration with Spring Integration in v2.0 will
greatly improve the development scalability.

]]>