Main   Products   Offshore Outsourcing   Customers   Partners   ContactUs  
JDBC Databases
  HXTT Access 7.0.014
  HXTT Cobol 4.0.014
  HXTT DBF 7.0.014
  HXTT Excel 6.0.015
  HXTT Paradox 7.0.014
 
  Buy Now
  Support
  Download
  Document
  FAQ
  HXTT PDF 1.1.014
  HXTT Text(CSV) 7.0.014
  HXTT Word 1.0.012
  HXTT XML 3.0.014
Offshore Outsourcing
Free Resources
  Firewall Tunneling
  Search Indexing Robot
  Conditional Compilation
  Password Recovery for MS Access
  Password Recovery for Corel Paradox
  Checksum Tool for MD5
  Character Set Converter
  Pyramid - Poker of ZYH
   
   
   
Heng Xing Tian Tai Lab of Xi'an City (abbr, HXTT)

HXTT Paradox
StackOverflow on large table
Simeon Petkov
2012-02-17 12:24:28.0
We are using the httx jdbc driver version 4.0. The use-case is a Kettle job processing some quite large tables (few million entries). Approx. on every second / third run the process crashes with a StackOverflow error from the httx JDBC driver. The log output is not much:

ERROR 16-02 23:30:15,363 - Table input - java.lang.StackOverflowError
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
at com.hxtt.global.ad.int(Unknown Source)
... and a few hundred more repetitions of the last line

Any idea how to handle it? Heap size and stack size are set to large enough values with no difference in the behaviour.

Appreciating your feedback!
Re:StackOverflow on large table
HXTT Support
2012-02-17 19:55:35.0
>at com.hxtt.global.ad.int(Unknown Source)
It seems that you have download the latest Paradox_JDBC40.jar . But that error message should be thrown by old version. Please check your classpath, and make sure it's through by the latest version.
Re:Re:StackOverflow on large table
Simeon Petkov
2012-02-21 01:22:31.0
Not much of a difference with the new one. Could you please look into it - it is becoming a real pain to run everything 3 times daily. The behaviour of the driver is not predictable - the exception occurs sporadically.

ERROR 21-02 10:42:05,803 - User Defined Java Class - Unexpected error
ERROR 21-02 10:42:05,805 - User Defined Java Class - java.lang.StackOverflowError
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
Re:Re:Re:StackOverflow on large table
HXTT Support
2012-02-21 11:24:34.0
Fixed. Please download the latest package file.
Re:Re:Re:Re:StackOverflow on large table
Simeon Petkov
2012-02-22 01:36:08.0
Re-an it today with the new version. The error is still the same:

ERROR 22-02 10:28:32,740 - User Defined Java Class - Unexpected error
ERROR 22-02 10:28:32,742 - User Defined Java Class - java.lang.StackOverflowError
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
at com.hxtt.global.ae.int(Unknown Source)
Re:Re:Re:Re:Re:StackOverflow on large table
Simeon Petkov
2012-02-22 02:02:39.0
A little bit more information from our side:

- The error seems to occur either on statement creation (statement = connection.createStatement();) or on query execution (resultSet = statement.executeQuery("SELECT ID...), I guess you know better when the int method is being called.

If you do not manage to fix it immediately - could you maybe provide some more detailed logging. Also - please let me know if you need any more input from our side (debug logs, etc. - just give a short manual how to turn everything on to debug level and which output you would like). We can rerun the process for testing purposes anytime.
Re:Re:Re:Re:Re:Re:StackOverflow on large table
Simeon Petkov
2012-02-22 07:50:06.0
Some more information: with the new version the StackOverflow error occurs every time. On the last run it was on executing a query with the driver:

resultSet = statement.executeQuery("SEL...

We are switching back to the older version, since we have to provide data on a production system. Please give as feedback as soon as you have progress.
Re:Re:Re:Re:Re:Re:Re:StackOverflow on large table
HXTT Support
2012-02-23 02:16:10.0
Fixed now. Thanks for your response. Please download it.
Re:Re:Re:Re:Re:Re:Re:Re:StackOverflow on large table
Simeon Petkov
2012-02-27 22:22:04.0
The last two runs finished successfully. Seems you got it right this time :)

Many thanks for your support!

Search Key   Search by Last 50 Questions




Google
 

Email: webmaster@hxtt.com
Copyright © 2003-2019 Heng Xing Tian Tai Lab of Xi'an City. | All Rights Reserved. | Privacy | Legal | Sitemap