Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
Punam Dhaitonde |
2020-08-07 01:55:38 |
I am using HXTT driver 7.0.113 and Teiid 11.1.2 to connect to text and csv file using odbc schema file.
I am getting a java.sql.SQLException: Bad message error while loading the metadata due to which vdb deployment stopped.
Stacktrace :
2020-08-07 10:04:48,315 WARN [org.teiid.RUNTIME] (Worker2_async-teiid-threads2) TEIID50036 VDB SvcSourceVdb_TESTFileDS2020080709583318.1 model "TESTFileDS2020080709583318" metadata failed to load. Reason:TEIID11010 java.sql.SQLException: Bad message: org.teiid.translator.TranslatorException: TEIID11010 java.sql.SQLException: Bad message
at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:308)
at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:68)
at org.teiid.query.metadata.NativeMetadataRepository.getMetadata(NativeMetadataRepository.java:91)
at org.teiid.query.metadata.NativeMetadataRepository.loadMetadata(NativeMetadataRepository.java:57)
at org.teiid.query.metadata.ChainingMetadataRepository.loadMetadata(ChainingMetadataRepository.java:51)
at org.teiid.jboss.VDBService$6.run(VDBService.java:337)
at org.teiid.jboss.VDBService$7.run(VDBService.java:388)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:277)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:115)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:206)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLException: Bad message
at com.caigen.global.ar.a(Unknown Source)
at com.caigen.global.ar.a(Unknown Source)
at com.hxtt.c.a4.y(Unknown Source)
at com.hxtt.c.a4.iR(Unknown Source)
at com.hxtt.c.i.iT(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
at com.hxtt.sql.b4.a(Unknown Source)
But it is working properly with the HXTT Text(CSV) driver 6.0.002 without throwing any exception.
Is there any fix or workaround to overcome this issue or any limitation with HXTT Text(CSV) driver 7.0.113.
Thanks,
Punam
|
Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
HXTT Support |
2020-08-08 02:31:10 |
What's your jdbc url?
>SvcSourceVdb_TESTFileDS2020080709583318.1 model "TESTFileDS2020080709583318"
> metadata failed to load. Reason:TEIID11010
It seems that your TESTFileDS2020080709583318 file can not be load.
>But it is working properly with the HXTT Text(CSV) driver 6.0.002 without throwing any exception.
Maybe v6.0 in 2017 had less data verification than the latest package.
|
Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
Punam Dhaitonde |
2020-08-09 19:49:18 |
Please find attached URL for the same :
jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0
|
Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
HXTT Support |
2020-08-09 21:28:22 |
It seems that you're using CSV file.
Try
jdbc:csv:sftp://abc:efg@10.10.10.10:22/home/abc?odbcSchemaFile=target.sch;csvfileExtension=csv;delayedClose=0;refreshInterval=0
|
Re:Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
Punam Dhaitonde |
2020-08-09 21:53:40 |
With this URL also I am getting same error.
Also if I am trying to connect to text file using below URL, getting same error.
Connection URL :
jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.txt?odbcSchemaFile=target.sch;fileExtension=txt;delayedClose=0;refreshInterval=0
|
Re:Re:Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
HXTT Support |
2020-08-10 00:20:39 |
You can try
select * from target
to see the error message.
But, you should avoid to use target.csv and target.txt at the same directory.
|
Re:Re:Re:Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
Punam Dhaitonde |
2020-08-11 07:56:31 |
We are not keeping both the files in same directory. I sent it just as an example.
We are not able to connect to flat file so, could not try with the query.
We tried to connect to FTP location with header false delimited csv file with ODBC schema file. But getting below error.
Schema file :
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
COL1=ID varchar
COL2=FirstName varchar
FTP Error : Invalid table; Table TESTFileDS20200811191000000._CURRENT_.abcd.target.csv has no columns defined.
2020-08-11 19:12:24,819 WARN [org.teiid.RUNTIME] (Worker6_async-teiid-threads7) TEIID40073 The metadata for the VDB SvcSourceVdb_TESTFileDS20200811191000000.1 is loaded, however it is not valid. Check models for errors to correct the metadata and re-deploy: SvcSourceVdb_TESTFileDS20200811191000000
2020-08-11 19:12:24,819 INFO [org.teiid.RUNTIME.VDBLifeCycleListener] (Worker6_async-teiid-threads7) TEIID40003 VDB SvcSourceVdb_TESTFileDS20200811191222287.1 is set to FAILED
We also tried with SFTP location with delimited csv file.But getting security permission issue.
Could you please tell us if there is any fix or workaround for the above issues.
Also as mentioned in previous comment, there might be more data verification added in HXTT Text(CSV) driver 7.0. So, Could please provide us information about additional data verification's.
|
Re:Re:Re:Re:Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
HXTT Support |
2020-08-11 08:13:19 |
2018-08-30 provides _CURRENT_ as a pseudo name for the current catalog for JasperSoft tool. The old "." name can still be used too.
|
Re:Re:Re:Re:Re:Re:Re:Re:Unable to connect to txt and csv file using HXTT Text(CSV) driver 7.0.113 |
HXTT Support |
2020-08-11 08:17:31 |
> TESTFileDS20200811191000000._CURRENT_.abcd.target.csv has no columns defined.
Maybe you should use
jdbc:csv:sftp://.../home/abc/TESTFileDS20200811191000000/abcd?...
|