maxScanRows = 0 does not work |
Lucy |
2007-06-25 11:29:00 |
there is a column all the values are "-" except at line 74632 it is \N.
I set maxScanRows = 0. This column is detected as Date, however the Text
JDBC Driver throws an exception at line 74632 because it \N is not a valid date format. I think this column should be detected as longvarchar since all rows
are scaned, is this a bug? Thanks!
|
Re:maxScanRows = 0 does not work |
HXTT Support |
2007-06-25 20:52:32 |
>except at line 74632 it is \N.
>throws an exception at line 74632 because it \N
Failed to recur. '\n' is a line separator, and should be accepted.
>all the values are "-"
>This column is detected as Date,
That's resulted by customer's requirement. Somce customers used "-" to stuff null date value. The next minor version will take "-" as string, not null date value.
|
Re:Re:maxScanRows = 0 does not work |
Lucy |
2007-06-26 05:57:12 |
Thanks for your reply. However to consider "-" as date value or not is not my point.
My point is that \N (not \n) is detected as String. But when \N is at the 74632th
line, it is not detected as String. Could you run an auto column type detection on the text file that has this problem(If you could, I'll send you the csv text file)? Thanks!
|
Re:Re:Re:maxScanRows = 0 does not work |
HXTT Support |
2007-06-26 06:26:18 |
>\N
Whether n is a number?
|
Re:Re:Re:Re:maxScanRows = 0 does not work |
Lucy |
2007-06-26 07:04:41 |
No it's just \N. It's strange, I generated a text file in which all lines are :
"-"
except that the 74632th line is:
\N
This file works OK and the column is detected as String.
But in my special text file, it doesn't accept the 74632th line because of the \N ,
and the column is detected as Date.
Do you want me to send you the text file?
Thanks a lot!
|
Re:Re:Re:Re:Re:maxScanRows = 0 does not work |
Lucy |
2007-06-26 07:20:05 |
Sorry. I think I'm not very clear about my question. \N is detected as String which
is OK. The problem bothers me is that when \N appears in the 74632th line, it should also detected as String, but in my special file it is not detected as String. So when I try to retrieve the 74632th row from the ResultSet, it throws
an Exception.
|
Re:Re:Re:Re:Re:Re:maxScanRows = 0 does not work |
HXTT Support |
2007-06-26 07:36:53 |
|
We needn't your sample. The next minor version will take "-" as string, not null date value.
|
Re:Re:Re:Re:Re:Re:Re:maxScanRows = 0 does not work |
Lucy |
2007-06-26 08:59:12 |
Thanks for your prompt reply very much! I'm doing more tests on this.
I created a test file with 74632 lines. All the lines are 1 except the
last line is x. When I set maxScanRows to be 74632, the column is detected
as string which is correct. However When I set maxScanRows to be 0,
the column is detected as integer which is not correct. Could you take a look at this?
|
Re:Re:Re:Re:Re:Re:Re:Re:maxScanRows = 0 does not work |
HXTT Support |
2007-06-26 17:34:39 |
>When I set maxScanRows to be 74632, the column is detected
>as string which is correct. However When I set maxScanRows to be 0,
>the column is detected as integer which is not correct.
Yeah. You're right. When set maxScanRows to be 0, HXTT Text (CSV) will detect the first 32767 rows to decide column type to avoid the possilbe overload. The next minor version will use 0x7ffffffe rows.
|
Main
webmaster@hxtt.com