- Nuiton-csv-commits - mailman.cloud.codelutin.com

r2620 - trunk
by maven-release＠users.nuiton.org May 23, 2014

May 23, 2014

Author: maven-release Date: 2014-05-23 17:19:15 +0200 (Fri, 23 May 2014) New Revision: 2620 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2620 Log: [maven-release-plugin] prepare for next development iteration Modified: trunk/pom.xml Modified: trunk/pom.xml =================================================================== --- trunk/pom.xml 2014-05-23 15:19:12 UTC (rev 2619) +++ trunk/pom.xml 2014-05-23 15:19:15 UTC (rev 2620) @@ -9,7 +9,7 @@ </parent> <artifactId>nuiton-csv</artifactId> - <version>3.0-rc-2</version> + <version>3.0-SNAPSHOT</version> <name>Nuiton CSV</name> <description>Simple CSV API</description> @@ -46,12 +46,12 @@ <scm> <connection> - scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-2 + scm:svn:https://svn.nuiton.org/nuiton-csv/trunk </connection> <developerConnection> - scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-2 + scm:svn:https://svn.nuiton.org/nuiton-csv/trunk </developerConnection> - <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/tags/nuiton-cs…</url> + <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/trunk</url> </scm> <distributionManagement> <site>

1 0

r2619 - in tags: . nuiton-csv-3.0-rc-2
by maven-release＠users.nuiton.org May 23, 2014

May 23, 2014

Author: maven-release Date: 2014-05-23 17:19:12 +0200 (Fri, 23 May 2014) New Revision: 2619 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2619 Log: [maven-release-plugin] copy for tag nuiton-csv-3.0-rc-2 Added: tags/nuiton-csv-3.0-rc-2/ Property changes on: tags/nuiton-csv-3.0-rc-2 ___________________________________________________________________ Added: svn:mergeinfo + Added: svn:ignore + target velocity.log maven.log .eclipse .classpath *.iml *.ipr *.iws .settings .project testdir .idea

1 0

r2618 - trunk
by maven-release＠users.nuiton.org May 23, 2014

May 23, 2014

Author: maven-release Date: 2014-05-23 17:19:08 +0200 (Fri, 23 May 2014) New Revision: 2618 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2618 Log: [maven-release-plugin] prepare release nuiton-csv-3.0-rc-2 Modified: trunk/pom.xml Modified: trunk/pom.xml =================================================================== --- trunk/pom.xml 2014-05-23 15:13:18 UTC (rev 2617) +++ trunk/pom.xml 2014-05-23 15:19:08 UTC (rev 2618) @@ -9,7 +9,7 @@ </parent> <artifactId>nuiton-csv</artifactId> - <version>3.0-SNAPSHOT</version> + <version>3.0-rc-2</version> <name>Nuiton CSV</name> <description>Simple CSV API</description> @@ -46,12 +46,12 @@ <scm> <connection> - scm:svn:https://svn.nuiton.org/nuiton-csv/trunk + scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-2 </connection> <developerConnection> - scm:svn:https://svn.nuiton.org/nuiton-csv/trunk + scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-2 </developerConnection> - <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/trunk</url> + <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/tags/nuiton-cs…</url> </scm> <distributionManagement> <site>

1 0

Jenkins build became unstable: nuiton-csv-ci #6
by admin+ci-nuiton.org＠codelutin.com May 23, 2014

May 23, 2014

See <http://ci.nuiton.org/jenkins/job/nuiton-csv-ci/6/changes>

1 1

Jenkins build became unstable: nuiton-csv-ci » Nuiton CSV #6
by admin+ci-nuiton.org＠codelutin.com May 23, 2014

May 23, 2014

See <http://ci.nuiton.org/jenkins/job/nuiton-csv-ci/org.nuiton$nuiton-csv/6/chan…>

1 1

r2617 - trunk/src/main/java/org/nuiton/csv
by bleny＠users.nuiton.org May 23, 2014

May 23, 2014

Author: bleny Date: 2014-05-23 17:13:18 +0200 (Fri, 23 May 2014) New Revision: 2617 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2617 Log: fixes #3144 remove BOM from header Modified: trunk/src/main/java/org/nuiton/csv/Import.java Modified: trunk/src/main/java/org/nuiton/csv/Import.java =================================================================== --- trunk/src/main/java/org/nuiton/csv/Import.java 2014-05-23 14:54:53 UTC (rev 2616) +++ trunk/src/main/java/org/nuiton/csv/Import.java 2014-05-23 15:13:18 UTC (rev 2617) @@ -64,6 +64,13 @@ /** Logger. */ private static final Log log = LogFactory.getLog(Import.class); + /** + * BOM is a character you can find in the beginning of a UTF-8 encoded file that should not be interpreted. + * + * See http://en.wikipedia.org/wiki/Byte_order_mark + */ + protected static final char BOM_CHARACTER = '\uFEFF'; + /** Csv import model. */ protected ImportModel<E> model; @@ -331,6 +338,9 @@ try { String[] result = reader.getHeaders(); + if (result.length > 0) { + result[0] = removeBomCharacter(result[0]); + } return result; } catch (IOException e) { throw new ImportRuntimeException( @@ -338,6 +348,10 @@ } } + protected String removeBomCharacter(String s) { + return s.replaceFirst(BOM_CHARACTER + "?", ""); + } + protected List<ImportableColumn<E, Object>> getNonIgnoredHeaders() { List<ImportableColumn<E, Object>> nonIgnoredHeaders = new ArrayList<ImportableColumn<E, Object>>();

1 0

r2616 - in trunk/src/test: java/org/nuiton/csv resources
by bleny＠users.nuiton.org May 23, 2014

May 23, 2014

Author: bleny Date: 2014-05-23 16:54:53 +0200 (Fri, 23 May 2014) New Revision: 2616 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2616 Log: refs #3144 add test to prove issue Added: trunk/src/test/java/org/nuiton/csv/Utf8WithBomTest.java trunk/src/test/resources/csv-file-encoded-in-UTF-8-with-BOM.csv Added: trunk/src/test/java/org/nuiton/csv/Utf8WithBomTest.java =================================================================== --- trunk/src/test/java/org/nuiton/csv/Utf8WithBomTest.java (rev 0) +++ trunk/src/test/java/org/nuiton/csv/Utf8WithBomTest.java 2014-05-23 14:54:53 UTC (rev 2616) @@ -0,0 +1,63 @@ +package org.nuiton.csv; + +import org.apache.commons.lang3.ObjectUtils; +import org.apache.commons.logging.Log; +import org.apache.commons.logging.LogFactory; +import org.junit.Assert; +import org.junit.Test; + +import java.io.InputStream; +import java.util.List; + +public class Utf8WithBomTest { + + private static final Log log = LogFactory.getLog(Utf8WithBomTest.class); + + protected ImportModel<ObjectUtils.Null> importModel = new ImportModel<ObjectUtils.Null>() { + + @Override + public char getSeparator() { + return ';'; + } + + @Override + public void pushCsvHeaderNames(List<String> headerNames) { + // do nothing + } + + @Override + public ObjectUtils.Null newEmptyInstance() { + throw new UnsupportedOperationException(); + } + + @Override + public Iterable<ImportableColumn<ObjectUtils.Null, Object>> getColumnsForImport() { + ModelBuilder<ObjectUtils.Null> builder = new ModelBuilder<ObjectUtils.Null>(); + + builder.newMandatoryColumn("N° 1", "whatever"); + builder.newMandatoryColumn("N° 2", "whatever"); + builder.newMandatoryColumn("Nom", "whatever"); + + return (Iterable) builder.getColumnsForImport(); + } + + }; + + @Test + public void testImport() { + + InputStream csv = getClass().getResourceAsStream("/csv-file-encoded-in-UTF-8-with-BOM.csv"); + + Import<ObjectUtils.Null> csvImport = Import.newImport(importModel, csv); + + try { + csvImport.prepareAndValidate(); + } catch (ImportRuntimeException e) { + if (log.isDebugEnabled()) { + log.debug("exception caught", e); + } + Assert.fail("no exception should have been raised"); + } + + } +} Added: trunk/src/test/resources/csv-file-encoded-in-UTF-8-with-BOM.csv =================================================================== --- trunk/src/test/resources/csv-file-encoded-in-UTF-8-with-BOM.csv (rev 0) +++ trunk/src/test/resources/csv-file-encoded-in-UTF-8-with-BOM.csv 2014-05-23 14:54:53 UTC (rev 2616) @@ -0,0 +1,3 @@ +N° 1;N° 2;Nom +1;2;Taiste +

1 0

r2615 - trunk/src/main/java/org/nuiton/csv
by bleny＠users.nuiton.org May 23, 2014

May 23, 2014

Author: bleny Date: 2014-05-23 16:42:34 +0200 (Fri, 23 May 2014) New Revision: 2615 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2615 Log: fixes #3203 Modified: trunk/src/main/java/org/nuiton/csv/Common.java Modified: trunk/src/main/java/org/nuiton/csv/Common.java =================================================================== --- trunk/src/main/java/org/nuiton/csv/Common.java 2014-03-26 07:44:09 UTC (rev 2614) +++ trunk/src/main/java/org/nuiton/csv/Common.java 2014-05-23 14:42:34 UTC (rev 2615) @@ -182,9 +182,12 @@ public static class DateValue implements ValueParserFormatter<Date> { + protected String dateFormatPattern; + protected DateFormat dateFormat; public DateValue(String dateFormatPattern) { + this.dateFormatPattern = dateFormatPattern; dateFormat = new SimpleDateFormat(dateFormatPattern); } @@ -192,7 +195,11 @@ public Date parse(String value) throws ParseException { Date date = null; if (StringUtils.isNotBlank(value)) { - date = dateFormat.parse(value); + try { + date = dateFormat.parse(value); + } catch (ParseException e) { + throw new ParseException("unable to parse date, expected format is " + dateFormatPattern, 0); + } } return date; }

1 0

[ANN] - Nuiton CSV 3.0-rc-1 released
by nuiton.org Release Notification March 26, 2014

March 26, 2014

The Nuiton CSV team is pleased to announce the nuiton-csv-3.0-rc-1 release! Simple CSV API Documentation of the project can be found here: https://doc.nuiton.org/nuiton-csv Changes ------- Changes in this version include: New features: o Add a *YEAR* ValueParserformatter Issue: 3133. Thanks to Tony Chemit. Resolved by tchemit. o Be able to parse more integer and long number Issue: 3131. Thanks to Tony Chemit. Resolved by tchemit. Changes: o Updates mavenpom to 5.0.4 Issue: 3132. Thanks to Tony Chemit. Resolved by tchemit. Downloads --------- For a manual installation, you can download files here: https://forge.nuiton.org/projects/nuiton-csv/files * nuiton-csv-3.0-rc-1-deps.zip - https://forge.nuiton.org/attachments/download/1016 * nuiton-csv-3.0-rc-1-full.zip - https://forge.nuiton.org/attachments/download/1017 Maven artifacts --------------- Artifacts are deployed in Maven Central Repository http://repo1.maven.org/maven2/ Find us at * http://search.maven.org/#artifactdetails|org.nuiton|nuiton-csv|3.0-rc-1|jar Have fun! -Nuiton CSV team

1 0

r2614 - trunk
by maven-release＠users.nuiton.org March 26, 2014

March 26, 2014

Author: maven-release Date: 2014-03-26 08:44:09 +0100 (Wed, 26 Mar 2014) New Revision: 2614 Url: http://forge.nuiton.org/projects/nuiton-csv/repository/revisions/2614 Log: [maven-release-plugin] prepare for next development iteration Modified: trunk/pom.xml Modified: trunk/pom.xml =================================================================== --- trunk/pom.xml 2014-03-26 07:44:06 UTC (rev 2613) +++ trunk/pom.xml 2014-03-26 07:44:09 UTC (rev 2614) @@ -9,7 +9,7 @@ </parent> <artifactId>nuiton-csv</artifactId> - <version>3.0-rc-1</version> + <version>3.0-SNAPSHOT</version> <name>Nuiton CSV</name> <description>Simple CSV API</description> @@ -46,12 +46,12 @@ <scm> <connection> - scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-1 + scm:svn:https://svn.nuiton.org/nuiton-csv/trunk </connection> <developerConnection> - scm:svn:https://svn.nuiton.org/nuiton-csv/tags/nuiton-csv-3.0-rc-1 + scm:svn:https://svn.nuiton.org/nuiton-csv/trunk </developerConnection> - <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/tags/nuiton-cs…</url> + <url>https://forge.nuiton.org/projects/nuiton-csv/repository/show/trunk</url> </scm> <distributionManagement> <site>

1 0