Announcement

**Blama** · 21 Apr 2016, 07:39

Hi Isomorphic,

could you already look into this one?

Thank you & Best regards
Blama

**Isomorphic** · 21 Apr 2016, 14:07

The only way we can see this error occurring is because in your uploaded file, the last column in the header is missing and there is a trailing comma. For example, your header has two columns, whereas your data rows have three columns.

Please, confirm that this is causing your issue.

Regards
Isomorphic Software

**Blama** · 22 Apr 2016, 04:20

Hi Isomorphic,

I got to the ground of this. My columnRemap was columnMap.put(fieldName, uploadFieldName) but should have been columnMap.put(uploadFieldName, fieldName).

I found other errors as well and prepared a testcase for them.

1st row empty
My (solved) issue (=No matching column names in columnRemap)
The issue you mentioned

DataImportTest.java:

Code:

package com.smartgwt.sample.server.listener;

import java.io.IOException;
import java.io.Reader;
import java.io.StringReader;
import java.util.Date;
import java.util.LinkedHashMap;
import java.util.List;
import java.util.Map;

import javax.servlet.ServletException;
import javax.servlet.http.HttpServlet;
import javax.servlet.http.HttpServletRequest;
import javax.servlet.http.HttpServletResponse;

import com.isomorphic.tools.DataImport;
import com.isomorphic.tools.DataImport.ImportFormat;

public class DataImportTest extends HttpServlet {
    private static final long serialVersionUID = 6052735004239581488L;

    @Override
    public void doGet(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException {
        try {
            response.getWriter().append("Test 1 (1st row empty):\r\n");
            doDataImportTest(1, request, response);
        } catch (Exception e) {
            e.printStackTrace();
            response.getWriter().append(e.getMessage());
        }

        try {
            response.getWriter().append("\r\n\r\nTest 2 (my (solved) issue):\r\n");
            doDataImportTest(2, request, response);
        } catch (Exception e) {
            e.printStackTrace();
            response.getWriter().append(e.getMessage());
        }

        try {
            response.getWriter().append("\r\n\r\nTest 3 (issue you mentioned):\r\n");
            doDataImportTest(3, request, response);
        } catch (Exception e) {
            e.printStackTrace();
            response.getWriter().append(e.getMessage());
        }
    }

    @Override
    public void doPost(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException {
        doGet(request, response);
    }

    private void doDataImportTest(int test, HttpServletRequest request, HttpServletResponse response) throws Exception {
        String header = null;
        String datarow = null;
        String csvData = null;
        Reader emailContentReader = null;
        DataImport dataImporter = new DataImport(ImportFormat.CSV, ";");
        dataImporter.setPopulateDisplayFields(true);
        Map<String, String> columnRemap = new LinkedHashMap<String, String>();

        List<Map<String, Object>> dataImported = null;

        switch (test) {
        case 1:
        header = "\r\nMy-Name;My-SKU";
        datarow = "New Tool;123";
        csvData = header + "\r\n" + datarow + "\r\n";
        emailContentReader = new StringReader(csvData);

        columnRemap.put("My-Name", "itemName");
        columnRemap.put("My-SKU", "SKU");
        
        dataImported = dataImporter.importDataSourceRecords(emailContentReader, columnRemap, "supplyItem");
        break;

        case 2:
            header = "My-Name;My-SKU";
            datarow = "New Tool;123";
            csvData = header + "\r\n" + datarow + "\r\n";
            emailContentReader = new StringReader(csvData);

            columnRemap.put("nomatchatall", "itemName");
            
            dataImported = dataImporter.importDataSourceRecords(emailContentReader, columnRemap, "supplyItem");
            break;

        case 3:
            header = "My-Name;My-SKU";
            datarow = "New Tool;123;foo;";
            csvData = header + "\r\n" + datarow + "\r\n";
            emailContentReader = new StringReader(csvData);

            columnRemap.put("My-Name", "itemName");
            columnRemap.put("My-SKU", "SKU");

            dataImported = dataImporter.importDataSourceRecords(emailContentReader, columnRemap, "supplyItem");
            break;
        }
        response.getWriter().append(new Date().toString() + "\r\n" + dataImported.toString());
    }
};

web.xml addition (call http://127.0.0.1:8888/DataImportTest):

Code:

    <servlet>
        <servlet-name>DataImportTest</servlet-name>
        <servlet-class>com.smartgwt.sample.server.listener.DataImportTest</servlet-class>
    </servlet>
    <servlet-mapping>
        <servlet-name>DataImportTest</servlet-name>
        <url-pattern>/DataImportTest</url-pattern>
    </servlet-mapping>

While I can continue now, I think those should be fixed as nevertheless. I'll also update this thread now.

Best regards
Blama

**Isomorphic** · 26 Apr 2016, 07:19

These issues have been solved. Please try the next nightly build, dated April 27.

Regards
Isomorphic Software

**Blama** · 27 Apr 2016, 08:32

Hi Isomorphic,

I can confirm that the issues are fixed using v10.1p_2016-04-27.

Thank you & Best regards
Blama

Announcement

DataImport.importDataSourceRecords() exception question

Comment

Comment

Comment

Comment

Comment