Ispirer Home Page Ispirer SQLWays Product Page - Migration to PostgreSQL Request SQLWays

Invalid Byte Sequence For Encoding UTF8

Symptoms

During the import into PostgreSQL database when loading data into a table the following message arises: “Invalid Byte Sequence for encoding UTF8”.

Causes

  • When loading data into a table with LOB columns. It appears because BYTEA data type is not able to read the LOB data properly.
  • When loading data that contain Japanese characters using psql.exe utility on SJIS environment (psql.exe bug).

Solutions

NOTE! In order to set the settings below, Expert Mode should be enabled: How to Use SQLWays Wizard in Expert Mode

  • For the case with loading LOB data.

To solve the issue for such a case, just set the BYTEA Format option to HEX or to Escape value. You can find this option by clicking on the “Advanced” button on the “Choose a target Database” page and set it like it is shown on the screenshot:

This option will change the representation of the LOB data and load it into the target database.



  • For the case with SJIS environment

To solve this issue for such a case, just set Encoding option to SJIS. This option can be found on the “Choose a Target Database” page on the “Advanсed” window:



If you face some difficulties or have any additional questions, please, feel free to contact us: support@ispirer.com


Ispirer Home Page Ispirer SQLWays Product Page - Migration to PostgreSQL Request SQLWays


© 1999-2023, Ispirer Systems, LLC. All Rights Reserved.