[CLOSED] On python3 master email response from outside to erpnext contain escaped unicode character codes instead of utf chars

Frappe Framework Bug
,
1

Env

ERPNext: v11.1.13 (master)
Frappe Framework: v11.1.13 (master)
Python: 3.6.3

Problem:

Communication response from outside to erpnext contain escaped unicode charecter codes instead of utf chars. Later experiments shown that it’s a general problem with email responses that have 8bit encoding and if frappe is installed in python3 env.

Details

As seen here in Daily Work Summary response message
Should be “test ėį ęėįę įę į”

image
image1171×708 49.5 KB

Also it has to be noted that there is NO such issue with the subject of the response email.

UPDATE

Flawed conclusion DELETED

UPDATE 2

The issue might be whether email reply is sent from GMail or from other email client.
Problem replicates with Thunderbird but not when replying via GMail.

UPDATE 3

Thunderbird response

Text:

test 4 repl 234234čęėčęė

Best regards,
...

email source:

This is a multi-part message in MIME format.
--------------11DFA8B70490842392CF0452
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit

test 4 repl 234234čęėčęė

Best regards,
...

Gmail response

text:

čęė č ėęčėč ė
test test tets

email source:

...
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

=C4=8D=C4=99=C4=97 =C4=8D =C4=97=C4=99=C4=8D=C4=97=C4=8D =C4=97
test test tets
...

REFERENCE regarding Quoted-printable (e.g. =C4)

So apparently it’s a feature of email package as emails from Thunderbird satisfy exotic condition to treat differently from gmail emails. (Related question )

PULL REQUEST

PULL REQUESTS: hotfix submitted and MERGED into TRUNK

4 Likes