Character encoding: Difference between revisions

From FreeMind
Jump to navigationJump to search
m (Reverted edit of Yvyfyjeh, changed back to last version by Dan Polansky)
No edit summary
 
(18 intermediate revisions by the same user not shown)
Line 1: Line 1:
FreeMind stores Unicode characters as XML character entities into mind map files.
Reading of UTF-8 encoded mind map files is supported, with or without UTF-8 byte order mark (BOM).
Reading of UTF-32BE, UTF-32LE, UTF-16BE and UTF-16LE seem to be all supported provided the mind map starts with byte order mark (BOM).
Writing of UTF-8 is probably not supported; there was a feature request for this.
FreeMind does not write any BOM natively; given it writes XML character entities, it would make no sense.
==XML declaration==
FreeMind does not write XML declaration; it starts directly with the map element. The XML declaration would be like the following:
* <nowiki><?xml version = "1.0"></nowiki>
* <nowiki><?xml version = "1.0" encoding = "UTF-8"?></nowiki>
* <nowiki><?xml version = "1.0" encoding = "iso-8859-1"?></nowiki>
FreeMind does not read XML declaration either; the mind map has to start with the map element.
==Implementation==
Reading:
* Class FileReaderCreator in MindMapMapModel uses UTF-8 as the character encoding: 'return new UnicodeReader(new FileInputStream(mFile), "UTF-8");'
* The above class is instantiated in MindMapMapModel.loadTree(final File) method.
* Which is called from MindMapMapModel.load(File file).
* Class UnicodeReader determines the encoding from byte order mark (BOM), if any; it seems to take the passed-in "UTF-8" in case there is no BOM.
Writing:
* XMLElement.writeEncoded() encodes Unicode points such that unicode < 32 or unicode > 126 as XML character entities.
Links:
* [https://sourceforge.net/p/freemind/code/ci/master/tree/freemind/freemind/modes/mindmapmode/MindMapMapModel.java MindMapMapModel.java], sourceforge.net
* [https://sourceforge.net/p/freemind/code/ci/ae2e0364a92e71de2f85d3ba1ae2129a5736985d/tree/freemind/freemind/common/UnicodeReader.java UnicodeReader.java], sourceforge.net
* [https://sourceforge.net/p/freemind/code/ci/master/tree/freemind/freemind/main/XMLElement.java XMLElement.java], sourceforge.net
==Tracker items==
==Tracker items==
* [http://sourceforge.net/tracker/?func=detail&atid=107118&aid=2810535&group_id=7118 RC4 regression: incorrect viewing of UTF-8 map]
* [https://sourceforge.net/p/freemind/bugs/860/ #860 RC4 regression: incorrect viewing of UTF-8 map], bug, 2010-03-10, sourceforge.net
* [https://sourceforge.net/p/freemind/bugs/998/ #998 Accents in RC11 and RC12], bug, 2010-12-05
* [https://sourceforge.net/p/freemind/feature-requests/882/ #882 Why not UTF-8 file?], FR, 2015-12-21, sourceforge.net
* [https://sourceforge.net/p/freemind/feature-requests/827/ #827 saving .mm files in UTF-8], FR, 2012-03-08, sourceforge.net
* [https://sourceforge.net/p/freemind/patches/67/ #67 Utf-8 aware, and better Chinese characters], patches, 2006-04-07, sourceforge.net -- points to [[User:Jiangxin/Better chinese characters support]]
 
==Limitations==
* No support for XML declaration at the top of the mind map file; it is neither written nor read.
* No way to choose, upon reading, from a variety of encodings in the file, which would be indicated e.g. by encoding attribute of the map element or in the XML declaration if it was there. This limitation seems very minor given one can use a conversion tool to convert from any encoding to UTF-8 or one can generate UTF-8 directly.
* No writing in UTF-8, as per above. This is a major limitation: one of the spells of the XML format is that it is a plain text format that can be viewed in a plain text editors, but for non-Latin scripts, all characters end up as human-illegible character entities.
 
==See also==
* [[File format]]
* [[Requests for enhancements#Use UTF-8 in the XML file to store unicode characters]]
 
[[Category:Development]]

Latest revision as of 16:56, 6 June 2023

FreeMind stores Unicode characters as XML character entities into mind map files.

Reading of UTF-8 encoded mind map files is supported, with or without UTF-8 byte order mark (BOM).

Reading of UTF-32BE, UTF-32LE, UTF-16BE and UTF-16LE seem to be all supported provided the mind map starts with byte order mark (BOM).

Writing of UTF-8 is probably not supported; there was a feature request for this.

FreeMind does not write any BOM natively; given it writes XML character entities, it would make no sense.

XML declaration

FreeMind does not write XML declaration; it starts directly with the map element. The XML declaration would be like the following:

  • <?xml version = "1.0">
  • <?xml version = "1.0" encoding = "UTF-8"?>
  • <?xml version = "1.0" encoding = "iso-8859-1"?>

FreeMind does not read XML declaration either; the mind map has to start with the map element.

Implementation

Reading:

  • Class FileReaderCreator in MindMapMapModel uses UTF-8 as the character encoding: 'return new UnicodeReader(new FileInputStream(mFile), "UTF-8");'
  • The above class is instantiated in MindMapMapModel.loadTree(final File) method.
  • Which is called from MindMapMapModel.load(File file).
  • Class UnicodeReader determines the encoding from byte order mark (BOM), if any; it seems to take the passed-in "UTF-8" in case there is no BOM.

Writing:

  • XMLElement.writeEncoded() encodes Unicode points such that unicode < 32 or unicode > 126 as XML character entities.

Links:

Tracker items

Limitations

  • No support for XML declaration at the top of the mind map file; it is neither written nor read.
  • No way to choose, upon reading, from a variety of encodings in the file, which would be indicated e.g. by encoding attribute of the map element or in the XML declaration if it was there. This limitation seems very minor given one can use a conversion tool to convert from any encoding to UTF-8 or one can generate UTF-8 directly.
  • No writing in UTF-8, as per above. This is a major limitation: one of the spells of the XML format is that it is a plain text format that can be viewed in a plain text editors, but for non-Latin scripts, all characters end up as human-illegible character entities.

See also