Kanji Dojo Data

Data and scripts used by the Kanji Dojo application

Characters and expressions are located in data/ folder

Scripts to manipulate data are in the src directory, under task package. They can be executed using IntelliJ IDEA or by running a command with required task name

Tasks:

• ./gradlew run -Ptask=ExportCharactersJson
• ./gradlew run -Ptask=ExportDatabase
• ./gradlew run -Ptask=ExportExpressionsJson
• ./gradlew run -Ptask=ValidateJson
• ./gradlew run -Ptask=ExportVariantsInfo
• ./gradlew run -Ptask=ApplyExpressionRanks

If you wish to run scripts you'll need to download necessary data. Scripts and links for downloading can be found in parser_data/ directory

Download tasks:

• ./gradlew downloadRadkFile
• ./gradlew downloadLeedsFrequencies
• ./gradlew downloadjmdictFuriganaJson
• ./gradlew downloadYomichanJlptVocab
• TODO - replace all other bash scripts with gradle tasks

Data Sources and Credits

• KanjiVG
  Provides writing strokes, radicals information
  License: Creative Commons Attribution-Share Alike 3.0
  Link: https://kanjivg.tagaini.net/
• Kanji Dic
  Provides characters info, such as meanings, readings and classifications
  License: Creative Commons Attribution-Share Alike 3.0
  Link: http://www.edrdg.org/wiki/index.php/KANJIDIC_Project
• JMDict
  Japanese-Multilingual dictionary, provides expressions
  License: Creative Commons Attribution-Share Alike 4.0
  Link: https://www.edrdg.org/jmdict/j_jmdict.html
• RADKFILE Provides a decomposition of kanji into radicals to support software which provides a lookup service using kanji components License: Creative Commons Attribution-Share Alike 4.0 Link: https://www.edrdg.org/krad/kradinf.html
• JmdictFurigana
  Open-source furigana resource to complement the EDICT/Jmdict and ENAMDICT/Jmnedict dictionary files
  License: Creative Commons Attribution-Share Alike 4.0
  Link: https://github.com/Doublevil/JmdictFurigana
• Tanos by Jonathan Waller
  Provides JLPT classification for kanji
  License: Creative Commons BY
  Link: http://www.tanos.co.uk/jlpt/
• Frequency list by Leeds university
  Words ranking by frequency of usage in internet
  License: Creative Commons BY
  Link: http://corpus.leeds.ac.uk/list.html
• yomichan-jlpt-vocab
  This meta dictionary adds JLPT-level tags to words in Yomichan. Provides associations between JLPT words from Tanos and JMDict
  License: Creative Commons Attribution-Share Alike 4.0
  Link: https://github.com/stephenmk/yomichan-jlpt-vocab