Freelancer

Description

Input A:
multiple files in CSV, TXT format contains several thousand word or words list seperated by comma, space or new line. eg. level 1.txt, level 2.txt, level 3.txt, level 4.txt, dictionary.txt

Input B:
multiple files in TXT format contains story from 1 page to several hundred pages.

Output:
A txt file and html file contain the whole Input B, with word count, word appear frequency, word count after remove duplicate, word list from each level.txt, percentage of word from level 1.txt, level 2.txt, level 3.txt, level 4.txt and un-identific word percentage. When a dictionary file is present, the explaination will be insert beside the word.

Tricky part:
Chinese character is in 2 bytes, sometime 3 bytes. Word can consist of more than 1 characters. And there is no space between words.
eg. a ab abc abcd is different word.
the sentence aabcdababaabc has 6 different words.

The budget can increase, if more options is provided


Additional files submitted:
Level 1.txt
Level 2.txt
story.txt