Yes, you can add my list to other files if you wish.
You can easily strip all duplicates using notepad++ or by programming if you are feeling nerdy.
In notepad++ just go to: plugins > plugin manager > show plugin manager
Look for TextFX and install it.
Next click on TextFX in the tab selection menu > click TextFX tools > make sure "sort outputs only UNIQUE" is checked.
Next, go to your text file and hit cntrl+a (highlight all) then click on TextFX > TextFX tools > and choose "sort lines case sensitive"
It will remove all duplicates.
Do not ask me questions regarding my vacancy, I will not respond.