Ant script to remove duplicate lines from file - ant

Question

I have been trying to find solution in other posts but no one seems to be accurate.
I am struggling to find way to delete duplicate lines from a file.
From ex, a file RTNameList.txt has contents as
DBParticipant:JdbcDataSource:appdb
DBParticipant:JdbcDataSource:appdb
HttpType:HttpClientConfiguration:Prochttp
HttpType:HttpClientConfiguration:Prochttp
I want only unique line to be written to another file RTNameList-Final.txt .PLease advise best solution using Ant script.
I used below and it does not work.
<loadfile srcfile="${ScriptFilesPath}/RTNameList.txt" property="src.file.head">
<filterchain>
<sortfilter/>
<uniqfilter/>
</filterchain>
</loadfile>
<echo file="${ScriptFilesPath}/RTNameList-Final.txt">${src.file.head}</echo>
Expected output: File RTNameList-Final.txt should have contents as
DBParticipant:JdbcDataSource:appdb
HttpType:HttpClientConfiguration:Prochttp

Answer 1

Ant is not a programming language. The following example uses an embedded groovy script to process the file.
Example
├── build.xml
├── src
│   └── duplicates.txt
└── target
└── duplicatesRemoved.txt
src/duplicates.txt
DBParticipant:JdbcDataSource:appdb
DBParticipant:JdbcDataSource:appdb
HttpType:HttpClientConfiguration:Prochttp
HttpType:HttpClientConfiguration:Prochttp
target/duplicatesRemoved.txt
DBParticipant:JdbcDataSource:appdb
HttpType:HttpClientConfiguration:Prochttp
build.xml
<project name="demo" default="build">
<available classname="org.codehaus.groovy.ant.Groovy" property="groovy.installed"/>
<target name="build" depends="install-groovy">
<taskdef name="groovy" classname="org.codehaus.groovy.ant.Groovy"/>
<groovy>
ant.mkdir(dir:"target")
def dups = [:]
new File("target/duplicatesRemoved.txt").withWriter { w ->
new File("src/duplicates.txt").withReader { r ->
r.readLines().each {
if (!dups.containsKey(it)) {
dups[it] = it
w.println(it)
}
}
}
}
</groovy>
</target>
<target name="install-groovy" unless="groovy.installed">
<mkdir dir="${user.home}/.ant/lib"/>
<get dest="${user.home}/.ant/lib/groovy.jar" src="http://search.maven.org/remotecontent?filepath=org/codehaus/groovy/groovy-all/2.3.6/groovy-all-2.3.6.jar"/>
<fail message="Groovy has been installed. Run the build again"/>
</target>
</project>