Batch to determine are there duplicate lines in two text files

Question

I need a simple .bat file to determine are there duplicate lines in my 2 text files. I don't need the dupes deleted or even displayed, I only need to know do they exist or not.

Files look like this:

[email protected]

...

Thanks in advance for simple help instead of flaming and trying to make me look stupid.

score 1 · Answer 1 · answered Oct 10 '17 at 15:03

1

findstr /x /g:"filename1" "filename2"

Will find the lines that exist in both files if they exactly match and display them.

findstr /x /g:"filename1" "filename2">nul
if not errorlevel 1 echo found some

will display found some if at least one line matches. The >nul suppresses output from the findstr

answered Oct 10 '17 at 15:03

Magoo

77,302
8
62
84

You should add the `/L` option to force a literal search, else the dot will likely trigger a regex search. You should also add the `/I` flag, as most email systems ignore case. `/I` also prevents [this FINDSTR bug](https://stackoverflow.com/q/8844868/1012053) from being an issue. – dbenham Oct 10 '17 at 18:52

score 0 · Answer 2 · answered Oct 10 '17 at 14:57

On Linux, execute this command

cat file1.txt file2.txt | sort | uniq -c | sort -nr

On Windows, actually not sure because I don't have a windows machine but try one of the following:

Windows PowerShell to find duplicate lines in a file

Remove Duplicate Lines from Text File using Windows batching

Quanmao · Answer 3 · 2017-10-12T06:52:43.030

You can also use: nin f1.txt f2.txt -m to get file/pipe intersection. see following screenshot. Use -A to hide summary info of nin.exe.

nin.exe is a single portable exe (about 1.3MB) to get intersection set or difference set between 2 files or a file and a pipe by lines or keys. See nin.exe in my open project https://github.com/qualiu/msr tools directory or built-in doc like: https://qualiu.github.io/msr/usage-by-running/nin-Windows.html

Batch to determine are there duplicate lines in two text files

3 Answers3