Welcome to the Linux Foundation Forum!
compare files whose lines have been broken
aaaaaaaa
Posts: 1
in Command Line
Example, first file :1234 56asdfh asdfauiiiiiiil asdf
Second file :
1234 56asdfh
asdfauiiiiiiil
asdf
asdfauiiiiiiil
asdf
I would like to compare these two files and find no difference. I want to ignore all the breaking lines
Is there a command or a tool that can do that ? I want to use it in a batch file.
Thanks ![]()
0
Comments
-
This is a very difficult issue that I have been attempting to build a resolution on since the question was originally asked. It seems to me that the logic used in the absnse of line breaks makes this extrememly painful. If you remove all line breaks then the two files are all single line files, all diff utils that I have used to comparisons based upon line numbers, so they would not work. I beleive to otain your goal it would be best for you to write a bash script that first removes the line breaks, then increments one character at a time and reports the differences. However this would still be flawed because one a single space is detected it would then report all further characters and changes since the characters in the specific locations do not match. You may want to add some logic stating that if the character was replaced with a space to evaluate the non-space character against the next character in the opposite file.0
-
Since the diff utility is line oriented, this is difficult. It has options to ignore white space, but I don't know of a way to make it ignore lines entirely.0
-
you could use output each of those files into a files that have
a single line only, then compare the one-line files.
In other words, you replace the new line character by one space and you
remove extra spaces.
A seder could do that for you.
Example
###copy and paste to seder.sed below this line#!/bin/sed -f :loop N $!b loop s?[ \t\n]\{1,\}? ?g#### end of copy ####
After you pasted this to a sed script file (eg seder.sed) you make the
script executable:chmod +x seder.sed
Now, let's say the two files you want to compare are file1.txt and file2.txt.
You run these commands:./seder.sed file1.txt > firstfile ./seder.sed file2.txt > secondfile diff firstfile secondfile
0 -
vonbiber,
This is a nice script. I definitely would like to hear back from the original requester to see if this fulfills their needs.0
Categories
- All Categories
- 178 LFX Mentorship
- 178 LFX Mentorship: Linux Kernel
- 775 Linux Foundation IT Professional Programs
- 384 Cloud Engineer IT Professional Program
- 175 Advanced Cloud Engineer IT Professional Program
- 75 DevOps IT Professional Program - Discontinued
- 7 DevOps & GitOps IT Professional Program
- 103 Cloud Native Developer IT Professional Program
- 7.7K Training Courses & Learning Paths
- 13 AI & ML Training
- 1 Blockchain & Decentralized Identity Training
- 35 Cloud & Containers Training
- 3 Cybersecurity Training
- 3 DevOps & Site-Reliability Training
- 2 Linux Kernel Development Training
- 2 Networking Training
- 2 Open Source Best Practice Training
- 5 System Administration Training
- 1 System Engineering Training
- 6 Web & Application Development Training
- 798 Hardware
- 202 Drivers
- 68 I/O Devices
- 37 Monitors
- 96 Multimedia
- 173 Networking
- 91 Printers & Scanners
- 92 Storage
- 772 Linux Distributions
- 81 Debian
- 68 Fedora
- 24 Linux Mint
- 13 Mageia
- 24 openSUSE
- 151 Red Hat Enterprise
- 31 Slackware
- 13 SUSE Enterprise
- 356 Ubuntu
- 470 Linux System Administration
- 31 Cloud Computing
- 73 Command Line/Scripting
- Github systems admin projects
- 101 Linux Security
- 79 Network Management
- 102 System Management
- 46 Web Management
- 166 Mobile Computing
- 32 Android
- 119 Development
- 1.2K New to Linux
- 1K Getting Started with Linux
- 407 Off Topic
- 128 Introductions
- 35 Study Material
- 1.1K Programming and Development
- 310 Kernel Development
- 722 Software Development
- 1K Software
- 418 Applications
- 182 Command Line
- 5 Compiling/Installing
- 71 Games
- 320 Installation
- Archived
- 183 Small Talk
- 2 LFD140 Class Forum
- 1.4K LFS258 Class Forum
Upcoming Training
-
August 20, 2018
Kubernetes Administration (LFS458)
-
August 20, 2018
Linux System Administration (LFS301)
-
August 27, 2018
Open Source Virtualization (LFS462)
-
August 27, 2018
Linux Kernel Debugging and Security (LFD440)