The following shell script main aim is to merge two files line by line and delete the repeated word or duplicate word from each line.
file 1 :
apple goa orange
hello hi how are you
file 2 :
mango goa orange apple
how are you hi hello
Final out put required is :
apple goa orange mango
hello hi how are you
Screen outputs :
nc041031:/opt/krish # cat 1.txt
apple goa orange
hello hi how are you
nc041031:/opt/krish # cat 2.txt
mango goa orange apple
how are you hi hello
nc041031:/opt/krish # cat merge.sh
apple goa orange mango goa orange apple
hello hi how are you how are you hi hello
apple goa orange mango
hello hi how are you
nc041031:/opt/krish # cat final.txt
apple goa orange mango
hello hi how are you
file 1 :
apple goa orange
hello hi how are you
file 2 :
mango goa orange apple
how are you hi hello
Final out put required is :
apple goa orange mango
hello hi how are you
Screen outputs :
nc041031:/opt/krish # cat 1.txt
apple goa orange
hello hi how are you
nc041031:/opt/krish # cat 2.txt
mango goa orange apple
how are you hi hello
nc041031:/opt/krish # cat merge.sh
#!/bin/shnc041031:/opt/krish # ./merge.sh
awk 'NR==FNR{a[FNR]=$0;next} {print a[FNR],$0}' 1.txt 2.txt | tee a.txt
awk '{ while(++i<=NF) printf (!a[$i]++) ? $i FS : ""; i=split("",a); print "" }' a.txt | tee final.txt
apple goa orange mango goa orange apple
hello hi how are you how are you hi hello
apple goa orange mango
hello hi how are you
nc041031:/opt/krish # cat final.txt
apple goa orange mango
hello hi how are you
Reactions: |
2 comments to "merge 2 files line by line and delete duplicate words - shell script , awk"
Post a Comment
Who ever writes Inappropriate/Vulgar comments to context, generally want to be anonymous …So I hope U r not the one like that?
For lazy logs u can at least use Name/URL option which don’t even require any sign-in, good thing is that it can accept your lovely nick name also and URL is not mandatory too.
Thanks for your patience
~Krishna(I love "Transparency")
వీలయితే నాల్గు పోస్టులు ...కుదురితే ఒక కామెంటూ ...
Tags
Powered by WidgetsForFree
My Blog List
Popular posts
- Airtel and vodafone GPRS settings for pocket PC phones
- Andhra 2 America
- Ayyappa Deeksha required things
- Blogs I watch !
- Captions for your bike
- DB2 FAQs
- Deepavali Vs The Goddes of sleep
- ETV - Dhee D2 D3
- Evolution of smoking in India Women
- How to make credit card payments?
- Java-J2EE interview preparation
- My SQL FAQs
- My Travelogues
- Old is blod - New is italic
- Online pay methids for credit cards
- Oracle FAQs
- Pilgrimages
- Smoking in Indian Women
- Technology Vs Humans
- Twitter feeds for all Telugu stars on single page.
- Unix FAQs
- Unix best practices
- init 0, init 1, init 2 ..
- mCheck Application jar or jad download

Kishore says:
thanks a lot babu....u always backup me....good job...see u with more updates..
Krishna says:
No probs kishore. this we can do in many other ways, these days im practicing awk and hence used it . isn't it handy ?