database - awk - print only first line of duplicates and the line below it -


i have large database file needs manipulation. need avoid duplicate field 1 delimited '|' for:

-- title1 | title2   |t3   |title4|title5  ----------|----------|-----|------|--------------- -- data1   | same     |     |      |  blah blah eligible  | x1  data1   | same     |     | blah |  blah eligible  | x2  data1   | same     |     | blah |  blah blah eligible  | x2  data2   | same     |     |      |  blah blah eligible  | y1  data2   | same     |     | blah |  blah eligible  | y2 data2   | same     |     | blah |  blah blah blah blah eligible  | y2 data3   | same     |     |      |  blah blah eligible  | z1 data3   | same     |     | blah |  blah eligible  | z2 data3   | same     |     | blah |  blah blah blah blah eligible  | z2

the code using is

begin{ fs = "|" } { count[$1]++; if (count[$1] == 1) first [$1] = $0; if (count[$1] > 1) print first[$1] nr==1; }

but gives me output:

-- title1 | title2   |t3   |title4|title5  ----------|----------|-----|------|--------------- -- data1   | same     |     |      |  blah blah eligible  | x1  data2   | same     |     |      |  blah blah data3   | same     |     |      |  blah blah

i prefer output this:

-- title1 | title2   |t3   |title4|title5  ----------|----------|-----|------|--------------- -- data1   | same     |     |      |  blah blah eligible  | x1  data2   | same     |     |      |  blah blah eligible  | y1  data3   | same     |     |      |  blah blah eligible  | z1

i don't care title block need show data outlined. sorry amateurish explanation solution appreciated. novice when comes linux command line scripting if 1 explain why answer wrong, appreciated. not limited awk, , can use command solution. wanted try solution awk.

you try this:

awk -f\| '(printed!=0 && /eligible/) {print; printed=0;} (!seen[$1] && $1 !~ /eligible/) { print; printed = 1; seen[$1] = 1;  }'

although there's better way.

eta: there's awk tutorial here , several others around web, along books. basically, awk program series of patterns , blocks of code run on every record (line, default) matches pattern. 

awk '/foo/          { lines contain "foo" anywhere }      ($1 == "bar")  { lines first field "bar' }      ($nf ~ /baz/)  { lines last field contains "baz" }      (nf == 1)      { lines 1 field }      (nr == 10)     { on 10th line }'

if there's no pattern, block runs on every line. 

awk '{print $nf}'   # print last field of every line

if there's no block , pattern, matching lines printed unchanged:

awk '/foo/'      # same grep foo

a block labeled begin run before input processed; block labeled end run after input processed.

awk 'begin { t = 0 } {t += $nf} end { print t }'   # print total of last column

but uninitialized variables treated 0 in arithmetic, can skip initialization:

awk '{t += $nf} end {print t}'

some versions of awk require semicolon ; or newline between pattern/block pairs


Comments

Post a Comment

Popular posts from this blog

jquery - How can I dynamically add a browser tab? -

since using iframes house external pages are, accounts "not preferred method" , disallowed sites (flickr, one), want dynamically generate browser tabs. e.g., when user submits form, want dynamically generate tab on browser in response submitted. e.g., might want add new tab url like: http://www.bigsurgarrapata.com/contact how in jquery? you want form target attribute action attribute. http://www.w3schools.com/tags/att_form_target.asp browsers have ultimate control on result of target attribute open new tab value of _blank. <form action="contact_submit.php" target="_blank" method="post">
Read more

keyboard - C++ GetAsyncKeyState alternative -

i using windows.h library's getasynckeystate function define key pushed on keyboard . here program returns int value of pushed key example. #include <iostream> #include <windows.h> using namespace std; int main (){ char i; for(i=8;i<190;i++){ if(getasynckeystate(i)== -32767){ cout<<int (i)<<endl; } } return 0; } but trying make opengl simple game , function appeared slow . there function not need cycle 180 times , if statement . thanks you're trying make opengl game, you're going use glfw. if that's case can away using glfwgetkey() such: if (glfwgetkey(glfw_key_up) == glfw_press) {...} if (glfwgetkey(glfw_key_down) == glfw_press) {...} that method nicely explained in tutorial 6 opengl-tutorial.org . should start first tutorial of beginners tutorials , later intermediate tutorials . if you're going make win32 window can listen wm_keydown or wm_keyup messages , virtua...
Read more

android - java.net.UnknownHostException(Unable to resolve host “URL”: No address associated with hostname) -

i developing app testing asp.net webservice in android.for simple webservice adding 2 numbers used.where numbers passed parameters.the result in dialogue.the webserver works in local. when application runs following result exception.i provided internet permission in manifest. java.net.unknownhostexception(unable resolve host “ http://url.com/ ”: no address associated hostname) my code given below main activity public static string rslt=""; /** called when activity first created. */ @override public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.activity_main); button b1=(button)findviewbyid(r.id.button1); final alertdialog ad=new alertdialog.builder(this).create(); b1.setonclicklistener(new onclicklistener() { @override public void onclick(view arg0) { // todo auto-generated method stub try { ...
Read more