linux - How view data that comes from a .GZ File Format on ORACLE SQL? -


explanation of condition , problem figuring

i find bit complicated, maybe because new event , world of linux.

  1. so here on pc (windows 7) need make sql based reporting site data need not in oracle yet.
  2. i need view data in oracle sql comes many files controller -> pc (unix).
  3. the format of file .gz physically file format machinedump.log.gz05052012 (its still .gz -> inside .log still .txt content)

note: controller/personal computer connecting has username, password , port number.

inside each .log.gz data has data like:

20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    0  20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    1 20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    2 20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    3 20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    4  20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    5 20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    6 20120806_161944: 08.06 16:17:29.574 t_cm_03 c3011099140000 at_sts       =    7

but there more bigger problem see: machinedump.log.gz files many like:

machinedump.log.gz05052012 machinedump.log.gz05062012 machinedump.log.gz05072012 machinedump.log.gz05082012 etc.

so here question , need problem:

  1. i wanna ask guys best way store these file contents single table? .log.gz files single table?

  2. regarding on 1st question, possible make data fetching based on "date" automated? meaning if there file match present date, execute , save data desired table?

  3. is there way guys show me do?

  4. in addition guys, there here must study deeply?

i need make these data usefull , readable report on using atleast sql(oracle or there better way) , netbeans rest of job(these know).

moderators

is possible have previous failed question deleted? thanks...

you don't version of oracle you're using. matters because oracle adds new capabilities arsenal each release. following solution work on 11.0.1.7 (i.e. last patch release of 11gr1) or later; earlier versions require more wrangling.

but first:

do need stiore information in table? sufficient read once? because relational database oracle not best fit storing machine logs. there plenty of free (or free-ish) document dbs might better suited - mongodb, cassandra, etc. or there's splunk intended that.

anyway, first way read files inthe database build external table on file. reguilar table except data in os file rather tablespace. in 11gr2 oracle introduced preprocessor clause, allows associate shell script table, run before select statement executes. particularly pertinent in case, because can use preprocessor script uncompress file.

so basic workflow is:

  1. a script locates gz file in 1 directory, unzips file standard name.
  2. an external table whioch reads standard name file , has script preprocess script
  3. an insert statement selects external table , writes target table

a more precise version of require more details have given regarding business rules, should able figure out yourself.

find out more on external tables in documentation.

read adrian billington's excellent articles on preprocessor scripts here , here.


Comments

Post a Comment

Popular posts from this blog

jquery - How can I dynamically add a browser tab? -

since using iframes house external pages are, accounts "not preferred method" , disallowed sites (flickr, one), want dynamically generate browser tabs. e.g., when user submits form, want dynamically generate tab on browser in response submitted. e.g., might want add new tab url like: http://www.bigsurgarrapata.com/contact how in jquery? you want form target attribute action attribute. http://www.w3schools.com/tags/att_form_target.asp browsers have ultimate control on result of target attribute open new tab value of _blank. <form action="contact_submit.php" target="_blank" method="post">
Read more

node.js - Getting the socket id,user id pair of a logged in user(s) -

i have web application done using node js , in it,i have authentication system requires users log in before can access pages. have 2 pages,the homepage , updates page. from read docs,a new socket id issued when user opens tab in browser. me being admin,i know socket id of logged in user , more so,the socket id,logged in user id pair logged in users. what method can use socket id,logged in user id pair make sure broadcast realtime info users online?.
Read more

keyboard - C++ GetAsyncKeyState alternative -

i using windows.h library's getasynckeystate function define key pushed on keyboard . here program returns int value of pushed key example. #include <iostream> #include <windows.h> using namespace std; int main (){ char i; for(i=8;i<190;i++){ if(getasynckeystate(i)== -32767){ cout<<int (i)<<endl; } } return 0; } but trying make opengl simple game , function appeared slow . there function not need cycle 180 times , if statement . thanks you're trying make opengl game, you're going use glfw. if that's case can away using glfwgetkey() such: if (glfwgetkey(glfw_key_up) == glfw_press) {...} if (glfwgetkey(glfw_key_down) == glfw_press) {...} that method nicely explained in tutorial 6 opengl-tutorial.org . should start first tutorial of beginners tutorials , later intermediate tutorials . if you're going make win32 window can listen wm_keydown or wm_keyup messages , virtua
Read more