python - Best database management system for nested sorting? -


i've got bunch of events need organize first location, time, organization of remaining attributes (duration, cost, description). problem there millions of events, when querying, need retrieve small section , should come out ordered, preferably third index (cost or duration).

eventually, application using database needs data ultra-fast , doing thousands of queries. unfortunately, we're bound traditional hard drive, data needs stored in order. won't updated (a few hundred writes per day, compared millions of reads per day).

we've tried mysql, indicies, takes 200ms locate portion of data need, because our hard drive has ton of seeks, if knows data is.

we've looked @ nosql solutions key-value stores (redis, couchdb), redis doesn't nesting , couchdb doesn't allow 'ordered sets' since stores in json.

what solutions there store based on 2 (or more) indicies? bonus points if has nice interface python!

without more exact description of problem can't much, i've solved problem using kd-trees, binary trees in k dimensions. allow really fast k-nearest neighbor searches (in case can query corpus of ~10 million documents latitude, longitude, , time in <1 ms.) real downside writing them annoying - keep performance have rebalance tree pretty frequently. if want give try, check out scipy.spatial.ckdtree module. assuming have scipy installed you'll , running in 10 minutes.

if you're looking more of off shelf database solution, consider postgis; let create spatial index on 2-4 dimensions. more reliable , (and more write-friendly) roll-your-own kd tree approach, @ expense of little bit of performance.

edit: i'm assuming here "location" mean geolocation (latitude, longitude). if it's discrete location "california" answer not helpful.


Comments

Post a Comment

Popular posts from this blog

jquery - How can I dynamically add a browser tab? -

since using iframes house external pages are, accounts "not preferred method" , disallowed sites (flickr, one), want dynamically generate browser tabs. e.g., when user submits form, want dynamically generate tab on browser in response submitted. e.g., might want add new tab url like: http://www.bigsurgarrapata.com/contact how in jquery? you want form target attribute action attribute. http://www.w3schools.com/tags/att_form_target.asp browsers have ultimate control on result of target attribute open new tab value of _blank. <form action="contact_submit.php" target="_blank" method="post">
Read more

keyboard - C++ GetAsyncKeyState alternative -

i using windows.h library's getasynckeystate function define key pushed on keyboard . here program returns int value of pushed key example. #include <iostream> #include <windows.h> using namespace std; int main (){ char i; for(i=8;i<190;i++){ if(getasynckeystate(i)== -32767){ cout<<int (i)<<endl; } } return 0; } but trying make opengl simple game , function appeared slow . there function not need cycle 180 times , if statement . thanks you're trying make opengl game, you're going use glfw. if that's case can away using glfwgetkey() such: if (glfwgetkey(glfw_key_up) == glfw_press) {...} if (glfwgetkey(glfw_key_down) == glfw_press) {...} that method nicely explained in tutorial 6 opengl-tutorial.org . should start first tutorial of beginners tutorials , later intermediate tutorials . if you're going make win32 window can listen wm_keydown or wm_keyup messages , virtua
Read more

android - java.net.UnknownHostException(Unable to resolve host “URL”: No address associated with hostname) -

i developing app testing asp.net webservice in android.for simple webservice adding 2 numbers used.where numbers passed parameters.the result in dialogue.the webserver works in local. when application runs following result exception.i provided internet permission in manifest. java.net.unknownhostexception(unable resolve host “ http://url.com/ ”: no address associated hostname) my code given below main activity public static string rslt=""; /** called when activity first created. */ @override public void oncreate(bundle savedinstancestate) { super.oncreate(savedinstancestate); setcontentview(r.layout.activity_main); button b1=(button)findviewbyid(r.id.button1); final alertdialog ad=new alertdialog.builder(this).create(); b1.setonclicklistener(new onclicklistener() { @override public void onclick(view arg0) { // todo auto-generated method stub try {
Read more