post - Issue with cookies during webpage parsing using Python -


i trying parse webpage using python.

problem: page requires me enter zipcode in prompt window before loading. if don't enter zipcode (parse webpage directly) webpage gets loaded has 1 data table missing in it.

moment enter zipcode, page reloads in response without missing out data table.

i using following code accomplish same:

from requests import session import urllib, urllib2, cookielib  payload = {     '/att/ecom/shop/view/localizationformhandler.localizationinputbean.errorurl':'/shop/wireless/plans/prepaidplans.changezipmodalresponse.xhr.html', '/att/ecom/shop/view/localizationformhandler.localizationinputbean.skuid':'', '/att/ecom/shop/view/localizationformhandler.localizationinputbean.successurl':'/shop/wireless/plans/prepaidplans.changezipmodalresponse.xhr.html', '/att/ecom/shop/view/localizationformhandler.localize':'', '/att/ecom/shop/view/localizationformhandler.localize.x':'34', '/att/ecom/shop/view/localizationformhandler.localize.y':'13.566665649414062', '/att/ecom/shopcore/bean/localizationdatabean.localizationoriginatingpage':'/shop/wireless/plans/prepaidplans.html', '_d:/att/ecom/shop/view/localizationformhandler.localizationinputbean.errorurl':' ', '_d:/att/ecom/shop/view/localizationformhandler.localizationinputbean.skuid':' ', '_d:/att/ecom/shop/view/localizationformhandler.localizationinputbean.successurl':' ', '_d:/att/ecom/shop/view/localizationformhandler.localize':' ', '_d:/att/ecom/shopcore/bean/localizationdatabean.localizationoriginatingpage':' ', '_d:zipcode':' ', '_dargs':'/shop/wireless/plans/prepaidplans.changezipmodal.html', '_dynsessconf':'23', '_dyncharset':'utf-8', 'zipcode':'10001' }  session() c:     c.post('http://www.att.com/shop/wireless/plans/prepaidplans.changezipmodal.html', data=payload)     request = c.get('http://www.att.com/shop/wireless/plans/prepaidplans.html')      #print request.headers     #print request.text     att = open('att.html','wb')     att.write(request.text)

` pleas me in resolving issue , pardon ignorance new programming.


Comments

Post a Comment

Popular posts from this blog

Change php variable from jquery value using ajax (same page) -

what i'm trying this: i've php global variable $currentid , simple jquery script check if there "id" (page) in hash of url , if yes wanted give value $currentid . i've been reading lot , notice shall use ajax i'm not managing it. my code is: <script type="text/javascript"> $(document).ready(function(){ if (parent.location.hash != '' ) { var thecurrentid = parent.location.hash.split('#')[1]; $.ajax({ url: 'my.php', //current page type: 'post', data: {theid: thecurrentid }, datatype: 'json', success: function () { } }); } // code here }); </script> could me please? thank in advance. php server side language, meaning once has sent data browser, php variables , data cannot changed... however, using ajax, can send request php page , change data in dom based on result. consider th...
Read more

Pull out data related to my apps from Android Play Store and iOS App Store -

i want pull out data related apps (ratings, reviews, etc) google play store , apple app store ? how can accomplish ? i have found open source apis google mentioned not reliable. also there paid apis (e.g. appfigures) available. has idea how able pull data these play stores ?? i looking direction on how can accomplish this. can suggest ? we (appfigures) have been working on developing infrastructure give ability reviews , bunch of other data points major app stores several years :] we make available via our api though may want check out.
Read more

How can I fetch data from a web server in an android application? -

i want retrieve data web server in android application, , don't know begin. should use web services? i recommend these tutorials: connect android php , mysql , json in android , php , mysqli i used these tutorials , managed trying working without difficulty. between them describe each step in how attempting @ each stage, android application, database , web server side , has information included can process , use received information the thing add connect android php , mysql tutorial makes use of mysql_ in php deprecated. better use mysqli why included third link. the basic outline of want this: 1) in android app make request server php script using class this: import java.io.bufferedreader; import java.io.ioexception; import java.io.inputstream; import java.io.inputstreamreader; import java.io.unsupportedencodingexception; import java.util.list; import org.apache.http.httpentity; import org.apache.http.httpresponse; import org.apache.http.namevaluepair...
Read more