python - Is my application of a generator wrong here? -


i'm using facebook api , looking @ reactions post. fb limits responses max of 100 records puts pagination next lot etc.

my test case has on 100 reactions (last count: 550) . want returned list of tuples each tuple reaction post.

here have far... output list on 100 less expected-

import requests    def get_next_linksv3(page):     while true:     #try:         r = requests.get(page)         r_json = r.json()         if 'paging' in r_json.keys() , 'next' in r_json['paging']:             page = r_json['paging']['next']             yield page         else:             return  def process_follow_on_reactions_link(next_link, list_reaction_tuples):     nr = requests.get(next_link)     r_json = nr.json()     tmp_list = []     if 'data' in r_json.keys():         nrecord in r_json['data']:             reaction_id = nrecord['id']             reaction_id_name = nrecord['name']             reaction_type = nrecord['type']             tmp_list.append((reaction_id,reaction_id_name,reaction_type))     return tmp_list    def process_initial_reactions_link(link):     list_reaction_tuples = []     r = requests.get(link)     r_json = r.json()     if 'reactions' in r_json.keys():         record in r_json['reactions']['data']:             reaction_id = record['id']             reaction_id_name = record['name']             reaction_type = record['type']             list_reaction_tuples.append((reaction_id,reaction_id_name,reaction_type))     if 'reactions' in r_json.keys() , 'paging' in r_json['reactions'] , 'next' in r_json['reactions']['paging']:         next_link = r_json['reactions']['paging']['next']         gen  = get_next_linksv3(next_link)         while true:             try:                 list_reaction_tuples = list_reaction_tuples + (process_follow_on_reactions_link(next(gen), list_reaction_tuples))             except stopiteration:                 return list_reaction_tuples      return list_reaction_tuples  tuple_list = process_initial_reactions_link(target_link)

it may hang waiting data or spin in loop. in while true loop. when gets incorrect (or producing other output desired) url (the if condition not satisfy), generator downloads same page , never yields. may want introduce max_retries variable instead of while true loop.

run program under debugger , pinpoint hangs. if impossible - use simple print-debugging method. , show trace.


Comments

Post a Comment

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

i running os ububtu 16.04. ultimate goal able run php script cron job every minute. here php script located @ /var/www/html/tests/test/index.php : <?php $directorypath = $_server['document_root']."/tests/test/data/"; echo "directorypath: $directorypath<br><br>";//check $imagefilepathsarray = glob($directorypath . "*.{png,gif}", glob_brace); echo "<br><br>imagefilepathsarray: "; print_r($imagefilepathsarray);//check ?> when open php script in browser visiting url my-ip-address/tests/test/index.php , get: directorypath: /var/www/html/tests/test/data/ imagefilepathsarray:array( [0] => /var/www/html/tests/test/data/pic.png [1] => /var/www/html/tests/test/data/pic.gif ) before writing cron job in crontab file, need check if can run anywhere using terminal . opened ubuntu terminal @ /home/ location, , executed in terminal: sudo php /var/www/html/tests/test/index.php i got following out...
Read more

php - How can i create a user dashboard -

today have questions you, want create user dashboard site, include (obviously), users data, example -email -username -and others stuff how can information, , print them in html page? if can, how can these information via php sessions? shuld use session? example, if user login, , start new session ( session_start() ), how can data print in dashboard? should use php "project"? in advice, have day , thank time!
Read more

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -

i have jquery mobile page fixed full-screen toolbar, data-tap-toggle enabled. straight under toolbar have positioned banner should slide upwards when toolbar hiding , slide downward when toolbar showing. jquery mobile toggles toolbar applying , removing ui-fixed-hidden class - sadly, can't find in documentation of toolbar widget toggle , hide or show event that. how can detect when toolbar toggled, reposition banner? .banner { position: fixed; background-color: darkseagreen; top: 46px; min-height: 48px; width: 100%; text-align: center; line-height: 48px; } <!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"> <script src="https://code.jquery.com/jquery-1....
Read more