python - Save To Folder In List On Each Loop -


i have code below downloads files on each loop. what on each loop should extract files corresponding folder. whats happening saving files in each folder , overwriting files same names.

any appreciated.

import os import requests import zipfile, stringio bs4 import beautifulsoup  # here add login details submitted login form. payloads = [     {'username': '1111','password': '1111','option': 'login'},     {'username': '2222','password': '2222','option': 'login'},     {'username': '3333','password': '3333','option': 'login'},     {'username': '4444','password': '4444','option': 'login'},     ]  folders = [r"c:\temp\1111", r"c:\temp\2222", r"c:\temp\3333", r"c:\temp\4444"]  #possibly need headers later. headers = {'user-agent': 'mozilla/5.0 (macintosh; intel mac os x 10_12_5) applewebkit/537.36 (khtml, gecko) chrome/59.0.3071.115 safari/537.36'} base_url = "https://service.rl360.com/scripts/customer.cgi/sc/servicing/" # use 'with' ensure session context closed after use.  payload in payloads:      requests.session() s:             p = s.post('https://service.rl360.com/scripts/customer.cgi?option=login', data=payload)              # download page scrape.             r = s.get('https://service.rl360.com/scripts/customer.cgi/sc/servicing/downloads.php?folder=datadownloads&sortfield=reportdate&sortorder=ascending', stream=true)             content = r.text             soup = beautifulsoup(content, 'lxml')             #now recent download url.             download_url = soup.find_all("a", {'class':'tabletd'})[-1]['href']             #now join base url download url.             download_docs = s.get(base_url + download_url, stream=true)             print "checking content"             content_type = download_docs.headers['content-type']             print content_type             print "checking filename"             content_name = download_docs.headers['content-disposition']             print content_name             print "checking download size"             content_size = download_docs.headers['content-length']             print content_size             #this extract , download specified xml files.             z = zipfile.zipfile(stringio.stringio(download_docs.content))             print "---------------------------------"             print "downloading........."             folder in folders:               z.extractall(folder)             #now save files specified location.             print "download complete"

use z.read() or z.readstr() function extract file file , change paths and/or names need. odd extractall() overwriting existing files? if in each zip named same overwritten. simple that.

what doing here extracting same zip specified folders. loop has reworked follow zip's content, not other way around. assuming, of course, want achieve. can specify "c:\temp" extract whole zip (no loops needed) , deal resulting mess.

you said:

"the problem im using 4 different logins, each 1 has files , files have same name 1 in account."

but should deduced, comments copied above, have switch 2 loops. i.e. use new folder (from folders) per each username (from payloads. here extract same zip in folders. result being folders specified being filled zip last login. rework this.

a little example keeping design necessary changes:

from zipfile import zipfile cstringio import stringio import os temp_folder = "c:\\temp" users = {     123: ("login 123 etc", "download url 123"),     345: ("login 345 or url or whatever", "download url 345")}  user in users:     login_to(users[user][0])     content = get_zip_from(users[user][1])     path = os.path.join(temp_folder, user)     if not os.path.exists(path):         os.makedirs(path)     z = zipfile(stringio(content))     z.extractall((path)

reworking thing follow folders similar need connect folder user somehow. here used username folder extract content to. hope need.


Comments

Post a Comment

Popular posts from this blog

python - Operations inside variables -

this question has answer here: evaluating mathematical expression in string 12 answers i want make python script finds maximum possible output using 2 operations. problem says there syntax error @ 2nd last line, in b in there. how can fix it? x = 0 = int(input("1st number:")) c = int(input("2nd number:" )) e = int(input("3rd number:" )) in range(4): if == 0: b = "+" elif == 1: b = "-" elif == 2: b = "/" else: b = "*" j in range(4): if j == 0: d = "+" elif j == 1: d = "-" elif j == 2: d = "/" else: d = "*" k = b c d e print(k) if you're after variables e on single line, couldn...
Read more

Generic Map Parameter java -

i having lot of methods of type: public static list<eduusers> getdetails(class c, map<string, integer> params) { list<eduusers> details = null; session session = hibernateutil.getsessionfactory().opensession(); transaction tx = null; try { tx = session.begintransaction(); criteria cr = session.createcriteria(c); (map.entry<string, integer> entry : params.entryset()) { cr.add(restrictions.eq(entry.getkey(), entry.getvalue())); } details = cr.list(); tx.commit(); } catch (exception asd) { log.debug(asd.getmessage()); if (tx != null) { tx.commit(); } } { session.close(); } return details; } i trying have generic method them , have written far: public static <t> list<t> getdetails(class<t> c, class<t> b) { l...
Read more

arrays - What causes a java.lang.ArrayIndexOutOfBoundsException and how do I prevent it? -

what arrayindexoutofboundsexception mean , how rid of it? here code sample triggers exception: string[] name = {"tom", "dick", "harry"}; for(int = 0; i<=name.length; i++) { system.out.print(name[i] +'\n'); } your first port of call should documentation explains reasonably clearly: thrown indicate array has been accessed illegal index. index either negative or greater or equal size of array. so example: int[] array = new int[5]; int boom = array[10]; // throws exception as how avoid it... um, don't that. careful array indexes. one problem people run thinking arrays 1-indexed, e.g. int[] array = new int[5]; // ... populate array here ... (int index = 1; index <= array.length; index++) { system.out.println(array[index]); } that miss out first element (index 0) , throw exception when index 5. valid indexes here 0-4 inclusive. correct, idiomatic for statement here be: for (int index = 0; index <...
Read more