python - First HTTPS request takes much more time than the rest -


i'm making python app needs make fast http api calls. use python requests package make api calls on https. noticed first request takes more time rest. not due establishing http connection because requests.get() establishes new connection on every call (checked requests logs).

i investigated network wireshark , although found first request takes more time others, difference not big.

i noticed if make first call host1 , rest host2, request host1 takes more time subsequent requests. assures me issue not connected establishing kind of connection host.

i checked ping command , didn't find such difference between first , subsequent ping requests.

is os, requests initial set on first request or else?

my python code:

import requests import time import logging   logging.basicconfig(level=logging.debug)  url = "https://bittrex.com/api/v1.1/public/getorderbook?market=btc-ltc&type=both"  in range(10):     start = time.time()      requests.get(url)      end = time.time()      print('time: {}. index: {}'.format(end - start, i))

output:

debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.8292889595031738. index: 0 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.14321112632751465. index: 1 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.10214948654174805. index: 2 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.10616683959960938. index: 3 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.1061558723449707. index: 4 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.09714269638061523. index: 5 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.0861358642578125. index: 6 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.08713865280151367. index: 7 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.09714365005493164. index: 8 debug:urllib3.connectionpool:starting new https connection (1): bittrex.com debug:urllib3.connectionpool:https://bittrex.com:443 "get /api/v1.1/public/getorderbook?market=btc-ltc&type=both http/1.1" 200 46568 time: 0.09714889526367188. index: 9

see:
python requests module slow on specific machine
why python 3 http.client faster python-requests?
requests: how disable / bypass proxy

for issue seems around proxies.
change code speeded things dramatically me.

import requests import time import logging logging.basicconfig(level=logging.debug) url = "https://bittrex.com/api/v1.1/public/getorderbook?market=btc-ltc&type=both" session = requests.session() session.trust_env = false  in range(10):     start = time.time()      session.get(url)      end = time.time()      print('time: {}. index: {}'.format(end - start, i))

from requests: how disable / bypass proxy
written @lukas graf
"the way i'm aware of disabling proxies entirely following:

create session
set session.trust_env false
create request using session"

your mileage may differ


Comments

Post a Comment

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

i running os ububtu 16.04. ultimate goal able run php script cron job every minute. here php script located @ /var/www/html/tests/test/index.php : <?php $directorypath = $_server['document_root']."/tests/test/data/"; echo "directorypath: $directorypath<br><br>";//check $imagefilepathsarray = glob($directorypath . "*.{png,gif}", glob_brace); echo "<br><br>imagefilepathsarray: "; print_r($imagefilepathsarray);//check ?> when open php script in browser visiting url my-ip-address/tests/test/index.php , get: directorypath: /var/www/html/tests/test/data/ imagefilepathsarray:array( [0] => /var/www/html/tests/test/data/pic.png [1] => /var/www/html/tests/test/data/pic.gif ) before writing cron job in crontab file, need check if can run anywhere using terminal . opened ubuntu terminal @ /home/ location, , executed in terminal: sudo php /var/www/html/tests/test/index.php i got following out...
Read more

php - How can i create a user dashboard -

today have questions you, want create user dashboard site, include (obviously), users data, example -email -username -and others stuff how can information, , print them in html page? if can, how can these information via php sessions? shuld use session? example, if user login, , start new session ( session_start() ), how can data print in dashboard? should use php "project"? in advice, have day , thank time!
Read more

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -

i have jquery mobile page fixed full-screen toolbar, data-tap-toggle enabled. straight under toolbar have positioned banner should slide upwards when toolbar hiding , slide downward when toolbar showing. jquery mobile toggles toolbar applying , removing ui-fixed-hidden class - sadly, can't find in documentation of toolbar widget toggle , hide or show event that. how can detect when toolbar toggled, reposition banner? .banner { position: fixed; background-color: darkseagreen; top: 46px; min-height: 48px; width: 100%; text-align: center; line-height: 48px; } <!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"> <script src="https://code.jquery.com/jquery-1....
Read more