matrix - How to send sparse vectors and matrices over ZeroMQ? -


i have matrix a (how many stories start way?) sparse. 

[ [0,   0, 0, 1.2, 0] [0,   0, 0, 0,   0] [3.5, 0, 0, 0,   0] [0    7, 0, 0,   0] ]

i want send variants of , forth between processes using zeromq. assume client , servers of different languages have no common serialization format. here tasks.

  1. create a. complicated needing send "frame" of matrix, here (4,5).
  2. update a[4,2] 7 6.
  3. take sparse vector v=[0,0,3.1,0,0] , multiply a , result back.

i've been told sending byte streams best solution, can't find examples between different libraries , in sparse format.

my default have python, c++ or chapel pairing if can speak those.

as you know, brian, zeromq not problem here

lets try re-wrap problem formulation first:

  1. features use zmq; provide

  2. from zeromq point of view, not originator's side , ( or c++, you've mentioned above ) target environment decide on best choice of best serialisation strategy provider, de-ser have work inside particular target language implementation ( yes, zeromq best carry necessary payloads, byte-by-byte, nothing dangerous here, current state of zmq-module issue, being under review ), de-ser decides, once data have come in ( have been put in many of zeromq answers, zmq either deliver complete original message or none @ -- ceases dangerous no-go-strategy try move whole massive-matrix @ once ... ).

  3. the extreme care taken on sparse-matrix tools means, there rather need "communicate" sparse-matrix (re-)-representation, "send"-it ( if not due not available [space] on originator's node, due different representations of sparse-matrix content )

a concept of possible solution:

this said, choice create intelligent distributed agent-based system translation, allow target-environment ask originator's side ( massive sparse-matrix assembled ) start process of re-representation of massive sparse-matrix onto target-environment, such "replication-via-smart-communicated-content" become ready in { matrix | sparsematrix } type of such content re-representation, ready use linearalgebra;

simply forget hunt low-hanging fruits offered far, [space] kill json-grown-in-size-re-wrapped-original-massive-matrix, 1st hardly fit on same node in-ram footprint , 2nd next crash zero-copy ( there copies of such data-peta-blob attempted placed o/s & kernel network buffers etc ) , that not fly.


Comments

Post a Comment

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

i running os ububtu 16.04. ultimate goal able run php script cron job every minute. here php script located @ /var/www/html/tests/test/index.php : <?php $directorypath = $_server['document_root']."/tests/test/data/"; echo "directorypath: $directorypath<br><br>";//check $imagefilepathsarray = glob($directorypath . "*.{png,gif}", glob_brace); echo "<br><br>imagefilepathsarray: "; print_r($imagefilepathsarray);//check ?> when open php script in browser visiting url my-ip-address/tests/test/index.php , get: directorypath: /var/www/html/tests/test/data/ imagefilepathsarray:array( [0] => /var/www/html/tests/test/data/pic.png [1] => /var/www/html/tests/test/data/pic.gif ) before writing cron job in crontab file, need check if can run anywhere using terminal . opened ubuntu terminal @ /home/ location, , executed in terminal: sudo php /var/www/html/tests/test/index.php i got following out...
Read more

php - How can i create a user dashboard -

today have questions you, want create user dashboard site, include (obviously), users data, example -email -username -and others stuff how can information, , print them in html page? if can, how can these information via php sessions? shuld use session? example, if user login, , start new session ( session_start() ), how can data print in dashboard? should use php "project"? in advice, have day , thank time!
Read more

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -

i have jquery mobile page fixed full-screen toolbar, data-tap-toggle enabled. straight under toolbar have positioned banner should slide upwards when toolbar hiding , slide downward when toolbar showing. jquery mobile toggles toolbar applying , removing ui-fixed-hidden class - sadly, can't find in documentation of toolbar widget toggle , hide or show event that. how can detect when toolbar toggled, reposition banner? .banner { position: fixed; background-color: darkseagreen; top: 46px; min-height: 48px; width: 100%; text-align: center; line-height: 48px; } <!doctype html> <html> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"> <script src="https://code.jquery.com/jquery-1....
Read more