jeudi 5 novembre 2015

R: Speed up API calls

Vote count: 0

I am writing code to collect data from the Steam API (documentation: http://ift.tt/1nlgDl9).

Particularly, I use the fromJSON() function from the jsonlite package in [R].

However, I have the feeling that the code is slow, and that the bottleneck is the actual calling of the API. I am currently able to do around 7.500-10.000 calls an hour, resulting in around 2-3 calls per second. This feels slow. Is it possible to speed this up, and if so, how?

Two things I found already is that it may be necessary to close the connection after opening it (cf. http://ift.tt/1PcHM9Q). Also, the API allows json (what I use now) but also XML and CSV outputs, maybe it is better to use one of the latter two? Any other possible solutions?

asked 35 secs ago

This entry passed through the Full-Text RSS service - if this is your content and you're reading it on someone else's site, please read the FAQ at http://ift.tt/jcXqJW.



R: Speed up API calls

Aucun commentaire:

Enregistrer un commentaire