Using WGET to run a cronjob PHP
I tried to do a cron and run a url every 5 mintues.
I tried to do a cron and run a url every 5 mintues.
i write a node.js code just like below sample.
Is it possible to essentially run a wget
from within a node.js app? I’d like to have a script that crawls a site, and downloads a specific file, but the href
of the link that goes the file changes fairly often. So, I figured the easiest way to go about doing it would be to find the href
of the link, then just perform a wget on it.
I want to get the content from this website.
I try to download a file with wget
and curl
and it is rejected with a 403 error (forbidden).
One major shortcoming of curl
is that more and more wepages are having their main piece of content painted by a JavaScript AJAX response that occurs after the initial HTTP response. curl
never picks up on this post-painted content.
I have a problem with the following wget command:
This is, how I download various master branches from GitHub, and I aim to have a prettier script (and maybe more reliable?).
I need to use wget
to download a file to the directory /var/cache/foobar/
(so, as an example, if I download stackexchange-site-list.txt
, it’d be downloaded to /var/cache/foobar/stackexchange-site-list.txt
)
Imagine something like this: