User Controls
Some advanced bash scripting.
-
2015-11-27 at 6:37 PM UTCAlright so while i have the chance i wanted to ask a couple of bash related questions.
I want to make a script that takes in a list of URLs stores each line as a variable and then passes that variable as an argument to curl, then i want curl to do some magic retrieve some data and print the data to STDOUT. I want this to continue until all the lines in the textfile have been tested in such a manner. Now i want bash to know that it needs to stop after all the lines have been tested so i was thinking i would have to programatically insert some type of End Of File marker to check for.
I want this all to happen when a function gets called. Now IDK a lot of Bash so i do not even know how i can have it read in a liat like that. Also with regards to functions in Bash is there some special kind of syntax i need to take into account or can i just do this:
function foo()
do bar
return bas
also in case i want to redirect output to a textfile can i just do:
myscript.sh >> /tmp/outfile.txt
Bare in mind my script will prpbably come with args so does bash know i mean redirect when i enter two greater than symbols or will it think i am trying to pass an argument?
thanks goys -
2015-11-28 at 2:12 AM UTCIs PHP not plausible? Or are you trying to keep it CMD-line?
-
2015-11-28 at 9:09 AM UTC
Is PHP not plausible? Or are you trying to keep it CMD-line?
Not sure honestly, but i wasn't planning on making the tool web based. I could probably do it in C but i don't know any C. And while i do know a bit of python half of the purpose of making the script was teaching myself more bash. -
2015-12-04 at 3:54 AM UTCYou will hate yourself if you use bash, just a warning.
I'd do it like this:
Read in the entire file to a variable (assuming it's not too large), then split by newline - saving each line to a dynamically created variable or hash list or regular list. You'll know you have reached the end when there are no more newlines. Then use system calls for the curl stuff, manipulate it etc.
Also you can call php from the command line, hell I think you can even call it like "./myPhpScript", same with javascript. You can write php and js scripts without intending on using it for the web. -
2015-12-04 at 3:56 AM UTCOh yeah it should redirect fine, the only problem I can see is if you needed ">" to be the parameter itself.
-
2015-12-04 at 6:03 AM UTCThis seems like a perfectly suitable job for bash to me, you don't even really need a script or anything, xargs will do this for you:
lanny@niggasin:~$ cat urls.txt
http://textfiles.com/art/afinger.txt
http://textfiles.com/art/bobface.txt
lanny@niggasin:~$ cat urls.txt | xargs -L 1 curl
/"\
|\./|
| |
| |
|>~<|
| |
/'\| |/'\..
/~\| | | | \
| =[@]= | | \
| | | | | \
| ~ ~ ~ ~ |` )
| /
\ /
\ /
\ _____ /
|--//''`\--|
| (( +==)) |
|--\_|_//--|THE FACE OF "BOB" fnord
$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$
$$$$$$$$$$$$$$ $$$$$$$ $$ $ $$$$
$$$$$$$$$$$ $$ $$$ $$ $ $ $$$$
$$$$%$$$ $ $ $$ $$$ $ $ $$ $ $$
$$$$%%$$$ $ $ $$ $$$ $ $$ $ $ $$$
$$$$$%%$$$$ $ $ $ $$ $ $$$ $ $$ $$$$
$$$$$%%%$$$$$ $$$$ $ $ $$ $ $$$$$ $$ $$$$$
$$$$$$%%%$$$$$$$$$$$ $$ $ $$$$ $ $$$$$$$$$$$$$$$$
$$$$$$%%%$$$$$$$$$$$$$$$ $$$$$$ $$$$$$$$$$$$$$$$$$$
$$$$$$%%%$$%%%%%%$$$$$$$$$$$$$$$ $$$$$$$$$ $$$$$$$$
$$$$$$%%$$%%%%%%%%%$$$$$$$$$$$$$ $$$$$$$ $$$$%$$$
$$$$$$%$$%%%%%%%%%%%$$$$$$$$$$$$$$$$$ $$$$%%$$$
$$$$$$$$%%%%%%%%%%%%%$$$$$$$$$$$ $$$$%%$$$
$$$$$$$%%% $$$$$$$$ $$$%%$$$
$$$$$$%%% $$$%%$$
$$$$$$%%% $$$%%$$
$$$$$%%%% % $$$%%$$
$$$$$%%%% % $$%%$$
$$$$$%%%% % $$%%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %%% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$%%%% $$$$ %% $$$$%$$
$ $$$%%%% $$$$$$$$$ $$$$$$$$$%% $$$$$$$
$$$ $$%%% $$$$$$$$$$ $$$$$$$$$$$%% $$$$$$
$$$$ %%% $$$ $$$$ $$%% $$$$$$
$$$$$$%%% $$$$$ $$$$ $$$$$$$$$$ $%% $$$$$$
$$$$ %%% $$$ $$$$$ $$$$$$ $$$ %%% $$$$$
$$$$ $$$$$$$$$ $$$$ $$$$$$$$$$$$$$ % $$$$$
$$$$ $$$ $ $$ $$$$ $$$$$$ $ $ $$ $$$$
$$$$ $ $$$ %%%$$$ %% $$$ $$$$
$$$$ %%%% $$ %%%%%% %%% $$$$
$$$$ %%% %%%%% $ %%%%%%% $$$$
$$$$ %%%%% $$ %%% $$ $
$$ $ %% $ $ $$
$ $$ $ $ $
$ $$ $ %$ $$ $
$ $ $ %%$ $$$$
$$$ $$ $ %%% $ $ $$
$$ $$ $ %%%% $ $$$ $$ $
$ $$$ $$ %%%% $$$ $$$ $$$ $
$ $$$ $$ %%%$$$ $$$$ $$$$ $$$$ $
$$$$$$$$$$ $$$$$$$$$$$$$$ $$$$$$$$$ $
$$$$$$$ $$$$$$$$$$$$$$ $$$$$$$$ $
$$$$$$ %%$$$$$$$$$$$$$$ $$$$$$$$$$$$$$
$$$ $$ %$$$$$$$$$$ $$$$$$$$$ $$$$
$$ $ $$$$ $$$$$$$$ $$ $$$
$$ $ %$$$$ $$ $$$$
$ $ %%%%$$$ $$$$$$$$$$$$$ $$$
$$ $$ %%%% $$ $$$$
$$ $$ %%$$$$ $$$$$$$$$$ $$$
$ $ $$$$$%%%%%%%%%% $$$$
$$ $$ $$$$$%%% $$$
$ $ $$$$ %%%%%%%%%%%%%% $$$
$$ $$$$ %%%%%%%%%%%%% $$$
$$$ $ $$$$ $%%%% $$$
$$ $$ $$$$$ $$$$ $$$
$ $$ $$ $$$$$$ $$$ $$$
$ $$$$ $$ $$$$$$ $$$$ $$$
$ $$$ $$$ $$$$$$ $$$$$$$ $$$
$ $$$$$$$$$$ $$$$$$ $$$
$ $$ $$$$$$$$ $$$$$$$$$$$$$$$ $$$
$$$$$ $$$$$$$ $$$$$$$$$$$$$$$$$$
$$$$$$ $$$$$ $$$$$$
$$$$$ $$$$
$$$$$$ $$$
$$$$$ $$$
$$$$$$$$
$$$$$$
and
THE FACE OF "BOB" (SMALL VERSION) 12-13-90
@@@@@@@^^~~~~~~~~~~~~~~~~~~~~^@@@@@@@@@
@@@@@@^ ~^ @ @@ @ @ @ I ~^@@@@@@
@@@@@ ~ ~~ ~I @@@@@
@@@@' ' _,w@< @@@@
@@@@ @@@@@@@@w___,w@@@@@@@@ @ @@@
@@@@ @@@@@@@@@@@@@@@@@@@@@@ I @@@
@@@@ @@@@@@@@@@@@@@@@@@@@*@[ i @@@
@@@@ @@@@@@@@@@@@@@@@@@@@[][ | ]@@@
@@@@ ~_,,_ ~@@@@@@@~ ____~ @ @@@
@@@@ _~ , , `@@@~ _ _`@ ]L J@@@
@@@@ , @@w@ww+ @@@ww``,,@w@ ][ @@@@
@@@@, @@@@www@@@ @@@@@@@ww@@@@@[ @@@@
@@@@@_|| @@@@@@P' @@P@@@@@@@@@@@[|c@@@@
@@@@@@w| '@@P~ P]@@@-~, ~Y@@^'],@@@@@@
@@@@@@@[ _ _J@@Tk ]]@@@@@@
@@@@@@@@,@ @@, c,,,,,,,y ,w@@[ ,@@@@@@@
@@@@@@@@@ i @w ====--_@@@@@ @@@@@@@@
@@@@@@@@@@`,P~ _ ~^^^^Y@@@@@ @@@@@@@@@
@@@@^^=^@@^ ^' ,ww,w@@@@@ _@@@@@@@@@@
@@@_xJ~ ~ , @@@@@@@P~_@@@@@@@@@@@@
@@ @, ,@@@,_____ _,J@@@@@@@@@@@@@
@@L `' ,@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
The holy visage of "Bob" Dobbs is copyright 1990, and probably other
years as well - MAYBE EVEN YEARS YOU WON'T FIND IN YOUR PINK CALENDAR!
- by the Church of the SubGenius. Fnord.
(Note that the face of J.R. ``Bob'' Dobbs is a registered trademark of
the Church of the SubGenius. Fnord.)
lanny@niggasin:~$Bare in mind my script will prpbably come with args so does bash know i mean redirect when i enter two greater than symbols or will it think i am trying to pass an argument?
The former, ">>" as well as other bash reserved symbols are never read as arguments. If you want to pass >> as an argument you need to wrap it in quotes. -
2015-12-04 at 10:39 AM UTC
This seems like a perfectly suitable job for bash to me, you don't even really need a script or anything, xargs will do this for you:
lanny@niggasin:~$ cat urls.txt
http://textfiles.com/art/afinger.txt
http://textfiles.com/art/bobface.txt
lanny@niggasin:~$ cat urls.txt | xargs -L 1 curl
/"\
|\./|
| |
| |
|>~<|
| |
/'\| |/'\..
/~\| | | | \
| =[@]= | | \
| | | | | \
| ~ ~ ~ ~ |` )
| /
\ /
\ /
\ _____ /
|--//''`\--|
| (( +==)) |
|--\_|_//--|THE FACE OF "BOB" fnord
$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$$$$$$$$$$$$$$$$$$$$$$$$$$ $$$$$
$$$$$$$$$$$$$$ $$$$$$$ $$ $ $$$$
$$$$$$$$$$$ $$ $$$ $$ $ $ $$$$
$$$$%$$$ $ $ $$ $$$ $ $ $$ $ $$
$$$$%%$$$ $ $ $$ $$$ $ $$ $ $ $$$
$$$$$%%$$$$ $ $ $ $$ $ $$$ $ $$ $$$$
$$$$$%%%$$$$$ $$$$ $ $ $$ $ $$$$$ $$ $$$$$
$$$$$$%%%$$$$$$$$$$$ $$ $ $$$$ $ $$$$$$$$$$$$$$$$
$$$$$$%%%$$$$$$$$$$$$$$$ $$$$$$ $$$$$$$$$$$$$$$$$$$
$$$$$$%%%$$%%%%%%$$$$$$$$$$$$$$$ $$$$$$$$$ $$$$$$$$
$$$$$$%%$$%%%%%%%%%$$$$$$$$$$$$$ $$$$$$$ $$$$%$$$
$$$$$$%$$%%%%%%%%%%%$$$$$$$$$$$$$$$$$ $$$$%%$$$
$$$$$$$$%%%%%%%%%%%%%$$$$$$$$$$$ $$$$%%$$$
$$$$$$$%%% $$$$$$$$ $$$%%$$$
$$$$$$%%% $$$%%$$
$$$$$$%%% $$$%%$$
$$$$$%%%% % $$$%%$$
$$$$$%%%% % $$%%$$
$$$$$%%%% % $$%%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %%% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$$%%%% %% $$$%$$
$$$$%%%% $$$$ %% $$$$%$$
$ $$$%%%% $$$$$$$$$ $$$$$$$$$%% $$$$$$$
$$$ $$%%% $$$$$$$$$$ $$$$$$$$$$$%% $$$$$$
$$$$ %%% $$$ $$$$ $$%% $$$$$$
$$$$$$%%% $$$$$ $$$$ $$$$$$$$$$ $%% $$$$$$
$$$$ %%% $$$ $$$$$ $$$$$$ $$$ %%% $$$$$
$$$$ $$$$$$$$$ $$$$ $$$$$$$$$$$$$$ % $$$$$
$$$$ $$$ $ $$ $$$$ $$$$$$ $ $ $$ $$$$
$$$$ $ $$$ %%%$$$ %% $$$ $$$$
$$$$ %%%% $$ %%%%%% %%% $$$$
$$$$ %%% %%%%% $ %%%%%%% $$$$
$$$$ %%%%% $$ %%% $$ $
$$ $ %% $ $ $$
$ $$ $ $ $
$ $$ $ %$ $$ $
$ $ $ %%$ $$$$
$$$ $$ $ %%% $ $ $$
$$ $$ $ %%%% $ $$$ $$ $
$ $$$ $$ %%%% $$$ $$$ $$$ $
$ $$$ $$ %%%$$$ $$$$ $$$$ $$$$ $
$$$$$$$$$$ $$$$$$$$$$$$$$ $$$$$$$$$ $
$$$$$$$ $$$$$$$$$$$$$$ $$$$$$$$ $
$$$$$$ %%$$$$$$$$$$$$$$ $$$$$$$$$$$$$$
$$$ $$ %$$$$$$$$$$ $$$$$$$$$ $$$$
$$ $ $$$$ $$$$$$$$ $$ $$$
$$ $ %$$$$ $$ $$$$
$ $ %%%%$$$ $$$$$$$$$$$$$ $$$
$$ $$ %%%% $$ $$$$
$$ $$ %%$$$$ $$$$$$$$$$ $$$
$ $ $$$$$%%%%%%%%%% $$$$
$$ $$ $$$$$%%% $$$
$ $ $$$$ %%%%%%%%%%%%%% $$$
$$ $$$$ %%%%%%%%%%%%% $$$
$$$ $ $$$$ $%%%% $$$
$$ $$ $$$$$ $$$$ $$$
$ $$ $$ $$$$$$ $$$ $$$
$ $$$$ $$ $$$$$$ $$$$ $$$
$ $$$ $$$ $$$$$$ $$$$$$$ $$$
$ $$$$$$$$$$ $$$$$$ $$$
$ $$ $$$$$$$$ $$$$$$$$$$$$$$$ $$$
$$$$$ $$$$$$$ $$$$$$$$$$$$$$$$$$
$$$$$$ $$$$$ $$$$$$
$$$$$ $$$$
$$$$$$ $$$
$$$$$ $$$
$$$$$$$$
$$$$$$
and
THE FACE OF "BOB" (SMALL VERSION) 12-13-90
@@@@@@@^^~~~~~~~~~~~~~~~~~~~~^@@@@@@@@@
@@@@@@^ ~^ @ @@ @ @ @ I ~^@@@@@@
@@@@@ ~ ~~ ~I @@@@@
@@@@' ' _,w@< @@@@
@@@@ @@@@@@@@w___,w@@@@@@@@ @ @@@
@@@@ @@@@@@@@@@@@@@@@@@@@@@ I @@@
@@@@ @@@@@@@@@@@@@@@@@@@@*@[ i @@@
@@@@ @@@@@@@@@@@@@@@@@@@@[][ | ]@@@
@@@@ ~_,,_ ~@@@@@@@~ ____~ @ @@@
@@@@ _~ , , `@@@~ _ _`@ ]L J@@@
@@@@ , @@w@ww+ @@@ww``,,@w@ ][ @@@@
@@@@, @@@@www@@@ @@@@@@@ww@@@@@[ @@@@
@@@@@_|| @@@@@@P' @@P@@@@@@@@@@@[|c@@@@
@@@@@@w| '@@P~ P]@@@-~, ~Y@@^'],@@@@@@
@@@@@@@[ _ _J@@Tk ]]@@@@@@
@@@@@@@@,@ @@, c,,,,,,,y ,w@@[ ,@@@@@@@
@@@@@@@@@ i @w ====--_@@@@@ @@@@@@@@
@@@@@@@@@@`,P~ _ ~^^^^Y@@@@@ @@@@@@@@@
@@@@^^=^@@^ ^' ,ww,w@@@@@ _@@@@@@@@@@
@@@_xJ~ ~ , @@@@@@@P~_@@@@@@@@@@@@
@@ @, ,@@@,_____ _,J@@@@@@@@@@@@@
@@L `' ,@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
The holy visage of "Bob" Dobbs is copyright 1990, and probably other
years as well - MAYBE EVEN YEARS YOU WON'T FIND IN YOUR PINK CALENDAR!
- by the Church of the SubGenius. Fnord.
(Note that the face of J.R. ``Bob'' Dobbs is a registered trademark of
the Church of the SubGenius. Fnord.)
lanny@niggasin:~$
The former, ">>" as well as other bash reserved symbols are never read as arguments. If you want to pass >> as an argument you need to wrap it in quotes.
well that seems easy enough. -
2015-12-05 at 7:50 PM UTCProblemo solved.
-
2015-12-05 at 8:21 PM UTCStill gonna' make a shellscript just to see if i can. I'll even add some kewl options and shit to make it fancy.
