Our mission will be to get a formatted output port:state:service like this
… and so on …
All closed ports should be marked as 1 the rest will be 0.
Like always, in *nix system we have plenty of tools (and approaches) to get the expected result, lets try the awk way…
At first sight we can identify three fields in our input file and tree tasks be solved.
Get rid of the slash + tcp string of the first field.
Change the value of the second field for 1 or 0.
Field separator should be :
A simply text replacing, is a straightforward way to get the expected result:
Here’s the internals:
We look for a string started by as slash (note de escape char \/) followed by any number of any character (dot + star .*) ,followed by the string closed and ended by any number of space chars * and replace it with :1: .For the first line:
21/tcp closed ftp will be replace for :1:
Same thing for “open” in this case “:0:” will be the substitution string , example: 22/tcp open ssh will be replace for :0:
Our initial tasks get solved ,but we can refine our efforts.
Let’s use the conditional operator.
expr ? action1 : action2
Its pretty straight forward : if expr then acction1 is performed/evaluated , if not action2.
For our example , field two must change to 1 if it’s value is closed, if not it should be 1.
The needed conditional operator:
$2=="closed" ? "1" : "0"
Depending of second field value, our program will perform a different action, in this case its returning a string : 1 or 0.
At this point, a variable is needed to store it:
n= $2=="closed" ? "1" : "0"
Finally we perform the text substitution:
Note that we reduce the calls to the sub function to just one.
A final (and total different) approach , field substitution instead of text replacing.
Remember our tasks:
a) Get rid of the slash+tcp string of the first field.
b) Change the value of the second field for 1 or 0
c) Field separator should be :
Our input file has naturally three fields (by the default awkFS ):
It’s clear that we can think in a four fields based line, if we add the slash / to our field separators by using a regex as FS='( *)|(/)' where ( *) represents any number of spaces as separator and (/) represents the slash:
Note that the Output Field Separator OFS is changed to > for clarify.
Now, we want to get rid of the second field, technically is not possible, but we can assign the null value (empty string) to it:
Attention, the use of the print statement is not needed, awk will print the input line if the result of applying the inner statements to the current input line is true.
The assignment $2="" is not an action statement but we force a true return by placing 1 at the end of the program.
If we set the OFS to null value:
We’re close to or goal, the last step is to process the third field:
$3=="closed" ? ":1:" : ":0:"
Like we saw before we need to assign it to a variable,… look the trick:
$3= $3=="closed" ? ":1:" : ":0:"
We say , hey! change `$3 depending of its previous value.
A final optimization, the conditional operator performs always an action that imply the print statement, so:
Lets say that whe have a bunch of txt files and we need to rename to sql.
We can use ls combined with sed and xargs to achieve our goal.
How it works:
The ls output is piped to sed , then we use the p flag to print the argument without modifications, in other words, the original name of the file.
The next step is use the substitute command to change file extension.
NOTE: We’re using single quotes to enclose literal strings (the dot is a metacharacter if using double quotes scape it with a backslash).
The result is a combined output that consist of a sequence of old_file_name and new_file_name.
Finally we pipe the resulting feed through xargs to get the effective rename of the files.
PD: Alternative path to take care of spaces in the file names:
Here’s the CMD:
From the man page:
xargs combines the fixed initial-arguments with arguments read from
standard input to execute the specified command one or more times.
The number of arguments read for each command invocation and the
manner in which they are combined are determined by the options
The n parameter
-n number Execute command using as many standard input
arguments as possible, up to number arguments
maximum. Fewer arguments are used if their total
size is greater than size bytes, and for the last
invocation if there are fewer than number
arguments remaining. If option -x is also coded,
each number arguments must fit in the size[/sourcecode]
The -n2 flag force xargs to take 2 arguments from the piped output each time and parses it to the mv command to get the job done.