Difference between revisions of "Core utilities"

From ArchWiki
Jump to: navigation, search
m (extract: indent level confuses intention)
(added GREP_OPTIONS info)
(26 intermediate revisions by 16 users not shown)
Line 1: Line 1:
[[Category:Utilities (English)]]
+
[[Category:System administration]]
 +
[[zh-CN:Core Utilities]]
 
{{Article summary start}}
 
{{Article summary start}}
 
{{Article summary text|Tips and tricks related to so-called "core" utilities on a GNU/Linux system.}}
 
{{Article summary text|Tips and tricks related to so-called "core" utilities on a GNU/Linux system.}}
Line 5: Line 6:
 
{{Article summary wiki|Commandline Tools}}
 
{{Article summary wiki|Commandline Tools}}
 
{{Article summary wiki|General Recommendations}}
 
{{Article summary wiki|General Recommendations}}
 +
{{Article summary wiki|GNU Project}}
 
{{Article summary end}}
 
{{Article summary end}}
This article deals with so-called "core" utilities on a GNU/Linux system, such as '''less''', '''ls''', and '''grep'''. The scope of this article includes -- ''but is not limited to'' -- those utilities included with the GNU {{Package Official|coreutils}} package. What follows are various tips and tricks and other helpful information related to these utilities. If sections grow too detailed, please split into separate articles.
 
  
==alias==
+
This article deals with so-called "core" utilities on a GNU/Linux system, such as '''less''', '''ls''', and '''grep'''. The scope of this article includes -- ''but is not limited to'' -- those utilities included with the GNU {{Pkg|coreutils}} package. What follows are various tips and tricks and other helpful information related to these utilities. If sections grow too detailed, please split into separate articles.
[[Wikipedia:alias|alias]] is a command in various shells, such as [[Bash]], which enables a replacement of a word with another string. It is often used for abbreviating a system command, or for adding default arguments to a regularly used command.
+
 
+
Personal aliases are preferably stored in {{Filename|~/.bashrc}}, and system-wide aliases (which affect all users) belong in {{Filename|/etc/bash.bashrc.local}}.
+
 
+
An example excerpt from {{Filename|~/.bashrc}} covering several time-saving aliases:
+
{{File
+
|name=~/.bashrc
+
|content=<nowiki>
+
# modified commands
+
alias diff='colordiff'              # requires colordiff package
+
alias grep='grep --color=auto'
+
alias more='less'
+
alias df='df -h'
+
alias du='du -c -h'
+
alias mkdir='mkdir -p -v'
+
alias nano='nano -w'
+
alias ping='ping -c 5'
+
alias ..='cd ..'
+
 
+
# new commands
+
alias da='date "+%A, %B %d, %Y [%T]"'
+
alias du1='du --max-depth=1'
+
alias hist='history | grep $1'     # requires an argument
+
alias openports='netstat --all --numeric --programs --inet'
+
alias pg='ps -Af | grep $1'        # requires an argument
+
 
+
# privileged access
+
if [ $UID -ne 0 ]; then
+
    alias sudo='sudo '
+
    alias scat='sudo cat'
+
    alias svim='sudo vim'
+
    alias root='sudo su'
+
    alias reboot='sudo reboot'
+
    alias halt='sudo halt'
+
    alias update='sudo pacman -Su'
+
    alias netcfg='sudo netcfg2'
+
fi
+
 
+
# ls
+
alias ls='ls -hF --color=always'
+
alias lr='ls -R'                    # recursive ls
+
alias ll='ls -l'
+
alias la='ll -A'
+
alias lx='ll -BX'                  # sort by extension
+
alias lz='ll -rS'                  # sort by size
+
alias lt='ll -rt'                  # sort by date
+
alias lm='la | more'
+
 
+
# safety features
+
alias cp='cp -i'
+
alias mv='mv -i'
+
alias rm='rm -I'                    # 'rm -i' prompts for every file
+
alias ln='ln -i'
+
alias chown='chown --preserve-root'
+
alias chmod='chmod --preserve-root'
+
alias chgrp='chgrp --preserve-root'
+
</nowiki>}}
+
 
+
==extract==
+
The following function will extract a wide range of compressed file types. Add the function to {{Filename|~/.bashrc}} and use it with the syntax {{Codeline|extract <file1> <file2> ...}}
+
 
+
{{File
+
|name=~/.bashrc
+
|content=<nowiki>
+
extract() {
+
    local c e i
+
 
+
    for i; do
+
            e=0
+
            c=''
+
 
+
            if [[ ! -r $i ]]; then
+
                    echo "$0: file is unreadable: \`$i'" >&2
+
                    e=1
+
                    continue
+
            fi
+
 
+
            case $i in
+
            *.t@(gz|lz|xz|b@(2|z?(2))|a@(z|r?(.@(Z|bz?(2)|gz|lzma|xz)))))
+
                  c='bsdtar xvf';;
+
            *.7z)  c='7z x';;
+
            *.Z)  c='uncompress';;
+
            *.bz2) c='bunzip2';;
+
            *.exe) c='cabextract';;
+
            *.gz)  c='gunzip';;
+
            *.rar) c='unrar x';;
+
            *.xz)  c='unxz';;
+
            *.zip) c='unzip';;
+
            *)    echo "$0: unrecognized file extension: \`$i'" >&2
+
                  e=1
+
                  continue;;
+
            esac
+
 
+
            command $c "$i"
+
    done
+
 
+
    return $e
+
}
+
</nowiki>}}
+
 
+
{{note|[[Bash]] users should make sure extglob is enabled: {{codeline|shopt -s extglob}}. It is enabled by default if using [[Bash#Advanced completion|Bash completion]]. [[Zsh]] users should do: {{codeline|setopt kshglob}} instead.}}
+
 
+
Another way to do this is to install ''unp'' package.
+
  
 
==grep==
 
==grep==
[[Wikipedia:grep|grep]] is a command line text search utility originally written for Unix. The {{codeline|grep}} command searches files or standard input globally for lines matching a given regular expression, and prints them to the program's standard output.
+
[[Wikipedia:grep|grep]] is a command line text search utility originally written for Unix. The {{ic|grep}} command searches files or standard input globally for lines matching a given regular expression, and prints them to the program's standard output.
  
Beyond aesthetics, {{Codeline|grep}}'s color output is immensely useful for learning {{Codeline|regexp}} and {{Codeline|grep}}'s functionality.
+
Beyond aesthetics, {{ic|grep}}'s color output is immensely useful for learning {{ic|regexp}} and {{ic|grep}}'s functionality.
  
To add it, write the following entry to {{Filename|~/.bashrc}}:
+
To use the default colors for grep, write the following entry to {{ic|~/.bashrc}}:
  export GREP_COLOR="1;33"
+
alias grep='grep --color=auto'
  alias grep='grep --color=auto'
+
Alternatively, you can set the {{ic|GREP_OPTIONS}} [[Environment Variables|environment variable]] [http://www.gnu.org/software/grep/manual/html_node/Environment-Variables.html] bearing in mind this may break some scripts that use {{ic|grep}} [http://brainstorm.ubuntu.com/idea/24141/]:  
 +
  export GREP_OPTIONS='--color=auto'
 +
To include file line numbers in the output, add "''-n''":
 +
  alias grep='grep -n --color=auto'  
  
The variable {{codeline|GREP_COLOR}} is used to specify the output color, in this example a light yellow color.
+
The environment variable {{ic|GREP_COLORS}} may be used to specify different colors than the defaults.
  
Although {{codeline|grep}}'s [[man page]] states that {{codeline|GREP_COLOR}} is deprecated and that {{codeline|GREP_COLORS}} is preferable, this variable does not work as of {{Package Official|grep}} version 2.5.4, so use {{codeline|GREP_COLOR}} for now.
+
==less==
 +
[[Wikipedia:less (Unix)|less]] is a terminal pager program used to view the contents of a text file one screen at a time. Whilst similar to other pages such as {{ic|more}} and {{ic|pg}}, {{ic|less}} offers a more advanced interface and complete feature-set.[http://www.greenwoodsoftware.com/less/faq.html]
  
==less==
+
You can enable code syntax coloring in {{ic|less}}. First, install {{Pkg|source-highlight}}.
[[Wikipedia:less (Unix)|less]] is a terminal pager program used to view the contents of a text file one screen at a time. Whilst similar to other pages such as {{Codeline|more}} and {{Codeline|pg}}, {{Codeline|less}} offers a more advanced interface and complete feature-set.[http://www.greenwoodsoftware.com/less/faq.html]
+
Then add these lines to your {{ic|~/.bashrc}}:
 +
export LESSOPEN="| /usr/bin/source-highlight-esc.sh %s"
 +
export LESS=' -R '
  
Frequent users of the command line interface might want to install {{Package Official|lesspipe}}:
+
Frequent users of the command line interface might want to install {{Pkg|lesspipe}}:
 
  # pacman -S lesspipe
 
  # pacman -S lesspipe
  
 
Users may now list the compressed files inside of an archive using their pager:
 
Users may now list the compressed files inside of an archive using their pager:
  
{{Command
+
{{hc
|name=$ less compressed_file.tar.gz
+
|$ less compressed_file.tar.gz
|output=<nowiki>
+
|<nowiki>
 
==> use tar_file:contained_file to view a file in the archive
 
==> use tar_file:contained_file to view a file in the archive
 
-rw------- username/group  695 2008-01-04 19:24 compressed_file/content1
 
-rw------- username/group  695 2008-01-04 19:24 compressed_file/content1
Line 143: Line 47:
 
</nowiki>}}
 
</nowiki>}}
  
{{Codeline|lesspipe}} also grants {{Codeline|less}} the ability of interfacing with files other than archives; serving as an alternative for the specific command associated for that file-type (such as viewing HTML via {{Package Official|html2text}}).
+
{{ic|lesspipe}} also grants {{ic|less}} the ability of interfacing with files other than archives; serving as an alternative for the specific command associated for that file-type (such as viewing HTML via {{Pkg|html2text}}).
  
Re-login after installing {{Codeline|lesspipe}} in order to activate it, or source {{Filename|/etc/profile.d/lesspipe.sh}}.
+
Re-login after installing {{ic|lesspipe}} in order to activate it, or source {{ic|/etc/profile.d/lesspipe.sh}}.
  
 
==ls==
 
==ls==
 
[[Wikipedia:ls|ls]] is a command to list files in Unix and Unix-like operating systems.
 
[[Wikipedia:ls|ls]] is a command to list files in Unix and Unix-like operating systems.
  
Colored output can be enabled with a simple alias. File {{Filename|~/.bashrc}} should already have the following entry copied from {{Filename|/etc/skel/.bashrc}}:
+
Colored output can be enabled with a simple alias. File {{ic|~/.bashrc}} should already have the following entry copied from {{ic|/etc/skel/.bashrc}}:
 
  alias ls='ls --color=auto'
 
  alias ls='ls --color=auto'
  
The next step will further enhance the colored {{Codeline|ls}} output; for example, broken (orphan) symlinks will start showing in a red hue. Add the following to {{Filename|~/.bashrc}} and relogin, or source the file:
+
The next step will further enhance the colored {{ic|ls}} output; for example, broken (orphan) symlinks will start showing in a red hue. Add the following to {{ic|~/.bashrc}} and relogin, or source the file:
 
  eval $(dircolors -b)
 
  eval $(dircolors -b)

Revision as of 14:49, 17 January 2013

Template:Article summary start Template:Article summary text Template:Article summary heading Template:Article summary wiki Template:Article summary wiki Template:Article summary wiki Template:Article summary end

This article deals with so-called "core" utilities on a GNU/Linux system, such as less, ls, and grep. The scope of this article includes -- but is not limited to -- those utilities included with the GNU coreutils package. What follows are various tips and tricks and other helpful information related to these utilities. If sections grow too detailed, please split into separate articles.

grep

grep is a command line text search utility originally written for Unix. The grep command searches files or standard input globally for lines matching a given regular expression, and prints them to the program's standard output.

Beyond aesthetics, grep's color output is immensely useful for learning regexp and grep's functionality.

To use the default colors for grep, write the following entry to ~/.bashrc:

alias grep='grep --color=auto' 

Alternatively, you can set the GREP_OPTIONS environment variable [1] bearing in mind this may break some scripts that use grep [2]:

export GREP_OPTIONS='--color=auto'

To include file line numbers in the output, add "-n":

alias grep='grep -n --color=auto' 

The environment variable GREP_COLORS may be used to specify different colors than the defaults.

less

less is a terminal pager program used to view the contents of a text file one screen at a time. Whilst similar to other pages such as more and pg, less offers a more advanced interface and complete feature-set.[3]

You can enable code syntax coloring in less. First, install source-highlight. Then add these lines to your ~/.bashrc:

export LESSOPEN="| /usr/bin/source-highlight-esc.sh %s"
export LESS=' -R '

Frequent users of the command line interface might want to install lesspipe:

# pacman -S lesspipe

Users may now list the compressed files inside of an archive using their pager:

$ less compressed_file.tar.gz
==> use tar_file:contained_file to view a file in the archive
-rw------- username/group  695 2008-01-04 19:24 compressed_file/content1
-rw------- username/group   43 2007-11-07 11:17 compressed_file/content2
compressed_file.tar.gz (END)

lesspipe also grants less the ability of interfacing with files other than archives; serving as an alternative for the specific command associated for that file-type (such as viewing HTML via html2text).

Re-login after installing lesspipe in order to activate it, or source /etc/profile.d/lesspipe.sh.

ls

ls is a command to list files in Unix and Unix-like operating systems.

Colored output can be enabled with a simple alias. File ~/.bashrc should already have the following entry copied from /etc/skel/.bashrc:

alias ls='ls --color=auto'

The next step will further enhance the colored ls output; for example, broken (orphan) symlinks will start showing in a red hue. Add the following to ~/.bashrc and relogin, or source the file:

eval $(dircolors -b)