Command line and full screen utilities for browsing procfs, a "pseudo" file system dynamically generated by Linux to provide information about the status of entries in its process table.
Go to file
Jim Warner 96d59cbf46 library: add item origin (as comments) to header files
A lack of documentation seems to be the major obstacle
to releasing this new library. So, in an effort to get
the ball rolling again, this patch adds the origins of
each item as a comment to six of the new header files.

However, before reviewing how such changes may benefit
that documentation objective, it seemed appropriate to
first reflect on newlib's background & current status.

___________________________________________ BACKGROUND
Discussions about and work on a new library began back
in July 2012 but quickly died. After a lull of 2 years
those discussions were resumed in August 2014 but soon
died also (and no code survived the gitorious demise).

With those early discussions, the recommended approach
was to encapsulate all of the libprocps data offerings
in individual functions. When it came to extensibility
it was suggested we should rely on symbols versioning.

Unfortunately that approach would have made for a huge
Application Programming Interface virtually impossible
to master or even document. And, runtime call overhead
would have been substantial for ps and especially top.

So, an alternative design was sought but there were no
new suggestions/contributions via freelists or gitlab.
Thus, in spite of a lack of library design experience,
the procps-ng team (Craig & Jim) set out to develop an
alternative API, more concise and with lower overhead.

Reference(s):
. 07/01/2012, begin library design discussion
https://www.freelists.org/post/procps/Old-library-calls
. 08/12/2014, revival of library design discussion
https://www.freelists.org/post/procps/libprocs-redesign

_____________________________________ DESIGN EVOLUTION
Our newlib branch first appeared on June 14, 2015. And
our current API actually represents the 4th generation
during the past 3 years of evolution. First, there was
a basic 'new', 'get' and 'unref' approach, using enums
to minimize the proliferation of 'get' function calls.

Then, in anticipation of other programs like ps, where
multiple fields times multiple processes would greatly
increase the number of 'get' function calls, a concept
of 'chains' was introduced. This became generation #2.

Such 'chains' proved unnecessarily complex so 'stacks'
replaced them. This was considered the 3rd generation,
but too many implementation details were still exposed
requiring those users to 'alloc', 'read', 'fill', etc.

Finally, a 4th generation emerged representing several
refinements to standardize and minimize those exported
functions, thus hiding all implementation details from
the users. Lastly, handling of 'errno' was normalized.

Reference(s):
. 06/14/2015, revival of new API discussion
https://www.freelists.org/post/procps/The-library-API-again
. 06/24/2015, birth of the newlib branch
https://www.freelists.org/post/procps/new-library
. 06/29/2015, 2nd generation introduced 'chains'
https://www.freelists.org/post/procps/new-library,8
. 07/22/2015, 3rd generation introduced 'stacks'
https://www.freelists.org/post/procps/newlib-stacks-vs-chains
. 06/18/2016, 4th generation refinements begin
https://www.freelists.org/post/procps/newlib-generation-35
. 11/10/2017, 4th generation standardized 'errno'
https://www.freelists.org/post/procps/some-more-master-newlib-stuff

_______________________________________ CURRENT DESIGN
Central to this new design is a simple 'result' struct
reflecting an item plus its value (thanks to a union).
As a user option, these item structures can be grouped
into 'stacks', yielding many results with just 1 call.
Such a 'stack' can be seen as a variable length record
whose content/order is determined solely by the users.

Within that 'result' structure, the union has standard
C language types so there is never a doubt how a value
should be used in a printf statement. Given that linux
requires a least a 32-bit platform the only difference
in capacity surrounds 'long' integers. And, where such
types might be used, the 32-bit maximums are adequate.

The items themselves are simply enumerators defined in
the respective header files. A user can name any items
of interest then the library magically provides result
structure(s). The approach was proven to be extensible
without breaking the ABI (in commit referenced below).

The 6 major APIs each provide for the following calls:
. 'new' ---------> always required as the first call .
. 'ref' -------------------------> strictly optional .
. 'unref' --------> optional, if ill-behaved program .
. 'get' --------------------> retrieve a single item .
. 'select' ----------------> retrieve multiple items .

And the 'get' and 'select' functions provide for delta
results representing the difference between successive
get/select calls (or a 'new' then  'get/select' call).

For the <diskstats>, <pids>, <slabinfo> & <stat> APIs,
where results are unpredictable, a 'reap' function can
return multiple result structures for multiple stacks.

The <pids> API differs from others in that those items
of interest must be provided at 'new' or 'reset' time,
a function unique to this API. And the <pids> 'select'
function requires PIDs or UIDs which are to be fetched
which then operates as a subset of 'reap'. Lastly, the
'get' function is an iterator for successive PIDs/TIDs
returning items previously identified via 'new/reset'.

To provide assistance to users during development, the
special header 'proc/xtra-procps-debug.h' is available
to check type usage against library expectations. That
check is activated by including this header explicitly
or via build using: ./configure '-DXTRA_PROCPS_DEBUG'.

Reference(s):
. 08/05/2016, type validation introduced
https://www.freelists.org/post/procps/newlib-types-validation
commit e3270d463d
. 08/11/2016, extensibility while preserving ABI example
https://www.freelists.org/post/procps/new-meminfo-fields
commit 09e1886c9e

_________________________ INITIAL DOCUMENTATION EFFORT
The initial attempt, referenced below, dealt primarily
with the <pids> interface. Separate man pages for each
exported function were created. Plus there was another
document describing the items, among other miscellany.

Adopting such an approach encounters several problems:

1. In order to use these man pages, users are required
to already know how to use the library. Or alternately
one could randomly search each of them while trying to
ascertain which function call satisfies their need and
what exactly was the proper compliment/order required.

2. While we can explain what all of those <pids> items
represent, that certainly isn't true for all the APIs.
See the gaps in kernel documentation for <meminfo> and
complete lack of documentation with that <vmstat> API.

3. Our documentation effort should take pains to avoid
unnecessary implementation details. Here's an example:
. "The pointer to info will have memory"
. "allocated and a structure created."

Alternatively, the following conveys user requirements
while not offering any internal implementation detail:
. "You must provide the address of a NULL"
. "info structure pointer."

Reference(s):
. 01/04/2017, initial documentation offering
https://www.freelists.org/post/procps/Using-reap-and-get
commit 2598e9f2ce

___________________ RECOMMENDED DOCUMENTATION APPROACH
I recommend that the newlib documentation consist of 3
man pages only. The first would cover the 5 major APIs
and their common functions. The second would deal with
the <pids> API exclusively, explaining how it differs.
Any remaining exported libproc functions which are yet
to be included could be represented in a 3rd document.

For these new documents the following are are assumed:

1. Since we will not be able to document all items, we
shouldn't try to document any items. We should instead
rely on proc(5) or Documentation/filesystems/proc.txt.

2. Program development often involves referencing some
header file(s). So, make that an absolute requirement.

3. With the addition of item origins, represented with
this commit, and considering that 'types' were already
present, the header file might be all some users need.

4. And who knows, when a user of our libproc complains
about gaps in their documentation, it might prompt the
kernel folks to correct those long standing omissions.

To summarize, I suggest that we replace that libproc.3
document with a more general one explaining the basics
of accessing this new library and the common calls for
most of the major interfaces. We can then create a new
document (libproc-pids.3?), which explains differences
in using the <PIDS> application programming interface.
A final document (libproc-misc.3?) covers what's left.

Signed-off-by: Jim Warner <james.warner@comcast.net>
2019-01-03 08:06:48 +11:00
contrib miscellaneous: clean up trailing whitespace once again 2013-04-07 18:05:01 +10:00
doc documentation: Update pids manual pages 2017-01-05 09:44:04 +11:00
Documentation miscellaneous: remove some trailing whitespace buildup 2015-06-20 07:46:23 +10:00
include Build fails if not done from the source root directory (#105) 2018-08-08 20:03:16 +10:00
lib 0041-proc/sig.c: Harden print_given_signals(). 2018-06-09 21:35:19 +10:00
man-po misc: Tell po4a to handle email macros 2018-06-23 21:59:14 +10:00
misc build-sys: rename the 'tools' subdirectory to 'misc' 2012-03-02 21:25:38 +11:00
po update translations _______________________ (catch up) 2018-05-06 07:19:38 +10:00
proc library: add item origin (as comments) to header files 2019-01-03 08:06:48 +11:00
ps docs: Update ps.1 to warn about command name length 2018-08-13 20:53:56 +10:00
testsuite misc: fix ps etime tests 2018-05-03 21:13:16 +10:00
top top: harden management of 'Hide_pid' array allocations 2019-01-03 08:06:48 +11:00
.gitignore misc: Update translations _________________ (catch up) 2018-05-06 07:19:38 +10:00
.gitlab-ci.yml test: Update gitlab CI YAML to use shared runner 2016-04-20 22:20:55 +10:00
AUTHORS Changed git site to gitlab 2015-05-10 14:57:50 +10:00
autogen.sh Fix a remaining util-linux word in autogen 2012-02-26 08:39:16 +11:00
ChangeLog Changed git site to gitlab 2015-05-10 14:57:50 +10:00
configure.ac Port of merge request 49 to newlib 2017-08-19 23:05:22 +10:00
COPYING license: update FSF addresses 2012-03-04 08:04:24 +11:00
COPYING.LIB miscellaneous: clean up trailing whitespace once again 2013-04-07 18:05:01 +10:00
create-man-pot.sh misc: Update translations _________________ (catch up) 2018-05-06 07:19:38 +10:00
free.1 watch,free: interpet intervals in non-locale way 2016-07-03 16:20:48 +10:00
free.c free: fix scaling on 32-bit systems _______ (catch up) 2018-05-06 07:19:38 +10:00
INSTALL.md docs: Updated documentation 2015-05-10 17:23:54 +10:00
kill.1 docs: fix manual page warnings 2012-04-16 12:55:53 +02:00
kill.c 0022-skill: Simplify the kill_main() loop. 2018-06-23 21:59:14 +10:00
Makefile.am 3.3.13 release candidate 1 ________________ (catch up) 2018-05-06 07:19:38 +10:00
NEWS misc: Move NEWS item to correct version 2018-05-06 09:55:56 +10:00
pgrep.1 docs: Update pgrep.1 example to more modern browser 2017-12-22 15:10:54 +11:00
pgrep.c 0007-pgrep: Always null-terminate the cmd*[] buffers. 2018-06-23 21:59:14 +10:00
pidof.1 docs: Note limitation of pidof find scripts (catch up) 2018-05-06 07:19:38 +10:00
pidof.c 0020-pidof: Prevent integer overflows with grow_size(). 2018-06-23 21:59:14 +10:00
pkill.1 procps 010114 2002-02-01 22:47:29 +00:00
pmap.1 pmap: Including -p in the man page 2013-11-26 13:45:22 +01:00
pmap.c 0095-pmap: Fix extended mode in one_proc(). 2018-06-23 21:59:14 +10:00
pwdx.1 docs: fix manual page warnings 2012-04-16 12:55:53 +02:00
pwdx.c 0021-pwdx: Fix a misleading comment. 2018-06-23 21:59:14 +10:00
README.md misc: eliminate accumulated trailing whitespace, again 2016-03-12 14:53:53 +11:00
skill.1 skill: support namespaces 2013-04-18 13:59:44 -04:00
skill.c 0027-skill: Prevent multiple overflows in ENLIST(). 2018-06-23 21:59:14 +10:00
slabtop.1 procps: Add a zero-width break point in slabtop.1 2015-06-01 22:04:40 +10:00
slabtop.c misc: eliminate all those remaining gcc -Wall warnings 2017-05-22 21:38:10 +10:00
snice.1 procps 010114 2002-02-01 22:47:29 +00:00
sysctl.8 docs: sysctl.8 clarify when w flag is required 2018-02-19 21:07:21 +11:00
sysctl.c sysctl: fix typo in help __________________ (catch up) 2018-05-06 07:19:38 +10:00
sysctl.conf misc: Add some link examples to sysctl.conf (catch up) 2018-05-06 07:19:38 +10:00
sysctl.conf.5 misc: remove some newly introduced trailing whitespace 2016-09-26 07:40:45 +10:00
tload.1 docs: fix manual page warnings 2012-04-16 12:55:53 +02:00
tload.c 0015-tload: Prevent integer overflows of ncols, nrows, and scr_size. 2018-06-23 21:59:14 +10:00
translate-man.sh Fixed translate-man.sh for no top ps 2014-05-28 20:12:33 +10:00
uptime.1 docs: Fix typos in slabtop.1, sysctl.8 and uptime.1 2014-09-16 19:35:28 +02:00
uptime.c 0009-uptime: Check the return value of various functions. 2018-06-23 21:59:14 +10:00
vmstat.8 library: reverting tmpfs subtraction from cached (18-FEB-2014) 2014-04-30 13:59:34 +02:00
vmstat.c 0125-vmstat: Prevent out-of-bounds writes in new_header() and diskheader(). 2018-06-23 21:59:14 +10:00
w.1 w: correct program help & man page regarding arguments 2015-09-07 18:11:48 +10:00
w.c 0121-w: Clamp maxcmd to the MIN/MAX_CMD_WIDTH range. 2018-06-23 21:59:14 +10:00
watch.1 docs: Reword --exec option in watch.1 _____ (catch up) 2018-05-06 07:19:38 +10:00
watch.c watch: use sysconf() for hostname length __ (catch up) 2018-05-06 07:19:38 +10:00

build status procps

procps is a set of command line and full-screen utilities that provide information out of the pseudo-filesystem most commonly located at /proc. This filesystem provides a simple interface to the kernel data structures. The programs of procps generally concentrate on the structures that describe the processess running on the system.

The following programs are found in procps:

  • free - Report the amount of free and used memory in the system
  • kill - Send a signal to a process based on PID
  • pgrep - List processes based on name or other attributes
  • pkill - Send a signal to a process based on name or other attributes
  • pmap - Report memory map of a process
  • ps - Report information of processes
  • pwdx - Report current directory of a process
  • skill - Obsolete version of pgrep/pkill
  • slabtop - Display kernel slab cache information in real time
  • snice - Renice a process
  • sysctl - Read or Write kernel parameters at run-time
  • tload - Graphical representation of system load average
  • top - Dynamic real-time view of running processes
  • uptime - Display how long the system has been running
  • vmstat - Report virtual memory statistics
  • w - Report logged in users and what they are doing
  • watch - Execute a program periodically, showing output fullscreen

Reporting Bugs

There are a few ways of reporting bugs or feature requests:

  1. Your distributions bug reporter. If you are using a distribution your first port of call is their bug tracker. This is because each distribution has their own patches and way of dealing with bugs. Also bug reporting often does not need any subscription to websites.
  2. GitLab Issues - To the left of this page is the issue tracker. You can report bugs here.
  3. Email list - We have an email list (see below) where you can report bugs. The problem with this method is bug reports often get lost and cannot be tracked. This is especially a big problem when its something that will take time to resolve.

If you need to report bugs, there is more details on the Bug Reporting page.

Email List

The email list for the developers and users of procps is found at http://www.freelists.org/archive/procps/ This email list discusses the development of procps and is used by distributions to also forward or discuss bugs.