xref: /openbsd/usr.bin/uniq/uniq.1 (revision a6445c1d)
1.\"	$OpenBSD: uniq.1,v 1.17 2010/09/03 11:09:29 jmc Exp $
2.\"	$NetBSD: uniq.1,v 1.5 1994/12/06 07:51:15 jtc Exp $
3.\"
4.\" Copyright (c) 1991, 1993
5.\"	The Regents of the University of California.  All rights reserved.
6.\"
7.\" This code is derived from software contributed to Berkeley by
8.\" the Institute of Electrical and Electronics Engineers, Inc.
9.\"
10.\" Redistribution and use in source and binary forms, with or without
11.\" modification, are permitted provided that the following conditions
12.\" are met:
13.\" 1. Redistributions of source code must retain the above copyright
14.\"    notice, this list of conditions and the following disclaimer.
15.\" 2. Redistributions in binary form must reproduce the above copyright
16.\"    notice, this list of conditions and the following disclaimer in the
17.\"    documentation and/or other materials provided with the distribution.
18.\" 3. Neither the name of the University nor the names of its contributors
19.\"    may be used to endorse or promote products derived from this software
20.\"    without specific prior written permission.
21.\"
22.\" THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS ``AS IS'' AND
23.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
24.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
25.\" ARE DISCLAIMED.  IN NO EVENT SHALL THE REGENTS OR CONTRIBUTORS BE LIABLE
26.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
27.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
28.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
29.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
30.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
31.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
32.\" SUCH DAMAGE.
33.\"
34.\"     @(#)uniq.1	8.1 (Berkeley) 6/6/93
35.\"
36.Dd $Mdocdate: September 3 2010 $
37.Dt UNIQ 1
38.Os
39.Sh NAME
40.Nm uniq
41.Nd report or filter out repeated lines in a file
42.Sh SYNOPSIS
43.Nm uniq
44.Op Fl c
45.Op Fl d | u
46.Op Fl f Ar fields
47.Op Fl s Ar chars
48.Oo
49.Ar input_file
50.Op Ar output_file
51.Oc
52.Sh DESCRIPTION
53The
54.Nm
55utility reads the standard input comparing adjacent lines and writes
56a copy of each unique input line to the standard output.
57The second and succeeding copies of identical adjacent input lines are
58not written.
59Repeated lines in the input will not be detected if they are not adjacent,
60so it may be necessary to sort the files first.
61.Pp
62The options are as follows:
63.Bl -tag -width Ds
64.It Fl c
65Precede each output line with the count of the number of times the line
66occurred in the input, followed by a single space.
67.It Fl d
68Only output lines which have duplicates.
69.It Fl f Ar fields
70Ignore the first
71.Ar fields
72in each input line when doing comparisons.
73A field is a string of non-blank characters separated from adjacent fields
74by blanks, with blanks considered part of the following field.
75Field numbers are one based, i.e., the first field is field one.
76.It Fl s Ar chars
77Ignore the first
78.Ar chars
79characters in each input line when doing comparisons.
80If specified in conjunction with the
81.Fl f
82option, the first
83.Ar chars
84characters after the first
85.Ar fields
86fields will be ignored.
87Character numbers are one based, i.e., the first character is character one.
88.It Fl u
89Only output lines which are unique.
90.\".It Fl Ns Ar n
91.\"(Deprecated; replaced by
92.\".Fl f ) .
93.\"Ignore the first n
94.\"fields on each input line when doing comparisons,
95.\"where n is a number.
96.\"A field is a string of non-blank
97.\"characters separated from adjacent fields
98.\"by blanks.
99.\".It Cm \&\(pl Ns Ar n
100.\"(Deprecated; replaced by
101.\".Fl s ) .
102.\"Ignore the first
103.\".Ar m
104.\"characters when doing comparisons, where
105.\".Ar m
106.\"is a
107.\"number.
108.El
109.Pp
110If additional arguments are specified on the command line, the first
111such argument is used as the name of an input file, the second is used
112as the name of an output file.
113A file name of
114.Ql -
115denotes the standard input or the standard output
116.Pq depending on its position on the command line .
117.Sh EXIT STATUS
118.Ex -std uniq
119.Sh SEE ALSO
120.Xr sort 1
121.Sh STANDARDS
122The
123.Nm
124utility is compliant with the
125.St -p1003.1-2008
126specification.
127.Pp
128The use of
129.Fl c
130in conjunction with
131.Fl d
132or
133.Fl u
134is an extension to that specification.
135.Pp
136The historic
137.Cm + Ns Ar number
138and
139.Fl Ns Ar number
140options have been deprecated but are still supported in this implementation.
141