.\" .\" Sun Microsystems, Inc. gratefully acknowledges The Open Group for .\" permission to reproduce portions of its copyrighted documentation. .\" Original documentation from The Open Group can be obtained online at .\" http://www.opengroup.org/bookstore/. .\" .\" The Institute of Electrical and Electronics Engineers and The Open .\" Group, have given us permission to reprint portions of their .\" documentation. .\" .\" In the following statement, the phrase ``this text'' refers to portions .\" of the system documentation. .\" .\" Portions of this text are reprinted and reproduced in electronic form .\" in the SunOS Reference Manual, from IEEE Std 1003.1, 2004 Edition, .\" Standard for Information Technology -- Portable Operating System .\" Interface (POSIX), The Open Group Base Specifications Issue 6, .\" Copyright (C) 2001-2004 by the Institute of Electrical and Electronics .\" Engineers, Inc and The Open Group. In the event of any discrepancy .\" between these versions and the original IEEE and The Open Group .\" Standard, the original IEEE and The Open Group Standard is the referee .\" document. The original Standard can be obtained online at .\" http://www.opengroup.org/unix/online.html. .\" .\" This notice shall appear on any product containing this material. .\" .\" The contents of this file are subject to the terms of the .\" Common Development and Distribution License (the "License"). .\" You may not use this file except in compliance with the License. .\" .\" You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE .\" or http://www.opensolaris.org/os/licensing. .\" See the License for the specific language governing permissions .\" and limitations under the License. .\" .\" When distributing Covered Code, include this CDDL HEADER in each .\" file and include the License file at usr/src/OPENSOLARIS.LICENSE. .\" If applicable, add the following below this CDDL HEADER, with the .\" fields enclosed by brackets "[]" replaced with your own identifying .\" information: Portions Copyright [yyyy] [name of copyright owner] .\" .\" .\" Copyright 1989 AT&T .\" Portions Copyright (c) 1992, X/Open Company Limited All Rights Reserved .\" Portions Copyright (c) 1982-2007 AT&T Knowledge Ventures .\" Copyright (c) 2008, Sun Microsystems, Inc. All Rights Reserved .\" .TH UNIQ 1 "Mar 13, 2008" .SH NAME uniq \- report or filter out repeated lines in a file .SH SYNOPSIS .SS "/usr/bin/uniq" .LP .nf \fB/usr/bin/uniq\fR [\fB-c\fR | \fB-d\fR | \fB-u\fR] [\fB-f\fR \fIfields\fR] [\fB-s\fR \fIchar\fR] [\fIinput_file\fR [\fIoutput_file\fR]] .fi .LP .nf \fB/usr/bin/uniq\fR [\fB-c\fR | \fB-d\fR | \fB-u\fR] [\fB-n\fR] [+ \fIm\fR] [\fIinput_file\fR [\fIoutput_file\fR]] .fi .SS "ksh93" .LP .nf \fBuniq\fR [\fB-cdiu\fR] [\fB-D\fR[\fIdelimit\fR]] [\fB-f\fR \fIfields\fR] [\fB-s\fR \fIchars\fR] [\fB-w\fR \fIchars\fR] [\fIinput_file\fR [\fIoutput_file\fR]] .fi .LP .nf \fBuniq\fR [\fB-cdiu\fR] [\fB-D\fR[\fIdelimit\fR]] [\fB-n\fR] [\fB+m\fR] [\fB-w\fR \fIchars\fR] [\fIinput_file\fR [\fIoutput_file\fR]] .fi .SH DESCRIPTION .SS "/usr/bin/uniq" .sp .LP The \fBuniq\fR utility reads an input file comparing adjacent lines and writes one copy of each input line on the output. The second and succeeding copies of repeated adjacent input lines are not written. .sp .LP Repeated lines in the input are not detected if they are not adjacent. .SS "ksh93" .sp .LP The \fBuniq\fR built-in in \fBksh93\fR is associated with the \fB/bin\fR or \fB/usr/bin path\fR. It is invoked when \fBuniq\fR is executed without a pathname prefix and the pathname search finds a \fB/bin/uniq\fR or \fB/usr/bin/uniq\fR executable. .sp .LP \fBuniq\fR reads an input, comparing adjacent lines, and writing one copy of each input line on the output. The second and succeeding copies of the repeated adjacent lines are not written. .sp .LP If \fIoutput_file\fR is not specified, \fBuniq\fR writes to standard output. If \fIinput_file\fR is not specified, or if \fIinput_file\fR is \fB-\fR, \fBuniq\fR reads from standard input, and the start of the file is defined as the current offset. .SH OPTIONS .SS "/usr/bin/uniq" .sp .LP The following options are supported by \fB/usr/bin/uniq\fR: .sp .ne 2 .na \fB\fB-c\fR\fR .ad .RS 13n Precedes each output line with a count of the number of times the line occurred in the input. .RE .sp .ne 2 .na \fB\fB-d\fR\fR .ad .RS 13n Suppresses the writing of lines that are not repeated in the input. .RE .sp .ne 2 .na \fB\fB-f\fR \fIfields\fR\fR .ad .RS 13n Ignores the first \fIfields\fR fields on each input line when doing comparisons, where \fIfields\fR is a positive decimal integer. A field is the maximal string matched by the basic regular expression: .sp .in +2 .nf [[:blank:]]*[^[:blank:]]* .fi .in -2 .sp If \fIfields\fR specifies more fields than appear on an input line, a null string is used for comparison. .RE .sp .ne 2 .na \fB\fB+\fR\fIm\fR\fR .ad .RS 13n Equivalent to \fB-s\fR \fIchars\fR with \fIchars\fR set to \fIm\fR. .RE .sp .ne 2 .na \fB\fB\(mi\fR\fIn\fR\fR .ad .RS 13n Equivalent to \fB-f\fR \fIfields\fR with \fIfields\fR set to \fIn\fR. .RE .sp .ne 2 .na \fB\fB-s\fR \fIchars\fR\fR .ad .RS 13n Ignores the first \fIchars\fR characters when doing comparisons, where \fIchars\fR is a positive decimal integer. If specified in conjunction with the \fB-f\fR option, the first \fIchars\fR characters after the first \fIfields\fR fields is ignored. If \fIchars\fR specifies more characters than remain on an input line, a null string is used for comparison. .RE .sp .ne 2 .na \fB\fB-u\fR\fR .ad .RS 13n Suppresses the writing of lines that are repeated in the input. .RE .SS "ksh93" .sp .LP The following options are supported by the \fBuniq\fR built-in command is \fBksh93\fR: .sp .ne 2 .na \fB\fB-c\fR\fR .ad .br .na \fB\fB--count\fR\fR .ad .RS 28n Outputs the number of times each line occurred along with the line. .RE .sp .ne 2 .na \fB\fB-d\fR\fR .ad .br .na \fB\fB--repeated | duplicates\fR\fR .ad .RS 28n Outputs only duplicate lines. .RE .sp .ne 2 .na \fB\fB-D\fR\fR .ad .br .na \fB\fB--all-repeated\fR[\fB=\fR\fIdelimit\fR]\fR .ad .RS 28n Outputs all duplicate lines as a group with an empty line delimiter specified by \fIdelimit\fR. .sp Specify \fIdelimit\fR as one of the following: .sp .ne 2 .na \fB\fBnone\fR\fR .ad .RS 12n Do not delimit duplicate groups. .RE .sp .ne 2 .na \fB\fBprepend\fR\fR .ad .RS 12n Prepend an empty line before each group. .RE .sp .ne 2 .na \fB\fBseparate\fR\fR .ad .RS 12n Separate each group with an empty line. .RE The value for \fIdelimit\fR can be omitted. The default value is \fBnone\fR. .RE .sp .ne 2 .na \fB\fB-f\fR\fR .ad .br .na \fB\fB--skip-fields=\fR\fIfields\fR\fR .ad .RS 28n Skips over \fIfields\fR number of fields before checking for uniqueness. A field is the minimal string matching the \fBBRE [[:\fR\fIblank\fR\fB:]]*[^[:\fR\fIblank\fR\fB:]]*\fR. .RE .sp .ne 2 .na \fB\fB-i\fR\fR .ad .br .na \fB\fB--ignore-case\fR\fR .ad .RS 28n Ignore case in comparisons. .RE .sp .ne 2 .na \fB\fB+\fR\fIm\fR\fR .ad .RS 28n Equivalent to the \fB-s\fR \fIchars\fR option, with \fIchars\fR set to \fIm\fR. .RE .sp .ne 2 .na \fB\fB-\fR\fIn\fR\fR .ad .RS 28n Equivalent to the \fB-f\fR \fIfields\fR option, with \fIfields\fR set to \fIn\fR. .RE .sp .ne 2 .na \fB\fB-s\fR\fR .ad .br .na \fB\fB--skip-chars=\fR\fIchars\fR\fR .ad .RS 28n Skips over \fIchars\fR number of characters before checking for uniqueness. .sp If specified with the \fB-f\fR option, the first \fIchars\fR after the first fields are ignored. If the \fIchars\fR specifies more characters than are on the line, an empty string is used for comparison. .RE .sp .ne 2 .na \fB\fB-u\fR\fR .ad .br .na \fB\fB--uniq\fR\fR .ad .RS 28n Outputs unique lines. .RE .sp .ne 2 .na \fB\fB-w\fR\fR .ad .br .na \fB\fB--check-chars=\fR\fIchars\fR\fR .ad .RS 28n Skips over any specified fields and characters, then compares \fIchars\fR number of characters. .RE .SH OPERANDS .sp .LP The following operands are supported: .sp .ne 2 .na \fB\fIinput_file\fR\fR .ad .RS 15n A path name of the input file. If \fIinput_file\fR is not specified, or if the \fIinput_file\fR is \fB\(mi\fR, the standard input is used. .RE .sp .ne 2 .na \fB\fIoutput_file\fR\fR .ad .RS 15n A path name of the output file. If \fIoutput_file\fR is not specified, the standard output is used. The results are unspecified if the file named by \fIoutput_file\fR is the file named by \fIinput_file\fR. .RE .SH EXAMPLES .LP \fBExample 1 \fRUsing the \fBuniq\fR Command .sp .LP The following example lists the contents of the \fBuniq.test\fR file and outputs a copy of the repeated lines. .sp .in +2 .nf example% \fBcat uniq.test\fR This is a test. This is a test. TEST. Computer. TEST. TEST. Software. example% \fBuniq -d uniq.test\fR This is a test. TEST. example% .fi .in -2 .sp .sp .LP The next example outputs just those lines that are not repeated in the \fBuniq.test\fR file. .sp .in +2 .nf example% \fBuniq -u uniq.test\fR TEST. Computer. Software. example% .fi .in -2 .sp .sp .LP The last example outputs a report with each line preceded by a count of the number of times each line occurred in the file: .sp .in +2 .nf example% \fBuniq -c uniq.test\fR 2 This is a test. 1 TEST. 1 Computer. 2 TEST. 1 Software. example% .fi .in -2 .sp .SH ENVIRONMENT VARIABLES .sp .LP See \fBenviron\fR(5) for descriptions of the following environment variables that affect the execution of \fBuniq\fR: \fBLANG\fR, \fBLC_ALL\fR, \fBLC_CTYPE\fR, \fBLC_MESSAGES\fR, and \fBNLSPATH\fR. .SH EXIT STATUS .sp .LP The following exit values are returned: .sp .ne 2 .na \fB\fB0\fR\fR .ad .RS 6n Successful completion. .RE .sp .ne 2 .na \fB\fB>0\fR\fR .ad .RS 6n An error occurred. .RE .SH ATTRIBUTES .sp .LP See \fBattributes\fR(5) for descriptions of the following attributes: .SS "/usr/bin/uniq" .sp .sp .TS box; c | c l | l . ATTRIBUTE TYPE ATTRIBUTE VALUE _ CSI Enabled _ Interface Stability Committed _ Standard See \fBstandards\fR(5). .TE .SS "ksh93" .sp .sp .TS box; c | c l | l . ATTRIBUTE TYPE ATTRIBUTE VALUE _ Interface Stability See below. .TE .sp .LP The \fBksh93\fR built-in binding to \fB/bin\fR and \fB/usr/bin\fR is Volatile. The built-in interfaces are Uncommitted. .SH SEE ALSO .sp .LP \fBcomm\fR(1), \fBksh93\fR(1), , \fBpcat\fR(1), \fBsort\fR(1), \fBuncompress\fR(1), \fBattributes\fR(5), \fBenviron\fR(5), \fBstandards\fR(5)