help for concatenate 2 files

Discussion:

MOKRANI Rachid

2013-03-27 14:55:04 UTC

Hi,

I don't know how to concatenate two files with row.

The first file is :

cat /tmp/file1

bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A

The second file is :

cat /tmp/file2

bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME

I don't know how to obtain the following result .

bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; ; ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; ; ;

OR the following

bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; TEST ; TEST ;

Any help will be really appreciate.
Best regards.
__________________________
Avant d'imprimer, pensez Ã l'environnement ! Please consider the environment before printing !
Ce message et toutes ses piÃšces jointes sont confidentiels et Ã©tablis Ã l'intention exclusive de ses destinataires. Toute utilisation non conforme Ã sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse. IFP Energies nouvelles dÃ©cline toute responsabilitÃ© au titre de ce message. This message and any attachments are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. IFP Energies nouvelles should not be liable for this message.
__________________________

Tim Chase

2013-03-27 15:54:23 UTC

Permalink

Post by MOKRANI Rachid
I don't know how to concatenate two files with row.
cat /tmp/file1
bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A
cat /tmp/file2
bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME

I'm not sure that's the sort of thing that can be done with sed, but
you can use "join" to get pretty close:

join --nocheck-order -a 1 --header file1 file2

You might also want to add

-t' '

to tweak how it treats the spaces.

-tim

MOKRANI Rachid

2013-03-27 15:02:34 UTC

Permalink

Werfgam Nadler

2013-04-17 06:05:10 UTC

Permalink

Hi,

try this solution.

cat file1 file2 | sed '

$!{
N;
s/^/\n/;
D
}

/^$[^\n; ]*$ .*\n\1 /!{
s/\n/; TEST ; TEST ;&/
/\n/!s/$/; TEST ; TEST ;/
}

/^$[^\n; ]*$$ *$;$[^\n][^\n]*$$.*$\n\1 *$[^\n][^\n]*$/{
s//\1\2;\3\5\4/;
}
P;
D;
'

I got the below result

bug_id ; creation_ts ; bug_severity; bug_when ; added
8 ; 2013-03-21 ; N/A; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 ; Mineur; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 ; Mineur; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 ; N/A; 2013-03-25 17:09:09 ; CONFIRME
13 ; 2013-03-25 ; N/A; TEST ; TEST ;

thanks
WN

________________________________
From: MOKRANI Rachid <***@ifpen.fr>
To: sed-***@yahoogroups.com
Sent: Wednesday, March 27, 2013 8:32 PM
Subject: help for concatenate 2 files

Hi,

I don't know how to concatenate two files with row.

The first file is :

cat /tmp/file1

bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A

The second file is :

cat /tmp/file2

bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME

I don't know how to obtain the following result .

bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; ; ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; ; ;

OR the following

bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; TEST ; TEST ;

Any help will be really appreciate.
Best regards.

------------------------------------

--
Yahoo! Groups Links

[Non-text portions of this message have been removed]

Thierry Blanc

2013-04-17 16:41:44 UTC

Permalink

cat file1 file2 |sort -nr | sed -nrf sed.script |tac

sed.script:
$!N;
/^([0-9]*)\s*;.*\n\1/{
s|\n[0-9]*||;
p;
d;
b;
}
P;
D;
-------end-of-script

could you comment on your script below. Am I right that it reads all the
lines into the pattern space?

Post by Werfgam Nadler
Hi,
try this solution.
cat file1 file2 | sed '
$!{
N;
s/^/\n/;
D
}
/^$[^\n; ]*$ .*\n\1 /!{
s/\n/; TEST ; TEST ;&/
/\n/!s/$/; TEST ; TEST ;/
}
/^$[^\n; ]*$$ *$;$[^\n][^\n]*$$.*$\n\1 *$[^\n][^\n]*$/{
s//\1\2;\3\5\4/;
}
P;
D;
'
I got the below result
bug_id ; creation_ts ; bug_severity; bug_when ; added
8 ; 2013-03-21 ; N/A; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 ; Mineur; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 ; Mineur; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 ; N/A; 2013-03-25 17:09:09 ; CONFIRME
13 ; 2013-03-25 ; N/A; TEST ; TEST ;
thanks
WN
________________________________
Sent: Wednesday, March 27, 2013 8:32 PM
Subject: help for concatenate 2 files
Hi,
I don't know how to concatenate two files with row.
cat /tmp/file1
bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A
cat /tmp/file2
bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME
I don't know how to obtain the following result .
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; ; ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; ; ;
OR the following
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; TEST ; TEST ;
Any help will be really appreciate.
Best regards.
------------------------------------

Thierry Blanc

2013-04-17 16:57:44 UTC

Permalink

Werfgam Nadler

2013-04-18 07:14:42 UTC

Permalink

I guess i was just trying to solve the problem entirely with sed and not to use several other commands.
my comments for my code are below.

W

________________________________
From: Thierry Blanc <***@gmx.ch>
To: Werfgam Nadler <***@yahoo.com>
Cc: MOKRANI Rachid <***@ifpen.fr>; "sed-***@yahoogroups.com" <sed-***@yahoogroups.com>
Sent: Wednesday, April 17, 2013 10:27 PM
Subject: Re: help for concatenate 2 files

other solution:

sed -r 's|([^;]*)\s*;.*|\1;TEST;TEST|' file1 |cat file2 - |sort -n
|uniq -w 5 | cut -c 5- | paste file1 -

file1: file that has ALL entries
file2: file that has just the additional entries (i.e. not line 8 and 13)

Post by Werfgam Nadler
Hi,
try this solution.
cat file1 file2 | sed '

# Read all the content of both the files.

Post by Werfgam Nadler
$!{
N;
s/^/\n/;
D
}

# If two lines without same bug_id exist then....

Post by Werfgam Nadler
/^$[^\n; ]*$ .*\n\1 /!{
s/\n/; TEST ; TEST ;&/
/\n/!s/$/; TEST ; TEST ;/
}

#if two lines with same bug id (assuming it is just not a number). exists. then...

Post by Werfgam Nadler
/^$[^\n; ]*$$ *$;$[^\n][^\n]*$$.*$\n\1 *$[^\n][^\n]*$/{
s//\1\2;\3\5\4/;
}
P;
D;
'
I got the below result
bug_id ; creation_ts ; bug_severity; bug_when ; added
8 ; 2013-03-21 ; N/A; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 ; Mineur; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 ; Mineur; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 ; N/A; 2013-03-25 17:09:09 ; CONFIRME
13 ; 2013-03-25 ; N/A; TEST ; TEST ;
thanks
WN
________________________________
Sent: Wednesday, March 27, 2013 8:32 PM
Subject: help for concatenate 2 files

Hi,
I don't know how to concatenate two files with row.
cat /tmp/file1
bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A
cat /tmp/file2
bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME
I don't know how to obtain the following result .
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; ; ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; ; ;
OR the following
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; TEST ; TEST ;
Any help will be really appreciate.
Best regards.
------------------------------------

------------------------------------

--
Yahoo! Groups Links

[Non-text portions of this message have been removed]

MOKRANI Rachid

2013-03-27 15:40:19 UTC

Permalink

Daniel

2013-03-29 02:37:37 UTC

Permalink

Of course, it doesn't help to repeat post :)

Are those tab characters around the semicolons?
Or are they spaces?

Would you consider getting rid of the white space around
the semicolons? Your file would be easier to deal with in
the following delimited format. The combination of the ;
delimiter with the surrounding space makes it more
difficult to process.

8;2013-03-21;N/A
9;2013-03-21;Mineur
10;2013-03-21;Mineur
11;2013-03-21;Mineur
12;2013-03-25;N/A
13;2013-03-25;N/A

Daniel

Jude DaShiell

2013-03-27 23:00:16 UTC

Permalink

Post by MOKRANI Rachid
Hi,
I don't know how to concatenate two files with row.
cat /tmp/file1
bug_id ; creation_ts ; bug_severity
8 ; 2013-03-21 ; N/A
9 ; 2013-03-21 ; Mineur
10 ; 2013-03-21 ; Mineur
11 ; 2013-03-21 ; Mineur
12 ; 2013-03-25 ; N/A
13 ; 2013-03-25 ; N/A
cat /tmp/file2
bug_id ; bug_when ; added
9 ; 2013-03-21 15:49:44 ; CONFIRME
10 ; 2013-03-21 15:04:56 ; CONFIRME
11 ; 2013-03-21 15:56:59 ; CONFIRME
12 ; 2013-03-25 17:09:09 ; CONFIRME
I don't know how to obtain the following result .
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; ; ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; ; ;
OR the following
bug_id ; creation_ts ; bug_severity ; bug_when ; added ;
8 ; 2013-03-21 ; N/A ; TEST ; TEST ;
9 ; 2013-03-21 ; Mineur ; 2013-03-21 15:49:44 ; CONFIRME ;
10 ; 2013-03-21 ; Mineur ; 2013-03-21 15:04:56 ; CONFIRME ;
11 ; 2013-03-21 ; Mineur ; 2013-03-21 15:56:59 ; CONFIRME ;
12 ; 2013-03-25 ; N/A ; 2013-03-25 17:09:09 ; CONFIRME ;
13 ; 2013-03-25 ; N/A ; TEST ; TEST ;
Any help will be really appreciate.
Best regards.
__________________________
Avant d'imprimer, pensez ? l'environnement ! Please consider the environment before printing !
Ce message et toutes ses pi?ces jointes sont confidentiels et ?tablis ? l'intention exclusive de ses destinataires. Toute utilisation non conforme ? sa destination, toute diffusion ou toute publication, totale ou partielle, est interdite, sauf autorisation expresse. IFP Energies nouvelles d?cline toute responsabilit? au titre de ce message. This message and any attachments are confidential and intended solely for the addressees. Any unauthorised use or dissemination is prohibited. IFP Energies nouvelles should not be liable for this message.
__________________________
------------------------------------
--
Yahoo! Groups Links

---------------------------------------------------------------------------
jude <***@shellworld.net>
Microsoft, windows is accessible. why do blind people need screen readers?