From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 19 09:16:37 2010 Received: (at submit) by debbugs.gnu.org; 19 Jul 2010 13:16:38 +0000 Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1OaqCy-0008HK-GN for submit@debbugs.gnu.org; Mon, 19 Jul 2010 09:16:37 -0400 Received: from mx10.gnu.org ([199.232.76.166]) by debbugs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1OamHb-0005pd-TT for submit@debbugs.gnu.org; Mon, 19 Jul 2010 05:05:09 -0400 Received: from lists.gnu.org ([199.232.76.165]:41441) by monty-python.gnu.org with esmtps (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.60) (envelope-from ) id 1OamHw-00016N-Kp for submit@debbugs.gnu.org; Mon, 19 Jul 2010 05:05:28 -0400 Received: from [140.186.70.92] (port=36897 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1OamHr-0006f7-P8 for bug-coreutils@gnu.org; Mon, 19 Jul 2010 05:05:28 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM, T_DKIM_INVALID, T_TO_NO_BRKTS_FREEMAIL autolearn=unavailable version=3.3.1 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1OamHq-0001Ky-Ct for bug-coreutils@gnu.org; Mon, 19 Jul 2010 05:05:23 -0400 Received: from mail-fx0-f41.google.com ([209.85.161.41]:65114) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1OamHq-0001Kf-8S for bug-coreutils@gnu.org; Mon, 19 Jul 2010 05:05:22 -0400 Received: by fxm20 with SMTP id 20so2232006fxm.0 for ; Mon, 19 Jul 2010 02:05:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:content-type :date:message-id:mime-version:x-mailer:content-transfer-encoding; bh=1rV9kNhcNJpK2mfWgGctOi+okd+DvCzK7+7UOokI0Rc=; b=SNjoFVLqpWxSsPUvztTLl2yXCkOaUbrPjt6nIfif5K57VkbHe37Z7VvzYLvRAjwRZN +HwVSyYgmWdLCiu+xdAaA5GrmarpgLWDuZVWLYRmBtODkP1Ov4EO9KoXMKT5ir2nbE3y 24SjzfAVMDjc4vWQ2wn6yGJaLK+5+z4rIJIwA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:content-type:date:message-id:mime-version:x-mailer :content-transfer-encoding; b=JOjieIWpaSEXgkDmHs6ZIDNlxUb48P9H87HEWfQ9gsfsTWFS9rIN4z6HTluUyDRwXi dcgxL4LGMGkUt/K4WQSMYvcTPTjZKq+ctKQpqnx4ApMmvWvJQ82PT9of7YzEf00KoEwp 2iFxkTRx1q0KaTdfd9SD67hi1LiahgSmDufvM= Received: by 10.86.86.2 with SMTP id j2mr2552804fgb.0.1279530320832; Mon, 19 Jul 2010 02:05:20 -0700 (PDT) Received: from [192.168.0.22] (aaqi205.neoplus.adsl.tpnet.pl [83.5.168.205]) by mx.google.com with ESMTPS id b9sm1934920faq.31.2010.07.19.02.05.20 (version=SSLv3 cipher=RC4-MD5); Mon, 19 Jul 2010 02:05:20 -0700 (PDT) Subject: dd ?bug? while making image of hdd with bad sectors From: Jakub Muszynski To: bug-coreutils@gnu.org Content-Type: text/plain; charset="UTF-8" Date: Mon, 19 Jul 2010 11:05:14 +0200 Message-ID: <1279530314.8940.22.camel@kuba> Mime-Version: 1.0 X-Mailer: Evolution 2.28.1 Content-Transfer-Encoding: 7bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-detected-operating-system: by monty-python.gnu.org: GNU/Linux 2.6, seldom 2.4 (older, 4) X-Spam-Score: -3.3 (---) X-Debbugs-Envelope-To: submit X-Mailman-Approved-At: Mon, 19 Jul 2010 09:16:35 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.11 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -4.6 (----) Hello, It's my first post here, i hope it might be usefull. My full story can be found here: http://ubuntuforums.org/showthread.php?p=9607705#post9607705 I will try to summarize it here: I have broken (fall) hdd, now im sure that's contain ~2GB od broken sectors, in 1/3 of disc capacity. I have been trying to make a dd copy : dd if=/dev/sdb conv=noerror,sync bs=4096k|pv| dd of=usb320.dd conv=noerror,sync bs=4096k > dd320.LOG but image took all my free diskspace (406GB), and terminated, eventhough my hdd is 320GB, (btw, a option to log dd output(errors) would be usefull, since i use screen terminal) root@gamma:/home/jacek# fdisk -l /dev/sdb Disk /dev/sdb: 320.1 GB, 320072933376 bytes 255 heads, 63 sectors/track, 38913 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x5517132d Device Boot Start End Blocks Id System /dev/sdb1 1 262 2098176 27 Unknown /dev/sdb2 * 263 5485 41948749 7 HPFS/NTFS /dev/sdb3 5486 38913 268510410 f W95 Ext'd (LBA) /dev/sdb5 12037 38913 215889502+ 83 Linux /dev/sdb6 8696 12036 26836551 b W95 FAT32 /dev/sdb7 5486 6377 7164927 83 Linux /dev/sdb8 6378 6499 979933+ 82 Linux swap / Solaris Partition table entries are not in disk order finally i managed to make image with this command: dd if=/dev/sdb conv=noerror,sync |pv| dd of=usb320.dd conv=noerror,sync > dd320.LOG i guess that problem is bs size + sync + badblocks My disc contain about 2GB bad blocks (around 112Gbyte sector) thoese 4194304 sectors, exchenged (due to sync flag) for empty sectors in image file, would be: with bs=4096k: 4194304 * 4096k = 17592GB (that would definitely not fit on my disk) with bs=512: 4194304 * 512 = 2147MB (thats ok) so i guess, that dd is not considering what is block size while exchanging broken block in the image file. I'm not sure if it can be called a bug, but in my opinion is should be at least mentioned in manual (to care about block size while making dump of broken disc) btw - ddrescue also filed to complete backup. if you want more feedback - i still have the same hardware configuration, so i can provide more test Sirkubax root@gamma:/mnt/csda8# dd --version dd (coreutils) 7.4 Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later . This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Written by Paul Rubin, David MacKenzie, and Stuart Kemp. root@gamma:/mnt/csda8# From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 19 10:44:33 2010 Received: (at 6667) by debbugs.gnu.org; 19 Jul 2010 14:44:34 +0000 Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1Oara4-0000RZ-VQ for submit@debbugs.gnu.org; Mon, 19 Jul 2010 10:44:33 -0400 Received: from mail1.slb.deg.dub.stisp.net ([84.203.253.98]) by debbugs.gnu.org with smtp (Exim 4.69) (envelope-from ) id 1Oara2-0000RS-En for 6667@debbugs.gnu.org; Mon, 19 Jul 2010 10:44:31 -0400 Received: (qmail 16879 invoked from network); 19 Jul 2010 14:44:50 -0000 Received: from unknown (HELO ?192.168.2.25?) (84.203.137.218) by mail1.slb.deg.dub.stisp.net with SMTP; 19 Jul 2010 14:44:50 -0000 Message-ID: <4C4464D3.1040203@draigBrady.com> Date: Mon, 19 Jul 2010 15:44:35 +0100 From: =?UTF-8?B?UMOhZHJhaWcgQnJhZHk=?= User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100227 Thunderbird/3.0.3 MIME-Version: 1.0 To: Jakub Muszynski Subject: Re: bug#6667: dd ?bug? while making image of hdd with bad sectors References: <1279530314.8940.22.camel@kuba> In-Reply-To: <1279530314.8940.22.camel@kuba> X-Enigmail-Version: 1.0.1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spam-Score: -2.7 (--) X-Debbugs-Envelope-To: 6667 Cc: 6667@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.11 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.7 (--) On 19/07/10 10:05, Jakub Muszynski wrote: > Hello, > > It's my first post here, i hope it might be usefull. > My full story can be found here: > http://ubuntuforums.org/showthread.php?p=9607705#post9607705 > I will try to summarize it here: > > I have broken (fall) hdd, now im sure that's contain ~2GB od broken > sectors, in 1/3 of disc capacity. > I have been trying to make a dd copy : > > dd if=/dev/sdb conv=noerror,sync bs=4096k|pv| dd of=usb320.dd > conv=noerror,sync bs=4096k > dd320.LOG > > but image took all my free diskspace (406GB), and terminated, eventhough > my hdd is 320GB dd doesn't read full blocks by default, so one has to be careful when reading from pipes. Is pv showing less than 406GB transferred? less would suggest the issue is with the second dd. Does adding "iflag=fullblock" to the second dd fix things? Since you're not specifying a count, just removing the "sync" option from the second dd is equivalent. Note one can can progress from dd by sending `kill -USR1` to the $pid every so often. Note also that one could get a proper progress bar from pv with: pv -s $(blockdev --getsize64 /dev/sdb) > (btw, a option to log dd output(errors) would be > usefull, since i use screen terminal) How about just doing: 2>error.log > btw - ddrescue also filed to complete backup. Surprising since this is what it's designed for. cheers, Pádraig. From debbugs-submit-bounces@debbugs.gnu.org Wed Oct 10 13:13:12 2018 Received: (at 6667) by debbugs.gnu.org; 10 Oct 2018 17:13:12 +0000 Received: from localhost ([127.0.0.1]:43796 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gAI2q-0002JP-2W for submit@debbugs.gnu.org; Wed, 10 Oct 2018 13:13:12 -0400 Received: from mail-pg1-f179.google.com ([209.85.215.179]:44972) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1gAI2o-0002J6-4Y; Wed, 10 Oct 2018 13:13:10 -0400 Received: by mail-pg1-f179.google.com with SMTP id g2-v6so2802986pgu.11; Wed, 10 Oct 2018 10:13:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=UMl3IcrCr5o6YcMaeDOz82PeQe0LbgyqY6J8xWHBfO8=; b=cNjUoQJDlazGTAzavzPsLFSkJR2M52CZmeZzKBcdJZ0/KesJW3JnmhUYiLobMl68mI 9tU6Vl/Pi5OPUeOEg8v5O0iWAQalFYZyUB8xxOQd5C5A/ciztVpxT1UluqTVnjfAupfw Y0sONXFmC8zDNR2uEZfvlr1Xj/3gpaf+eMPPGSPGsVtMcB0Dj+Hp6EZ2ge8wvHc024IN +eIFffjnOXgf1ayMrcVKuu4fsXhlryeig1ATiXJCUX14+sjWFbJvF69h8UZDP70/kwuF n064L7xjw4lwDWv4BXTedb3D9iRwEXRxf5d1Gt23AS1fnXjQq5ZSdT9HzJzOWSN93IXs mzhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=UMl3IcrCr5o6YcMaeDOz82PeQe0LbgyqY6J8xWHBfO8=; b=P8fdaJ2ibhCc9UEE3IKwPkBFwbpv96DOLP94KMudP72AMnfm6uLqHO1QprBecME9YK L/68Ss8pNtwLMpQitP+4mUq+avCWjPATYRpZzGzBjdxmuYN7N1hwIQjMW4fSK+yPKU1t Jh7LSGby307oZB7Malxp8QCCk70zsr6uhYGtlOCAo872+GCNihbnLlNuV+Xl/gLbE8Zc VcMH9+psh2YVb0NEc8AGQtDWdNXmNXVQSStOAhTsgKKeKGWjEb8GnMOS3n5R0IkW5BmS mUtUbA+7VtDdAWuFT1kiORVI9zGelV9OiGWc24bdF56HBteLFhiksvCcM1kO/OpquQf+ O5KQ== X-Gm-Message-State: ABuFfogOsEGoDa4PXchXxV5Cs/G0lDUjUQWm1Q/Dr2vRQssxzkQqSxq8 vaEobp9RLFep61/jmuzoA9pN5iPNlkc= X-Google-Smtp-Source: ACcGV637CfS304di2HTKXhD4mhLIB3rVow9q7mDdjJ/riXae0JFITeY5jK1p6vk1WKM9zO59MBlovQ== X-Received: by 2002:a63:2e47:: with SMTP id u68-v6mr30958158pgu.294.1539191583771; Wed, 10 Oct 2018 10:13:03 -0700 (PDT) Received: from tomato.housegordon.com (moose.housegordon.com. [184.68.105.38]) by smtp.googlemail.com with ESMTPSA id h63-v6sm26970467pge.48.2018.10.10.10.13.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Oct 2018 10:13:02 -0700 (PDT) Subject: Re: bug#6667: dd ?bug? while making image of hdd with bad sectors To: 6667@debbugs.gnu.org References: <1279530314.8940.22.camel@kuba> <4C4464D3.1040203@draigBrady.com> From: Assaf Gordon Message-ID: Date: Wed, 10 Oct 2018 11:13:00 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.9.1 MIME-Version: 1.0 In-Reply-To: <4C4464D3.1040203@draigBrady.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 6667 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) tags 6667 notabug close 6667 stop Hello, On 19/07/10 08:44 AM, Pádraig Brady wrote: > On 19/07/10 10:05, Jakub Muszynski wrote: >> I have been trying to make a dd copy : >> >> dd if=/dev/sdb conv=noerror,sync bs=4096k|pv| dd of=usb320.dd >> conv=noerror,sync bs=4096k > dd320.LOG >> >> but image took all my free diskspace (406GB), and terminated, eventhough >> my hdd is 320GB > > dd doesn't read full blocks by default, > so one has to be careful when reading from pipes. [...] > Does adding "iflag=fullblock" to the second dd fix things? > Since you're not specifying a count, just removing the > "sync" option from the second dd is equivalent. With no further comments in 8 years, I'm closing this item. regards, - assaf From unknown Thu Aug 14 21:53:26 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Thu, 08 Nov 2018 12:24:06 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator