Re: Feedback: segfault on Reiser4 SFRN 5.1.3

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Mar 24, 2020 at 1:01 AM Metztli Information Technology <jose.r.r@xxxxxxxxxxx> wrote:
>
> On Mon, Mar 23, 2020 at 3:29 PM Edward Shishkin <edward.shishkin@xxxxxxxxx> wrote:
> >
> > On 03/23/2020 01:39 PM, Metztli Information Technology wrote:
> > > On Wed, Mar 11, 2020 at 3:09 PM Edward Shishkin <edward.shishkin@xxxxxxxxx> wrote:
> > >>
> > >> On 03/10/2020 11:24 PM, Edward Shishkin wrote:
> > >>> On 03/10/2020 09:25 PM, Edward Shishkin wrote:
> > >>>> On 03/10/2020 06:36 AM, Metztli Information Technology wrote:
> > >>>>> Niltze, Ed-
> > >>>>>
> > >>>>>
> > >>>>> I am experiencing segfault when using dpkg (package manager for
> > >>>>> debian) utility to unpack software.
> > >>>>>
> > >>>>> It happens *both* during reiser4 sfrn 5.1.3 -enabled Debian Installer
> > >>>>> (d-i) *and* in a pure sfrn 5.1.3 Debian Buster environment,
> > >>>>> i.e., formatted in sfrn 5.1.3 and running reiser4progs 2.0.0 and
> > >>>>> corresponding kernel. It happens in VirtualBox 6.1.4
> > >>>>
> > >>>> Do you have any bootable image I could download and reproduce that
> > >>>> oops on my virtual machine?
> > >>>
> > >>> Ah, I see a mistake, which most likely causes that oops.
> > >>> Will provide a fixup soon..
> > >>
> > >>
> > >> Please, apply the attached patch (from the directory ./fs/reiser4)
> > >
> > > Applied your patch, ed, and the reiser4 SFRN 5.1.3 native installation proceeds a little further --until after the kernel is selected-- the locales package fails.
> > >
> > > Here is a little background. The Debian Installer (d-i) utilizes Busybox utilities --especifically unxz-- once the 'Install base system' option starts.
> > >
> > > Notwithstanding, for whatever reason unxz fails with:
> > >
> > > ...
> > > unxz: compressed data not read from terminal, use -f to force it
> > > usage: /usr/lib/debootstrap/pkgdetails PKGS mirror packagesfile pkgs..
> > >     or: /usr/lib/debootstrap/pkgdetails FIELD field mirror packagesfile pkgs..
> > >     or: /usr/lib/debootstrap/pkgdetails GETDEPS packagesfile pkgs..
> > >     or: /usr/lib/debootstrap/pkgdetails STANZAS packagesfile pkgs..
> > >     or: /usr/lib/debootstrap/pkgdetails WGET% low high end reason
> > > mknod: /target/dev/null: No such file or directory
> > >
> > > I tried a couple (at least) of methods to bypass the issue.
> > > I located /usr/share/debootstrap/functions and modified Busybox command invocation as: unxz -f
> > >
> > > Additionally, I built another Busybox hack which included the full unxz command along with the proper *.so library support built from bleeding edge git source.
> > > < https://github.com/xz-mirror/xz >
> > >
> > > Fact is non-busybox unxz command does not require -f switch to continue the installation onto reiser4 SFRN5 formatted media:
> > > < https://metztli.it/buster-reiser5/reg42/metztli-reiser4-sfrn5.iso >
> > > < https://metztli.it/buster-reiser5/reg42/metztli-reiser4-sfrn5.iso.SHA256SUM >
> > >
> > > At this point is when the patch that you provided proved its worth --as the segfault was not experienced any longer and the installation continued.
> > >
> > > Notwithstanding, after selecting the kernel to be installed, for which the locales package is a requirement, the installer Python 'thinks' --like busybox unxz before--
> > > that it is running in a terminal:
> > > sed: couldn't edit /etc/locale.gen: is a terminal
> > >
> > > Thinking that a newer Python3 version 3.8.2 might make a difference, I hacked a Debian UDEB component so as to provide Python3 3.8.2 support into
> > > the environment. Nevertheless, the issue persists, the Debian Installer continues to 'think' it is running in a terminal (read only? ) and not being installed
> > > into reiser4 SFRN5 formatted filesystem ( isatty() issues?)
> > >
> > > We can verify we are running non-busybox unxz utility:
> > > unxz --version
> > >
> > > and latest Python3 support:
> > > python3 --version
> >
> >
> > Hm.. I am not able to identify the problem only by that input..

Please, download the installer at the link referenced previously and run it in VirtualBox for the relevant input / output environment. Notwithstanding,
< https://metztli.it/readOnlyEphemeral/unxz-python3.png >
unxz --version
xz (XZ Utils) 5.3.1alpha
liblzma 5.3.1alpha

python3 --version
Python 3.8.2

> >
> >
> > >
> > > Please be aware, sir, that even in a VirtualBox 6.1.4 virtual machine converted from reiser4 SFRN 4.0.2 to SFRN 5.1.3 by the cp -a back-and-forth method
> > > and subsequent fine tuning, i.e., /etc/fstab modification, /boot/grub/grub.cfg, reiser4progs 2.0.0 proper installation, etc.,
> > > existing Python3 7.x.y from Debian repositories is used by the Debian package manager to install and upgrade software packages.
> > > Accordingly, that older Python3 version fails to detect that it is operating on a file system and, like the installer, 'thinks' it is in a terminal.
> > > Evidently, most software installation/upgrade operations fail with a python prompt:
> > >>>>
> > >
> > > Finally, I have hacked a couple of newer Debian package utilities with newer Python3 3.8.2 in an attempt to observe if something changes without any luck.
> > > apt_2.0.0+nmu1_amd64.deb
> > > apt-utils_2.0.0+nmu1_amd64.deb
> > > libapt-pkg6.0_2.0.0+nmu1_amd64.deb
> > >
> > > python3-apt_1.9.10+nmu1_amd64.deb
> > > python-apt_1.9.10+nmu1_amd64.deb
> > > python-apt-common_1.9.10+nmu1_all.deb
> > >
> > > In summary, a new busybox 1.31.1 unxz utility and Python3 7.x.y / 3.8.2 cannot detect the underlying reiser5 file system where they are to operate.
> > > I am able to replace unxz to advance the installation but I cannot make Python3 to recognize the reiser5 filesystem
> >
> >
> > There is no "reiser5 file system". At least, I didn't rename it.
> > "reiser5" stands for "reiser4 kernel module of SFRN 5.X.Y".
>
> I am using the term in your previous announcement, sir,
> < https://marc.info/?l=reiserfs-devel&m=157780043509663&w=2 >
> interchangeably. Notwithstanding, if you want me to be pedantic, let me rephrase the previous statement:
>
> "In summary, a new busybox 1.31.1 unxz utility and Python3 7.7.3 / 3.8.2 cannot detect the underlying reiser4 Software Framework Release Number (SFRN) 5.1.3
> file system where they are to operate. I am able to replace unxz to advance the installation but I cannot make Python3 to recognize the
> reiser4 SFRN 5.1.3 filesystem."

er, previous typo, I meant Python3 3.7.3 / 3.8.2
>
> >
> > Thanks,
> > Edward.
> >
> >
> >   on which it is to operate --as
> > > it erroneously 'believes' it is running in a terminal.
> > >
> > > By the way, the current Debian Installer (d-i) netboot framework for *both* reiser4 SFRN 4.0.2 and referenced SFRN 5.1.3 is very similar for the Linux 5.5.8 version.
> > > Yet the installer has no issues detecting a reiser4 4.0.2 -formatted media whereas unxz and python3 in reiser4 5.1.3 fail and possibly detect it as a terminal.
> > >
> > >>
> > >> Thanks,
> > >> Edward.
> > >>
> > >>>
> > >>>>
> > >>>> �  as well as in actual
> > >>>>> physical hardware, same BUG line.
> > >>>>>
> > >>>>> This BUG makes it impossible to carry out a native Debian Buster
> > >>>>> installation onto a default reiser4 SFRN 5.1.3 -formatted
> > >>>>> partition, i.e., reg42, with or without specifying a stripe, i.e., -t
> > >>>>> 256K. Accordingly, even if a user uses cp -a back-and-forth
> > >>>>> to hack a pure SFRN5 Debian system whenever a software upgrade occurs
> > >>>>> a segmentation fault will follow.
> > >>>>>
> > >>>>> Unaware if other package managers, like RPM/YUM utilities, etc., will
> > >>>>> cause a segfault as well.
> > >>>>>
> > >>>>>
> > >>>>> Mar Ã? 8 20:20:19 debootstrap: Selecting previously unselected package
> > >>>>> base-passwd.
> > >>>>> Mar Ã? 8 20:20:19 debootstrap: (Reading database ... 0 files and
> > >>>>> directories currently installed.)
> > >>>>> Mar Ã? 8 20:20:19 debootstrap: Preparing to unpack
> > >>>>> .../base-passwd_3.5.46_amd64.deb ...
> > >>>>> Mar Ã? 8 20:20:19 debootstrap: Segmentation fault
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378009] ------------[ cut here
> > >>>>> ]------------
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378017] kernel BUG at
> > >>>>> fs/reiser4/plugin/item/extent_stripe_ops.c:466!
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378031] invalid opcode: 0000 [#1] SMP PTI
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378044] CPU: 6 PID: 18587 Comm: dpkg
> > >>>>> Tainted: G �  �  �  �  �  � E �  �  5.5.0-1+reiser4-5.1.3-amd64 #1 Debian
> > >>>>> 5.5.7-1+reiser4~5.1.3
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378048] Hardware name: Hewlett-Packard
> > >>>>> HP Pavilion dv6 Notebook PC/17FC, BIOS F.1C 01/23/2013
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378103] RIP:
> > >>>>> 0010:find_or_create_extent_stripe+0x169/0x1d0 [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378110] Code: 48 89 58 50 eb b3 4c 89
> > >>>>> ef e8 43 40 fd ff eb 85 4c 89 e7 41 89 de e8 a6 2a d4 ee eb a2 4c 89
> > >>>>> e7 e8 bc 3e d4 ee e9 11 ff ff ff <0f> 0b 48 89 df e8 bd 42 fb ff eb
> > >>>>> 89 e8 26 1e be ee f0 ff 4b 0c 74
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378114] RSP: 0018:ffff9f90cd873c30
> > >>>>> EFLAGS: 00010246
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378120] RAX: 0000000000000000 RBX:
> > >>>>> ffff8ab298d12240 RCX: 0000000000000000
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378123] RDX: 0000000000000000 RSI:
> > >>>>> ffff8ab2a5b366f8 RDI: ffff8ab2a5b36600
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378127] RBP: ffff9f90cd873d20 R08:
> > >>>>> 0000000000000001 R09: 000000000000000c
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378130] R10: 0000000000000024 R11:
> > >>>>> ffff8ab29f350a82 R12: ffffd75c5061c1c0
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378134] R13: ffff8ab298d8a418 R14:
> > >>>>> 0000000000000000 R15: ffff8ab2b2905800
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378139] FS: Ã? 00007fc29b9f4380(0000)
> > >>>>> GS:ffff8ab2bfb80000(0000) knlGS:0000000000000000
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378143] CS: Ã? 0010 DS: 0000 ES: 0000
> > >>>>> CR0: 0000000080050033
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378147] CR2: 00005616aa3b0a81 CR3:
> > >>>>> 00000004187d4002 CR4: 00000000000606e0
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378150] Call Trace:
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378211] Ã? ? shorten_stripe+0x39b/0x4d0
> > >>>>> [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378221] Ã? ? _cond_resched+0x15/0x30
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378266] Ã? shorten_stripe+0x39b/0x4d0
> > >>>>> [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378317]
> > >>>>> reiser4_setattr_generic+0x150/0x200 [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378362] Ã? ? shorten_stripe+0x4d0/0x4d0
> > >>>>> [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378371] Ã? notify_change+0x339/0x4a0
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378378] Ã? do_truncate+0x74/0xc0
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378386] Ã? do_sys_ftruncate+0x130/0x180
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378395] Ã? do_syscall_64+0x52/0x170
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378401]
> > >>>>> entry_SYSCALL_64_after_hwframe+0x44/0xa9
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378406] RIP: 0033:0x7fc29bb81947
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378412] Code: 77 01 c3 48 8b 15 49 85
> > >>>>> 0c 00 f7 d8 64 89 02 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00
> > >>>>> 0f 1f 40 00 b8 4d 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 01 c3 48 8b
> > >>>>> 15 19 85 0c 00 f7 d8 64 89 02 b8
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378416] RSP: 002b:00007fff8148a888
> > >>>>> EFLAGS: 00000206 ORIG_RAX: 000000000000004d
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378421] RAX: ffffffffffffffda RBX:
> > >>>>> 00005616aa3ad4f0 RCX: 00007fc29bb81947
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378425] RDX: 0000000000000000 RSI:
> > >>>>> 0000000000000098 RDI: 0000000000000009
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378428] RBP: 00005616aa3ac260 R08:
> > >>>>> 00005616aa3ac340 R09: 00007fc29b9f4380
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378432] R10: 0000000000000000 R11:
> > >>>>> 0000000000000206 R12: 0000000000000098
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378435] R13: 00007fff8148b2f0 R14:
> > >>>>> 00005616aa3b32a5 R15: 0000000000000000
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378440] Modules linked in: dm_mod(E)
> > >>>>> md_mod(E) xfs(E) reiser4(E) jfs(E) btrfs(E) xor(E) raid6_pq(E)
> > >>>>> libcrc32c(E) zstd_compress(E) zstd_decompress(E) ext4(E) crc16(E)
> > >>>>> mbcache(E) jbd2(E) crc32c_generic(E) r8169(E) realtek(E) libphy(E)
> > >>>>> ctr(E) ccm(E) iwldvm(E) mac80211(E) libarc4(E) iwlwifi(E) cfg80211(E)
> > >>>>> rfkill(E) nls_ascii(E) nls_cp437(E) vfat(E) fat(E) hid_generic(E)
> > >>>>> usbhid(E) hid(E) sr_mod(E) cdrom(E) sd_mod(E) uas(E) usb_storage(E)
> > >>>>> ahci(E) libahci(E) xhci_pci(E) ehci_pci(E) xhci_hcd(E) sdhci_pci(E)
> > >>>>> ehci_hcd(E) cqhci(E) libata(E) rtsx_pci_sdmmc(E) sdhci(E) usbcore(E)
> > >>>>> mmc_core(E) scsi_mod(E) rtsx_pci(E) mfd_core(E) usb_common(E) wmi(E)
> > >>>>> battery(E) video(E) [last unloaded: libphy]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378508] ---[ end trace
> > >>>>> c7be9d76279fc2ea ]---
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378544] RIP:
> > >>>>> 0010:find_or_create_extent_stripe+0x169/0x1d0 [reiser4]
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378550] Code: 48 89 58 50 eb b3 4c 89
> > >>>>> ef e8 43 40 fd ff eb 85 4c 89 e7 41 89 de e8 a6 2a d4 ee eb a2 4c 89
> > >>>>> e7 e8 bc 3e d4 ee e9 11 ff ff ff <0f> 0b 48 89 df e8 bd 42 fb ff eb
> > >>>>> 89 e8 26 1e be ee f0 ff 4b 0c 74
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378554] RSP: 0018:ffff9f90cd873c30
> > >>>>> EFLAGS: 00010246
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378558] RAX: 0000000000000000 RBX:
> > >>>>> ffff8ab298d12240 RCX: 0000000000000000
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378562] RDX: 0000000000000000 RSI:
> > >>>>> ffff8ab2a5b366f8 RDI: ffff8ab2a5b36600
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378565] RBP: ffff9f90cd873d20 R08:
> > >>>>> 0000000000000001 R09: 000000000000000c
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378568] R10: 0000000000000024 R11:
> > >>>>> ffff8ab29f350a82 R12: ffffd75c5061c1c0
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378572] R13: ffff8ab298d8a418 R14:
> > >>>>> 0000000000000000 R15: ffff8ab2b2905800
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378576] FS: Ã? 00007fc29b9f4380(0000)
> > >>>>> GS:ffff8ab2bfb80000(0000) knlGS:0000000000000000
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378580] CS: Ã? 0010 DS: 0000 ES: 0000
> > >>>>> CR0: 0000000080050033
> > >>>>> Mar Ã? 8 20:20:19 kernel: [ Ã? 794.378584] CR2: 00005616aa3b0a81 CR3:
> > >>>>> 00000004187d4002 CR4: 00000000000606e0
> > >>>>>
> > >>>>>
>
> P.S. If, for the sake experiment, we format the target partition with reiserprogs 2.0.0 as
> mkfs.reiser4 -o compress=zstd1, we discover the fail installation experience is similar as if use mkfs.reiser4 -o create=reg42 ;
> could it be that the compression plugin, unsupported in SFRN 5.1.3, is somehow affecting the *overall* outcome. Is it possible
> to strip/disable the compression plugin from the reiser4 SFRN 5.1.3 code?
>
> Official current Reiser4 resources: https://reiser4.wiki.kernel.org/

СпаÑ?ибо,

-- 
Jose R R
http://metztli.it
---------------------------------------------------------------------------------------------
Download Metztli Reiser4: Debian Buster w/ Linux 5.5.8 AMD64
---------------------------------------------------------------------------------------------
feats ZSTD compression https://sf.net/projects/metztli-reiser4/
-------------------------------------------------------------------------------------------
Official current Reiser4 resources: https://reiser4.wiki.kernel.org/



[Index of Archives]     [Linux File System Development]     [Linux BTRFS]     [Linux NFS]     [Linux Filesystems]     [Ext4 Filesystem]     [Kernel Newbies]     [Share Photos]     [Security]     [Netfilter]     [Bugtraq]     [Yosemite Forum]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Device Mapper]     [Linux Resources]

  Powered by Linux