failed to build plucky kernal

[elpsyr]

Describe the bug
I compile the kernel of plucky (25.04) according to the instructions in the document, but it prompts an error.
I have installed dh_testdir and gawk. I suspect that these tools are not available in the chroot environment.
To Reproduce

$ git clone https://kernel.ubuntu.com/forgejo/kernel/kteam-tools.git
$ sudo apt install schroot devscripts ubuntu-dev-tools python3-ruamel.yaml sbuild python3-git

## plucky
$ kteam-tools/cranky/cranky chroot create-base "plucky"
$ kteam-tools/cranky/cranky chroot create-session plucky:linux

$ kteam-tools/cranky/cranky checkout plucky:linux-intel

cd canonical/kernel/ubuntu/plucky/linux

/home/cfel/kteam-tools/cranky/cranky fdr clean binary

Expected behavior
to build kernal

System report

cfel@srv-gpu-sz-5:~/canonical/kernel/ubuntu/plucky/linux$ /home/cfel/kteam-tools/cranky/cranky fdr clean binary
Running: "/home/cfel/kteam-tools/cranky/cranky" chroot run -- fakeroot debian/rules clean binary
/home/cfel/kteam-tools/cranky/crl/config.py:111: UserWarning: Missing configuration, using default config.
  warnings.warn("Missing configuration, using default config.")
/bin/bash: line 1: gawk: command not found
/bin/bash -e debian/scripts/control-create linux-intel > debian/control
sed -i -e 's/PKGVER/6.14.0/g'                          \
        -e 's/ABINUM/1006/g'                                       \
        -e 's/SRCPKGNAME/linux-intel/g'                               \
        -e 's/=SERIES=/plucky/g'                           \
        -e 's|\(^Maintainer:.*\)|\1\nXSC-Ubuntu-Compatible-Signing: ubuntu/4 pro/3|g' \
        -e 's/\(^Build-Depends:$\)/\1\n\ gcc-14, gcc-14-aarch64-linux-gnu [arm64] <cross>, gcc-14-arm-linux-gnueabihf [armhf] <cross>, gcc-14-powerpc64le-linux-gnu [ppc64el] <cross>, gcc-14-riscv64-linux-gnu [riscv64] <cross>, gcc-14-s390x-linux-gnu [s390x] <cross>, gcc-14-x86-64-linux-gnu [amd64] <cross>,/g'         \
debian/control
dh_testdir
/bin/bash: line 1: dh_testdir: command not found
make: *** [debian/rules:139: clean] Error 127

@hector-cao

[syncronize-issues-to-jira]

Thank you for reporting your feedback to us!

The internal ticket has been created: https://warthogs.atlassian.net/browse/PEK-2149.

This message was autogenerated

[ThibF]

I just reproduced this flow without issues (in a fresh Noble VM)
Did you check the last output lines of each command ?

Can you re-run

~/kteam-tools/cranky/cranky chroot create-base "plucky"
~/kteam-tools/cranky/cranky chroot create-session plucky:linux

And try again ?

[elpsyr]

@ThibF I want to build a 25.04 kernel, so I used plucky. However, the chroot environment has many missing build dependencies that are not mentioned in the documentation. I have manually installed the dependencies in the chroot environment. By the way, can the command kteam-tools/cranky/cranky fdr clean binary perform multi-core parallel builds? It is very slow on a single core.

[ThibF]

I want to build a 25.04 kernel, so I used plucky.

Doing this on Plucky/Noble doesn't matter usually as we use the chroot to build.

However, the chroot environment has many missing build dependencies that are not mentioned in the documentation.

I retried the whole process in Plucky VM (to be sure) without issues.
Here is the whole history of the VM, the build is still running right now, but without any issues so far:

    1  git clone https://kernel.ubuntu.com/forgejo/kernel/kteam-tools.git
    2  sudo apt install schroot devscripts ubuntu-dev-tools python3-ruamel.yaml sbuild python3-git
    3  sudo apt update && sudo apt install schroot devscripts ubuntu-dev-tools python3-ruamel.yaml sbuild python3-git
    4  kteam-tools/cranky/cranky chroot create-base "plucky"
    5  reboot
    6  kteam-tools/cranky/cranky chroot create-base "plucky"
    7  kteam-tools/cranky/cranky chroot create-session plucky:linux
    8  htop
    9  kteam-tools/cranky/cranky checkout plucky:linux-intel
   10 cd canonical/kernel/ubuntu/plucky/linux
   11 ~/kteam-tools/cranky/cranky fdr clean binary

Did you really check if these commands successfully exit :

~/kteam-tools/cranky/cranky chroot create-base "plucky"
~/kteam-tools/cranky/cranky chroot create-session plucky:linux

That would explain your dependencies issues, as you generally need to restart your session due to sbuild permission issues.
But could have been temporary mirror issues too.

By the way, can the command kteam-tools/cranky/cranky fdr clean binary perform multi-core parallel builds? It is very slow on a single core.
kteam-tools/cranky/cranky fdr clean binary does take into account the number of core available, would you be io limited ?

Some part of the build process are just copying stuff. Setting up eatmydata could help there.

[elpsyr]

I try to build and dpkg -i linux-image-xxxx on host ,but when i try to start vm , error:

root@srv-gpu-sz-5:/data/shared/manifold-vms# cat qemu.log
qemu-system-x86_64: Could not access KVM kernel module: No such file or directory
qemu-system-x86_64: failed to initialize kvm: No such file or directory
root@srv-gpu-sz-5:/data/shared/manifold-vms# lsmod | grep kvm
kvm                  1441792  0
irqbypass              12288  2 vfio_pci_core,kvm
root@srv-gpu-sz-5:/data/shared/manifold-vms# modprobe kvm_intel
modprobe: ERROR: could not insert 'kvm_intel': Invalid argument

this is CONFIG_KVM:

CONFIG_KVM_GUEST=y
CONFIG_KVM_COMMON=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_KVM_VFIO=y
CONFIG_KVM_GENERIC_DIRTYLOG_READ_PROTECT=y
CONFIG_KVM_GENERIC_PRE_FAULT_MEMORY=y
CONFIG_KVM_COMPAT=y
CONFIG_KVM_XFER_TO_GUEST_WORK=y
CONFIG_KVM_GENERIC_HARDWARE_ENABLING=y
CONFIG_KVM_GENERIC_MMU_NOTIFIER=y
CONFIG_KVM_ELIDE_TLB_FLUSH_IF_YOUNG=y
CONFIG_KVM_GENERIC_MEMORY_ATTRIBUTES=y
CONFIG_KVM_PRIVATE_MEM=y
CONFIG_KVM_GENERIC_PRIVATE_MEM=y
CONFIG_KVM_X86=m
CONFIG_KVM=m
CONFIG_KVM_WERROR=y
CONFIG_KVM_SW_PROTECTED_VM=y
CONFIG_KVM_INTEL=m
CONFIG_KVM_INTEL_PROVE_VE=y
CONFIG_KVM_INTEL_TDX=y
CONFIG_KVM_AMD=m
CONFIG_KVM_AMD_SEV=y
CONFIG_KVM_SMM=y
CONFIG_KVM_HYPERV=y
CONFIG_KVM_XEN=y
# CONFIG_KVM_PROVE_MMU is not set
CONFIG_KVM_EXTERNAL_WRITE_TRACKING=y
CONFIG_KVM_MAX_NR_VCPUS=4096

Is there anything I need to adjust when building? I have enabled VT-d and other virtualization in BIOS. @ThibF

[ThibF]

Did you also install linux-modules and linux-modules-extra ?

[elpsyr]

Did you also install linux-modules and linux-modules-extra ?

yes,I have installed :
linux-modules-6.14.0-1006-intel_6.14.0-1006.6_amd64.deb
linux-modules-extra-6.14.0-1006-intel_6.14.0-1006.6_amd64.deb
linux-image-unsigned-6.14.0-1006-intel_6.14.0-1006.6_amd64.deb