Compilation results for ml-serve1015.eqiad.wmnet: System changes detected

Catalog differences

Summary

Resources only in the new catalog

• Package[amd-k8s-node-labeller]
• File[/etc/nerdctl]
• Exec[renew certificate - mlserve__calico-cni]
• File[/etc/ferm/conf.d/10_calico-bird]
• Group[kube]
• Concat_fragment[component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia-header]
• File[/etc/kubernetes/pki/mlserve__calicoctl.pem]
• Package[amd-k8s-device-plugin]
• File[/etc/systemd/system/ferm.service.d/ferm-service-auto-restart.conf]
• File[/etc/kubernetes/pki/mlserve__calicoctl.csr]
• Package[dragonfly-dfdaemon]
• File[/etc/cni]
• File[/etc/kubernetes/pki/mlserve__system_kube-proxy.pem]
• Exec[Generate cert mlserve__amdgpu-node-labeller refresh]
• Exec[Generate cert mlserve__rsyslog refresh]
• Node[__node_regexp__ml-serve1001-91012345.eqiad.]
• File[/etc/cfssl/ssl/mlserve__rsyslog]
• File[/etc/udev/rules.d/70-kfd.rules]
• File[/etc/systemd/system/kubelet.service.d/container-runtime.conf]
• File[/etc/apt/sources.list.d/component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia.list]
• Service[rsyslog-imfile-remedy.timer]
• File[/etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet.pem]
• File[/etc/rsyslog.d/35-output-kafka-k8s.conf]
• File[/etc/calico]
• Exec[create chained cert /etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet.chain.pem]
• File[/etc/kubernetes]
• Exec[create chained cert /etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog.chain.pem]
• Exec[systemd daemon-reload for kubelet.service (kubelet-container-runtime)]
• File[/etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet.chain.pem]
• Exec[apt_package_from_component_kubernetes131]
• File[/etc/kubernetes/pki/mlserve__system_kube-proxy.chained.pem]
• Exec[Generate cert mlserve__istio-cni refresh on intermediate ca change]
• Exec[exec-apt-get-update-linux-6.16-trixie_trixie-bpo]
• File[/etc/kubernetes/pki/mlserve__kubelet_server-key.pem]
• Exec[Generate cert mlserve__calico-cni refresh]
• File[/etc/kubernetes/pki/mlserve__calico-cni.csr]
• Exec[systemd daemon-reload for rsyslog-imfile-remedy.service (rsyslog-imfile-remedy.service)]
• Service[apparmor]
• Exec[apt_pin_apt_pin_linux-6.16-trixie_trixie-bpo]
• Exec[Generate cert mlserve__istio-cni refresh]
• Exec[systemd daemon-reload for cpupower.service (cpupower)]
• Exec[Generate cert mlserve__system_kube-proxy]
• Package[dragonfly-dfget]
• Concat_fragment[component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia-header]
• Exec[cpupower_reload]
• Exec[apt_package_from_component_istio115]
• Exec[Generate cert mlserve__calico-cni]
• File[/etc/rsyslog.d/10-kubernetes-node-filters.conf]
• File[/usr/libexec/cpupower]
• File[/lib/systemd/system/rsyslog-imfile-remedy.service]
• Package[calico-cni]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__amdgpu-node-labeller.chain.pem]
• Exec[systemd daemon-reload for ferm.service (ferm-ferm-service-auto-restart)]
• File[/lib/systemd/system/cpupower.service]
• File[/etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet.csr]
• Concat_file[/etc/apt/sources.list.d/component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• File[/etc/calico/calicoctl-kubeconfig]
• File[/etc/systemd/system/kubelet.service.d]
• File[/lib/systemd/system/rsyslog-release-deleted-inotify-watches.timer]
• Exec[Generate cert mlserve__amdgpu-node-labeller refresh on intermediate ca change]
• File[/etc/cni/net.d/10-calico.conflist]
• File[/etc/rsyslog.d/08-input-file-kubernetes-json.conf]
• File[/etc/sysctl.d/75-kube_proxy_icmp.conf]
• File[/etc/kubernetes/proxy.conf]
• File[/etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet.pem]
• Service[dragonfly-dfdaemon]
• File[/etc/kubernetes/pki]
• File[/etc/kubernetes/pki/mlserve__istio-cni.chain.pem]
• File[/lib/systemd/system/rsyslog-release-deleted-inotify-watches.service]
• File[/etc/cfssl/csr/mlserve__rsyslog.csr]
• File[/etc/kubernetes/pki/mlserve__amdgpu-node-labeller.chain.pem]
• File[/var/lib/kubelet/config.json]
• Exec[renew certificate - mlserve__amdgpu-node-labeller]
• File[/etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog.chained.pem]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__istio-cni.chain.pem]
• File[/etc/systemd/system/kube-proxy.service.d]
• File[/etc/kubernetes/pki/mlserve__calico-cni.chain.pem]
• Exec[Generate cert mlserve__system_kube-proxy refresh on intermediate ca change]
• File[/etc/dragonfly/dfdaemon.yml]
• File[/etc/apt/preferences.d/apt_pin_firmware_amd_graphics_trixie_bpo_trixie_bpo.pref]
• Exec[systemd daemon-reload for rsyslog-release-deleted-inotify-watches.timer (rsyslog-release-deleted-inotify-watches.timer)]
• File[/etc/update-motd.d/05-ml-k8s--worker]
• Exec[Generate cert mlserve__calicoctl refresh]
• Package[socat]
• Package[linux-image-6.16.3+deb13-amd64]
• File[/etc/kubernetes/pki/mlserve__amdgpu-node-labeller.chained.pem]
• File[/etc/systemd/system/amd-k8s-node-labeller.service.d/amd-devplugin-after-labeller.conf]
• File[/etc/ferm/conf.d/10_kubelet-http]
• File[/etc/kubernetes/pki/mlserve__system_kube-proxy.csr]
• File[/etc/apparmor.d/abstractions]
• Exec[Generate cert mlserve__system_kube-proxy refresh]
• Exec[Generate cert mlserve__istio-cni]
• File[/var/log/rsyslog-release-deleted-inotify-watches]
• Exec[systemd daemon-reload for amd-k8s-node-labeller.service (amd-k8s-node-labeller-amd-devplugin-after-labeller)]
• Exec[renew certificate - discovery__ml-serve1015_eqiad_wmnet]
• File[/etc/kubernetes/pki/mlserve__kubelet_server.pem]
• File[/etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet.chained.pem]
• Exec[Generate cert mlserve__system_node_ml-serve1015_eqiad_wmnet refresh]
• File[/etc/sysctl.d/70-increase_inotify_limits.conf]
• Exec[Generate cert discovery__ml-serve1015_eqiad_wmnet refresh on intermediate ca change]
• File[/etc/kubernetes/pki/mlserve__kubelet_server.chain.pem]
• Exec[Generate cert discovery__ml-serve1015_eqiad_wmnet refresh]
• Package[istio-cni]
• File[/etc/ferm/conf.d/10_calico_typha]
• Exec[renew certificate - mlserve__istio-cni]
• File[/etc/logrotate.d/rsyslog-release-deleted-inotify-watches]
• File[/etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog-key.pem]
• Exec[renew certificate - mlserve__system_node_ml-serve1015_eqiad_wmnet]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__system_kube-proxy.chain.pem]
• File[/etc/kubernetes/pki/mlserve__calico-cni.pem]
• File[/etc/apt/sources.list.d/component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia.list]
• File[/etc/kubernetes/pki/mlserve__calicoctl.chained.pem]
• File[/etc/kubernetes/kube-proxy-config.yaml]
• File[/etc/dragonfly]
• File[/etc/kubernetes/pki/mlserve__system_kube-proxy.chain.pem]
• File[/etc/systemd/system/kube-proxy.service.d/puppet-override.conf]
• Exec[Generate cert mlserve__calicoctl]
• Package[wikimedia-lvs-realserver]
• File[/etc/rsyslog.d/09-kubernetes.conf]
• File[/etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog.csr]
• File[/etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog.chain.pem]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__calico-cni.chain.pem]
• File[/etc/sysctl.d/70-ipv6-fowarding-accept-ra.conf]
• File[/etc/cfssl/ssl/mlserve__rsyslog/mlserve__rsyslog.pem]
• Exec[Generate cert mlserve__system_node_ml-serve1015_eqiad_wmnet]
• File[/etc/kubernetes/pki/mlserve__amdgpu-node-labeller-key.pem]
• Exec[Generate cert mlserve__rsyslog]
• File[/etc/cni/net.d/calico-kubeconfig]
• Exec[apt_repository_component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• File[/etc/cfssl/csr/mlserve__calicoctl.csr]
• Package[containerd]
• File[/etc/rsyslog.d/40-rsyslog-release-deleted-inotify-watches.conf]
• File[/etc/kubernetes/pki/mlserve__kubelet_server.csr]
• Exec[systemd daemon-reload for rsyslog-imfile-remedy.timer (rsyslog-imfile-remedy.timer)]
• Exec[renew certificate - mlserve__kubelet_server]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__calicoctl.chain.pem]
• Exec[apt_repository_component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• File[/etc/default/cpupower]
• File[/etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet.csr]
• File[/etc/cfssl/csr/mlserve__calico-cni.csr]
• Service[cpupower]
• File[/etc/rsyslog.d/20-shellbox.conf]
• Package[linux-cpupower]
• File[/etc/amd/node-labeller-kubeconfig]
• Exec[apt_pin_apt_pin_firmware-amd-graphics-trixie-bpo_trixie-bpo]
• File[/etc/cfssl/csr/mlserve__amdgpu-node-labeller.csr]
• File[/etc/cni/net.d/istio-kubeconfig]
• File[/etc/kubernetes/pki/mlserve__istio-cni.pem]
• File[/etc/ferm/conf.d/10_dragonfly_dfget]
• Exec[Generate cert mlserve__rsyslog refresh on intermediate ca change]
• File[/var/lib/kubelet]
• File[/etc/cfssl/csr/mlserve__system_kube-proxy.csr]
• File[/etc/dragonfly/dfget.yml]
• File[/etc/rsyslog.d/00-imfile.conf]
• File[/etc/kubernetes/kubelet.conf]
• Exec[renew certificate - mlserve__rsyslog]
• File[/etc/kubernetes/pki/mlserve__istio-cni.csr]
• File[/etc/default/wikimedia-lvs-realserver]
• File[/etc/default/kube-proxy]
• Package[crictl]
• File[/etc/apt/preferences.d/apt_pin_linux_6_16_trixie_trixie_bpo.pref]
• Exec[apt_package_from_component_calico329]
• Exec[systemd daemon-reload for kube-proxy.service (kube-proxy)]
• File[/etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet.chained.pem]
• File[/etc/amd]
• Exec[Generate cert mlserve__kubelet_server refresh on intermediate ca change]
• File[/etc/kubernetes/pki/mlserve__istio-cni.chained.pem]
• Exec[Generate cert mlserve__system_node_ml-serve1015_eqiad_wmnet refresh on intermediate ca change]
• Exec[exec-apt-get-update-firmware-amd-graphics-trixie-bpo_trixie-bpo]
• File[/etc/containerd]
• File[/lib/systemd/system/rsyslog-imfile-remedy.timer]
• Package[calicoctl]
• Concat[/etc/apt/sources.list.d/component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• Package[kubernetes-node]
• File[/etc/modules-load.d/overlay.conf]
• Concat_fragment[component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• Concat_fragment[component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• Concat_file[/etc/apt/sources.list.d/component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• Service[rsyslog-release-deleted-inotify-watches.timer]
• File[/etc/default/kubelet]
• File[/etc/kubernetes/pki/mlserve__amdgpu-node-labeller.csr]
• File[/etc/udev/rules.d/70-render.rules]
• File[/etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet.chain.pem]
• Exec[Generate cert mlserve__calico-cni refresh on intermediate ca change]
• Package[nerdctl]
• Package[apparmor]
• File[/etc/kubernetes/pki/mlserve__system_kube-proxy-key.pem]
• File[/etc/dragonfly/discovery__ml-serve1015_eqiad_wmnet-key.pem]
• Concat[/etc/apt/sources.list.d/component-kubernetes131-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• File[/etc/kubernetes/pki/mlserve__calico-cni.chained.pem]
• File[/etc/containerd/config.toml]
• Exec[Generate cert mlserve__kubelet_server]
• Exec[Generate cert mlserve__amdgpu-node-labeller]
• Exec[/sbin/modprobe overlay]
• Exec[apt_repository_component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• File[/etc/kubernetes/pki/mlserve__kubelet_server.chained.pem]
• Concat_file[/etc/apt/sources.list.d/component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• File[/etc/cfssl/csr/mlserve__istio-cni.csr]
• Concat_fragment[component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia]
• File[/etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet-key.pem]
• File[/etc/systemd/system/amd-k8s-node-labeller.service.d]
• File[/usr/local/sbin/rsyslog-release-deleted-inotify-watches]
• File[/etc/apt/sources.list.d/component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia.list]
• Concat_fragment[component-istio115-apt.wikimedia.org-wikimedia-trixie-wikimedia-header]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__system_node_ml-serve1015_eqiad_wmnet.chain.pem]
• File[/etc/calico/calicoctl.cfg]
• File[/etc/calico/pki]
• File[/etc/cfssl/csr/mlserve__kubelet_server.csr]
• File[/etc/cni/net.d]
• Exec[Generate cert mlserve__kubelet_server refresh]
• File[/etc/cfssl/csr/discovery__ml-serve1015_eqiad_wmnet.csr]
• Service[containerd]
• File[/etc/nerdctl/nerdctl.toml]
• File[/etc/udev/rules.d/75-kube_proxy_conntrack.rules]
• Service[kube-proxy]
• Package[rsyslog-kubernetes]
• File[/etc/kubernetes/pki/mlserve__calico-cni-key.pem]
• File[/var/run/kubernetes]
• Exec[renew certificate - mlserve__calicoctl]
• Exec[Generate cert discovery__ml-serve1015_eqiad_wmnet]
• File[/etc/cfssl/csr/mlserve__system_node_ml-serve1015_eqiad_wmnet.csr]
• User[kube]
• File[/etc/sysctl.d/75-kube_proxy_conntrack.conf]
• Exec[/usr/sbin/dpkg-reconfigure -p critical -f noninteractive wikimedia-lvs-realserver]
• File[/etc/kubernetes/pki/mlserve__calicoctl-key.pem]
• Exec[Generate cert mlserve__calicoctl refresh on intermediate ca change]
• File[/etc/kubernetes/pki/mlserve__amdgpu-node-labeller.pem]
• Service[kubelet]
• Concat[/etc/apt/sources.list.d/component-calico329-apt.wikimedia.org-wikimedia-trixie-wikimedia.sources]
• File[/etc/kubernetes/pki/mlserve__istio-cni-key.pem]
• File[/etc/kubernetes/pki/mlserve__calicoctl.chain.pem]
• Exec[create chained cert /etc/kubernetes/pki/mlserve__kubelet_server.chain.pem]
• File[/etc/kubernetes/kubelet-config.yaml]
• Exec[systemd daemon-reload for rsyslog-release-deleted-inotify-watches.service (rsyslog-release-deleted-inotify-watches.service)]
• Exec[renew certificate - mlserve__system_kube-proxy]

Resources only in the old catalog

• File[/etc/update-motd.d/05-ml-k8s--insetup-gpu]
• Node[__node_regexp__ml-serve10145.eqiad.]

Resources modified

• File[/etc/nagios/nrpe.d/check_disk_space.cfg]

  Content differences:

  --- /etc/nagios/nrpe.d/check_disk_space.cfg.orig
  +++ /etc/nagios/nrpe.d/check_disk_space.cfg
  @@ -1,2 +1,2 @@
   # File generated by puppet. DO NOT edit by hand
  -command[check_disk_space]=/usr/lib/nagios/plugins/check_disk -w 6% -c 3% -W 6% -K 3% -l -e -A -i "/srv/sd[a-b][1-3]" -i "/srv/nvme[0-9]n[0-9]p[0-9]" --exclude-type=fuse --exclude-type=fuse.fuse_dfs --exclude-type=tracefs
  +command[check_disk_space]=/usr/lib/nagios/plugins/check_disk -w 10% -c 5% -W 6% -K 3% -l -e -A -i '/(var/lib|run)/(containerd|kubelet)/*' --exclude-type=tracefs

• File[/etc/modprobe.d/blacklist-wmf_overlay.conf]

  Parameters differences:

  --- File[/etc/modprobe.d/blacklist-wmf_overlay.conf].orig
  +++ File[/etc/modprobe.d/blacklist-wmf_overlay.conf]
  
  @@
  -    ensure => present
  +    ensure => absent
  

  Content differences:

  --- /etc/modprobe.d/blacklist-wmf_overlay.conf.orig
  +++ /etc/modprobe.d/blacklist-wmf_overlay.conf
  @@ -1,7 +1,3 @@
   # wmf_overlay - blacklisted kernel modules
   # This file is managed by Puppet
   #
  -blacklist overlay
  -install overlay /bin/true
  -blacklist overlayfs
  -install overlayfs /bin/true

• File[/etc/default/prometheus-node-exporter]

  Content differences:

  --- /etc/default/prometheus-node-exporter.orig
  +++ /etc/default/prometheus-node-exporter
  @@ -15,6 +15,7 @@
    --collector.netdev \
    --collector.netstat \
    --collector.netstat.fields=^(.*) \
  + --collector.processes \
    --collector.sockstat \
    --collector.stat \
    --collector.systemd.enable-restarts-metrics \

• File[/var/lib/prometheus/node.d/role_owner.prom]

  Content differences:

  --- /var/lib/prometheus/node.d/role_owner.prom.orig
  +++ /var/lib/prometheus/node.d/role_owner.prom
  @@ -1,3 +1,3 @@
   # HELP role_owner The team owner of the server role
   # TYPE role_owner gauge
  -role_owner{team="machine-learning",role="ml_k8s::insetup_gpu",cluster="ml_serve"} 1.0
  +role_owner{team="machine-learning",role="ml_k8s::worker",cluster="ml_serve"} 1.0

• Package[firmware-amd-graphics]

  Parameters differences:

  --- Package[firmware-amd-graphics].orig
  +++ Package[firmware-amd-graphics]
  
  @@
  -    ensure => installed
  +    ensure => 20251021-1~bpo13+1
  

• Concat_fragment[main contacts]

  Content differences:

  --- main contacts.orig
  +++ main contacts
  @@ -1,3 +1,3 @@
   ---
  -role::ml_k8s::insetup_gpu:
  +role::ml_k8s::worker:
   - Machine Learning

Relevant files

• Production catalog
• Change catalog
• Production errors/warnings
• Change errors/warnings
• Standard Diff
• Full Diff