Public images may contain known security vulnerabilities or configuration issues. Reviewing these known issues helps you understand potential security risks and resolve them quickly.
Known issues for Windows
Known issues for Linux
CentOS issues
Ubuntu issues
Fedora CoreOS issues
OpenSUSE issues
Red Hat Enterprise Linux issues
SUSE Linux Enterprise Server issues
AnolisOS issues
Other issues
Known issues for Windows
Feature issues on instances with 512 MB of memory
Symptoms
When you use the Windows Server, Version 2004 Datacenter 64-bit Chinese edition (without a GUI) image on an instance type with 512 MB of memory, you may encounter several issues. For example, the password set during instance creation does not take effect, you cannot change the password at runtime, and commands fail to run.
Cause
The paging file is not enabled. This prevents the system from allocating virtual memory and causes intermittent program errors.
Solution
The limited memory on this instance type prevents the Windows Recovery Environment (WinRE) from being mounted. Because the password set during instance creation is not applied, you cannot log on to the instance. You must use Cloud Assistant to configure the paging file.
Use one of the following methods to run commands with Cloud Assistant.
Use Session Manager to connect to the instance without a password and run commands. For more information, see Connect to an instance by using Session Manager on the console.
Use Cloud Assistant to send remote commands. For more information, see Send remote commands.
Run the following command to enable automatic management of the paging file.
Wmic ComputerSystem set AutomaticManagedPagefile=TrueNoteIf the command fails, retry it until it succeeds.
You can also run the
Wmic ComputerSystem get AutomaticManagedPagefilecommand to check whether the paging file is enabled. If the following output is returned, the paging file is enabled.AutomaticManagedPagefile TRUE
Restart the instance for the configuration to take effect.
Software packages unresponsive on Windows Server 2016
Symptoms
When you try to run a downloaded software package on Windows Server 2016, nothing happens.
Cause
As a security measure, Windows enables a "Protect your PC" configuration during the Sysprep phase of startup. This starts the Windows SmartScreen process to help protect your system from malicious websites and unsafe downloads.
When you run a software package from the internet, Windows flags it with a web mark. This triggers the SmartScreen process, which may block software that has an insufficient reputation.
Solution
To resolve this issue, use one of the following methods:
Unblock the software package
In the properties of the software package, select Unblock.
Run the software package again.
Turn off SmartScreen
Go to the
C:\Windows\System32directory.Double-click the
SmartScreenSettings.exefile.In the Windows SmartScreen dialog box, select Don't do anything (turn off Windows SmartScreen), and then click OK.
Run the software package again.
Modify group policy
Open the Run dialog box and enter
gpedit.msc.In the Local Group Policy Editor, navigate to Computer Configuration > Windows Settings > Security Settings > Local Policies > Security Options.
Find the User Account Control: Admin Approval Mode for the Built-in Administrator account policy, right-click it, and then select Properties.
On the Local Security Setting tab, select Enabled and then click OK.
Restart the system for the configuration to take effect.
Run the software package again.
Windows Server 2022: KB5034439 patch installation failure
Symptoms
The KB5034439 patch fails to install on Windows Server 2022.
Cause
KB5034439 is an update for the Windows Recovery Environment that was released by Microsoft in January 2024. If your update source is configured to use the official Microsoft Windows Update service, the system may try to install this patch, which can result in a failure. By default, Alibaba Cloud images use an internal WSUS update server and do not receive this patch. This behavior is expected and does not affect normal system operation. For more information, see the official Microsoft documentation for KB5034439: Windows Recovery Environment update for Windows Server 2022: January 9, 2024.
June 2022 patch: NAT and RRAS issues
Symptoms: Microsoft announced on June 23, 2022, that installing the June security patch may cause issues on Windows devices. For example, RRAS servers with NAT enabled on a network interface may lose connectivity, and devices connected to the server may be unable to access the internet.
Affected versions:
Windows Server 2022
Windows Server 2019
Windows Server 2016
Windows Server 2012 R2
Windows Server 2012
When you check for system updates on Windows Server 2012 R2 and Windows Server 2012, make sure that you select the Check for updates option that connects to the internal Alibaba Cloud Windows WSUS update server, instead of the option that connects to the official Microsoft Windows Update server on the internet. To prevent potential issues from security updates, we review all Microsoft Windows security updates and release only the approved ones to our internal WSUS update server. Open Control Panel > All Control Panel Items > Windows Update, and click Check for updates in the left-side menu to check for available updates. You can also click the Check online for updates from Windows Update link at the bottom of the page to check for updates online.
Solution: The problematic patches have been removed from the Alibaba Cloud WSUS service. To verify that your operating system is not affected, run the appropriate command for your Windows Server version to check whether the problematic patch is installed.
Windows Server 2012 R2: wmic qfe get hotfixid | find "5014738" Windows Server 2019: wmic qfe get hotfixid | find "5014692" Windows Server 2016: wmic qfe get hotfixid | find "5014702" Windows Server 2012: wmic qfe get hotfixid | find "5014747" Windows Server 2022: wmic qfe get hotfixid | find "5014678"If the command output shows that a problematic patch is installed and you are experiencing NAT or RRAS issues, uninstall the patch to restore normal functionality. Run the appropriate command for your Windows Server version to uninstall the patch.
Windows Server 2012 R2: wusa /uninstall /kb:5014738 Windows Server 2019: wusa /uninstall /kb:5014692 Windows Server 2016: wusa /uninstall /kb:5014702 Windows Server 2012: wusa /uninstall /kb:5014747 Windows Server 2022: wusa /uninstall /kb:5014678NoteFor the latest updates and guidance on this issue, see the official Microsoft documentation: RRAS Servers can lose connectivity if NAT is enabled on the public interface.
January 2022 patch: Domain controller issues
Symptoms: Microsoft announced on January 13, 2022, that installing the January security patch may cause issues on Windows devices. For example, domain controllers may fail to restart or enter a restart loop, Hyper-V virtual machines (VMs) may fail to start, or IPsec VPN connections may fail.
Affected versions:
Windows Server 2022
Windows Server, version 20H2
Windows Server 2019
Windows Server 2016
Windows Server 2012 R2
Windows Server 2012
When you check for system updates on Windows Server 2012 R2 and Windows Server 2012, make sure that you select the Check for updates option that connects to the internal Alibaba Cloud Windows WSUS update server, instead of the option that connects to the official Microsoft Windows Update server on the internet. To prevent potential issues from security updates, we review all Microsoft Windows security updates and release only the approved ones to our internal WSUS update server. Open Control Panel > All Control Panel Items > Windows Update, and click Check for updates in the left-side menu to check for available updates. You can also click the Check online for updates from Windows Update link at the bottom of the page to check for updates online.
Solution: The problematic patches have been removed from the Alibaba Cloud WSUS service. To verify that your operating system is not affected, run the appropriate command for your Windows Server version to check whether the problematic patch is installed.
Windows Server 2012 R2: wmic qfe get hotfixid | find "5009624" Windows Server 2019: wmic qfe get hotfixid | find "5009557" Windows Server 2016: wmic qfe get hotfixid | find "5009546" Windows Server 2012: wmic qfe get hotfixid | find "5009586" Windows Server 2022: wmic qfe get hotfixid | find "5009555"If the command output shows that a problematic patch is installed and you are experiencing domain controller failures or VMs are failing to start, uninstall the patch to restore normal functionality. Run the appropriate command for your Windows Server version to uninstall the patch.
Windows Server 2012 R2: wusa /uninstall /kb:5009624 Windows Server 2019: wusa /uninstall /kb:5009557 Windows Server 2016: wusa /uninstall /kb:5009546 Windows Server 2012: wusa /uninstall /kb:5009586 Windows Server 2022: wusa /uninstall /kb:5009555NoteFollow Microsoft's official documentation for further updates and instructions on this issue. For more information, see RRAS Servers can lose connectivity if NAT is enabled on the public interface.
Windows Server 2012 R2: .NET Framework 3.5 installation failure
Issue: The installation of .NET Framework 3.5 fails on Windows Server 2012 R2 systems created from images that have the June 2023 patch KB5027141, July 2023 patch KB5028872, August 2023 patch KB5028970, or September 2023 patch KB5029915 installed by default.
ImportantIf you plan to continue using Windows Server 2012 R2, we recommend creating an ECS instance from a community image that has .NET Framework 3.5 pre-installed. You can find these images on the ECS console. The image names are
win2012r2_9600_x64_dtc_zh-cn_40G_.Net3.5_alibase_20231204.vhdandwin2012r2_9600_x64_dtc_en-us_40G_.Net3.5_alibase_20231204.vhd. For information about how to find these images, see Find images.On the Results page of the Add Roles and Features Wizard, Feature Installation displays an error: the installation of one or more roles or features failed because the source files could not be found. The wizard recommends retrying the installation and specifying an alternate source path. The failed item is .NET Framework 3.5 (includes .NET 2.0 and 3.0).
Solution:
In Control Panel, find the KB5027141, KB5028872, KB5028970, or KB5029915 patch. Right-click the patch and select Uninstall.
The path is Control Panel > Programs > Programs and Features > Installed Updates.
Restart the ECS instance.
For more information, see Restart an instance.
Install .NET Framework 3.5 by using one of the following methods.
Server Manager GUI
In Server Manager, click Add Roles and Features.
Follow the wizard with the default settings. On the Features page, select .NET Framework 3.5 Features.
Follow the prompts in the wizard to confirm and complete the installation.
PowerShell command
You can run one of the following commands:
Dism /Online /Enable-Feature /FeatureName:NetFX3 /AllPS C:\Users\Administrator> Dism /Online /Enable-Feature /FeatureName:NetFX3 /All 部署映像服务和管理工具 版本: 6.3.9600.19408 映像版本: 6.3.9600.19397 启用一个或多个功能 [==========================100.0%==========================] 操作成功完成。Install-WindowsFeature -Name NET-Framework-FeaturesPS C:\Users\Administrator> Install-WindowsFeature -Name NET-Framework-Features Success Restart Needed Exit Code Feature Result ------- -------------- --------- -------------- True No Success {.NET Framework 3.5 (includes .NET 2.0 and...
Windows Server 2025: .NET Framework 3.5 installation failure
Symptoms: The installation of .NET Framework 3.5 fails on Windows Server 2025.
When you install .NET Framework 3.5 by using the Add Roles and Features Wizard, the installation progress page displays a failure with error code
0x800f0954.Solution: Windows Server 2025 systems currently use the Alibaba Cloud WSUS update source, which does not yet support feature updates for this OS version. For a solution, see How do I resolve the issue where .NET Framework 3.5 or a language pack fails to install on an instance that runs Windows Server 2012 R2 or later?.
Windows displays SSDs as HDDs
Symptoms:
After you create a Windows instance and attach an SSD cloud disk, Task Manager identifies the SSD cloud disk as an HDD.
Cause:
Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.
PS C:\Users\Administrator> Get-PhysicalDisk | Select-Object FriendlyName, MediaType
FriendlyName MediaType
------------ ---------
Red Hat VirtIO Unspecified
PS C:\Users\Administrator>Windows determines the disk type based on the MEDIUM ROTATION RATE value returned by the INQUIRY command. The driver must correctly report this value for the system to identify the disk as an SSD or an HDD. If the MEDIUM ROTATION RATE value is not reported, the system considers the type "Unspecified" and displays the default value, which is HDD. This display issue was a known bug in some Windows Server versions that Microsoft has since fixed in a patch.
Solution:
This cosmetic issue does not affect disk performance. It occurs because the virtio-blk driver cannot determine the disk type due to a protocol limitation, causing the OS to default to displaying the disk as an HDD.
TEMP and *.CHINA directories
Understanding the directories
administrator.CHINA: This is the user profile for a domain account. When a user with the username
Administratorlogs on to the machine for the first time through theCHINAdomain, the system automatically creates this directory to store personal data such as the desktop and documents. The.CHINAsuffix distinguishes the domain administrator from the local administrator.TEMP / TEMP.CHINA: This is a temporary user profile. When a user logs on, if the system cannot load their original user profile correctly, Windows creates a temporary user profile to allow the user to access the desktop.
Deletion guidelines
For administrator.CHINA (a normal domain account profile): If the directory does not contain important data and the domain administrator account no longer needs to log on to this machine, you can delete it after backing up its contents.
For TEMP / TEMP.CHINA (a temporary profile): If the user can now log on with their correct user profile, these leftover temporary directories can usually be deleted.
ImportantAlthough this is a temporary directory, files may have been unintentionally saved here during a previous logon session. To prevent data loss, back up the directory before deleting it.
How to safely delete user profiles
Open Control Panel, search for "advanced system settings", and then click View advanced system settings.
In the User Profiles section, click Settings.
From the list, select the profile to delete and click Delete.
Known issues for Linux operating systems
CentOS issues
CentOS 8.0: Public image naming issue
Symptoms: After you create a CentOS instance by using the centos_8_0_x64_20G_alibase_20200218.vhd public image, you connect to the instance and find that the system version is CentOS 8.1.
testuser@ecshost:~$ lsb_release -a LSB Version: :core-4.1-amd64:core-4.1-noarch Distributor ID: CentOS Description: CentOS Linux release 8.1.1911 (Core) Release: 8.1.1911 Codename: CoreCause: This public image was updated with the latest community packages, which upgraded its version to 8.1.
Affected image ID: centos_8_0_x64_20G_alibase_20200218.vhd.
Resolution: If you require CentOS 8.0, call the RunInstances API operation and set the
ImageIdparameter tocentos_8_0_x64_20G_alibase_20191225.vhdto create an ECS instance.
CentOS 7: Image ID change issues
Symptoms: The image IDs of some CentOS 7 public images have changed. This change may affect automated processes that depend on specific image IDs.
Affected images: CentOS 7.5 and CentOS 7.6
Cause: The latest versions of the CentOS 7.5 and CentOS 7.6 public images use the image ID format
%OS_Type%_%Major_Version%_%Minor_Version%_%Special_Field%_alibase_%Date%.%Format%. For example, the image ID prefix for CentOS 7.5 is updated fromcentos_7_05_64tocentos_7_5_x64. You must adjust your automated O&M policies accordingly. For more information about image IDs, see 2023.
CentOS 7: Hostname case changes after restart
Symptoms: On some CentOS 7 instances, uppercase letters in a hostname are converted to lowercase after the first restart.
Example hostname
Example after first restart
Remains lowercase
iZm5e1qe*****sxx1ps5zX
izm5e1qe*****sxx1ps5zx
Yes
ZZHost
zzhost
Yes
NetworkNode
networknode
Yes
Affected images: The following CentOS public images and any custom images created from them.
centos_7_2_64_40G_base_20170222.vhd
centos_7_3_64_40G_base_20170322.vhd
centos_7_03_64_40G_alibase_20170503.vhd
centos_7_03_64_40G_alibase_20170523.vhd
centos_7_03_64_40G_alibase_20170625.vhd
centos_7_03_64_40G_alibase_20170710.vhd
centos_7_02_64_20G_alibase_20170818.vhd
centos_7_03_64_20G_alibase_20170818.vhd
centos_7_04_64_20G_alibase_201701015.vhd
Affected applications: If your application is sensitive to hostname case, its services may be affected by an instance restart. Use the following table to determine if you are affected.
Hostname type
Affected?
When affected
Action required?
The hostname contains uppercase letters when the instance is created in the console or by using an API.
Yes
On the first instance restart
Yes
The hostname contains only lowercase letters when the instance is created in the console or by using an API.
No
N/A
No
The hostname contains uppercase letters, and you modify the hostname after you log on to the instance.
No
N/A
Yes
Resolution: To retain uppercase letters in the hostname after a restart, follow these steps.
Connect to the instance remotely.
For more information, see Connection methods.
View the current hostname.
[testuser@izbp193*****3i161uynzzx ~]# hostname izbp193*****3i161uynzzxRun the following command to make the hostname persistent.
hostnamectl set-hostname --static iZbp193*****3i161uynzzXRun the following command to view the updated hostname.
[testuser@izbp193*****3i161uynzzx ~]# hostname iZbp193*****3i161uynzzX
Next steps: If you use a custom image, update cloud-init to the latest version and then create a new custom image. This prevents the issue from occurring in new instances created from the image. For more information, see Install cloud-init and Create a custom image from an instance.
CentOS 6.8: NFS Client instance crash
Symptoms: A CentOS 6.8 instance with the NFS client loaded may hang, requiring a restart to recover.
Cause: When you use the NFS service with a kernel version from 2.6.32-696 to 2.6.32-696.10, the kernel nfsclient proactively disconnects the TCP connection if a communication latency glitch occurs. If the NFS server is slow to respond, the connection initiated by the nfsclient may get stuck in the FIN_WAIT2 state. Normally, a connection in the FIN_WAIT2 state times out and is reclaimed after one minute, allowing the nfsclient to reinitiate the connection. However, due to a defect in the TCP implementation of these kernel versions, the connection in the FIN_WAIT2 state never times out. As a result, the TCP connection of the nfsclient can never be closed, which blocks new connections and causes user requests to hang indefinitely. Restarting the ECS instance is the only way to recover.
Affected image IDs: centos_6_08_32_40G_alibase_20170710.vhd and centos_6_08_64_20G_alibase_20170824.vhd.
Resolution: Run the yum update command to upgrade the system kernel to version 2.6.32-696.11 or later.
ImportantBefore you perform operations on an instance, create a snapshot to back up your data. For more information, see Create a snapshot for a disk.
Ubuntu issues
Ubuntu 5.15 kernel: Disk hot-unplug triggers hung task
Symptoms: When you hot-unplug a disk from an instance that runs Ubuntu kernel version 5.15.0-144-generic, a hung task may be intermittently triggered with a timeout of about 120 seconds. Common stuck processes include:
kworker(ACPI hot-plug thread)udev-worker(device event handler process)
Cause: This issue is caused by a logical flaw in the kernel's
del_gendisk()function.
A race condition between freezing the queue and releasing the sysfs reference leads to an ABBA deadlock.The
kworkerprocess holds the queue freeze lock and waits for the sysfs reference to be released.The
udev-workerprocess holds the sysfs reference and waits for the queue to be unfrozen or to exit.
Because the kernel does not set the
QUEUE_FLAG_DYINGflag,blk_queue_enter()cannot exit, which results in a deadlock.Resolution:
Method 1: Upgrade the kernel (Recommended)
Upgrade to a kernel version that includes the fix (5.19 or later, or a distribution kernel that includes the patch).
Method 2: Apply a patch (Temporary fix)
In the 5.15 kernel, modify the
del_gendisk()function by replacingblk_queue_start_drain(q);withblk_set_queue_dying(q);. This change sets theQUEUE_FLAG_DYINGflag, which allows pending I/O requests to exit promptly and prevents the deadlock.
Fedora CoreOS issues
Fedora CoreOS: Hostname not applied from custom images
Symptoms: When you create an ECS instance (Instance B) from a custom image that was created from another Fedora CoreOS instance (Instance A), the new hostname specified for Instance B is not applied. Instance B retains the hostname of Instance A.
For example, you have an ECS instance (
Instance A) that runs the Fedora CoreOS operating system and has the hostnametest001. You then use a custom image from this instance to create a new ECS instance (Instance B). During the creation process, you set the hostname ofInstance Btotest002. After you create and remotely connect toInstance B, the hostname ofInstance Bis stilltest001.Cause: The Fedora CoreOS public images provided by Alibaba Cloud use the official Ignition service for instance initialization. Ignition is a utility used by Fedora CoreOS and Red Hat Enterprise Linux CoreOS to manipulate disks during the initramfs phase of system startup. When an ECS instance starts for the first time, the
coreos-ignition-firstboot-complete.servicein Ignition checks for the existence of the /boot/ignition.firstboot file to determine whether to initialize the instance. If this empty file exists, Ignition proceeds with initialization, which includes configuring the hostname, and then deletes the /boot/ignition.firstboot file.Since the original Fedora CoreOS instance has been started at least once, the /boot/ignition.firstboot file is no longer present in the custom image. When you use this custom image to create a new ECS instance, Ignition does not run the initialization process on first boot, and the new hostname is not applied.
Resolution:
NoteBefore you proceed, create a snapshot of the instance to back up your data. This allows you to restore the cloud disk if an error occurs. For more information, see Create a snapshot for a disk.
Before you create a custom image from a Fedora CoreOS instance, use
rootpermissions to create the /ignition.firstboot file in the /boot directory:Remount /boot in read-write mode.
sudo mount /boot -o rw,remountCreate the /ignition.firstboot file.
sudo touch /boot/ignition.firstbootRemount /boot in read-only mode.
sudo mount /boot -o ro,remount
For more information about Ignition, see the Ignition Configuration Specification.
OpenSUSE issues
OpenSUSE 15: Startup hang after kernel update
Symptoms: After you upgrade the OpenSUSE kernel to
4.12.14-lp151.28.52-default, an instance may hang on startup on certain CPU types. The known affected CPU type isIntel® Xeon® CPU E5-2682 v4 @ 2.50GHz. The following is the call trace:[ 0.901281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 0.901281] CR2: ffffc90000d68000 CR3: 000000000200a001 CR4: 00000000003606e0 [ 0.901281] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.901281] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 0.901281] Call Trace: [ 0.901281] cpuidle_enter_state+0x6f/0x2e0 [ 0.901281] do_idle+0x183/0x1e0 [ 0.901281] cpu_startup_entry+0x5d/0x60 [ 0.901281] start_secondary+0x1b0/0x200 [ 0.901281] secondary_startup_64+0xa5/0xb0 [ 0.901281] Code: 6c 01 00 0f ae 38 0f ae f0 0f 1f 84 00 00 00 00 00 0f 1f 84 00 00 00 00 00 90 31 d2 65 48 8b 34 25 40 6c 01 00 48 89 d1 48 89 f0 <0f> 01 c8 0f 1f 84 00 00 00 00 00 0f 1f 84 00 00 00 00 00 ** **Cause: The new kernel version is incompatible with the CPU Microcode. For more information, see Bug 1162092.
Affected image: opensuse_15_1_x64_20G_alibase_20200520.vhd.
Solution: In the /boot/grub2/grub.cfg file, add the kernel parameter
idle=nomwaitto the line that starts withlinux. An example of the modification is as follows:menuentry 'openSUSE Leap 15.1' --class opensuse --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-20f5f35a-fbab-4c9c-8532-bb6c66ce****' { load_video set gfxpayload=keep insmod gzio insmod part_msdos insmod ext2 set root='hd0,msdos1' if [ x$feature_platform_search_hint = xy ]; then search --no-floppy --fs-uuid --set=root --hint='hd0,msdos1' 20f5f35a-fbab-4c9c-8532-bb6c66ce**** else search --no-floppy --fs-uuid --set=root 20f5f35a-fbab-4c9c-8532-bb6c66ce**** fi echo 'Loading Linux 4.12.14-lp151.28.52-default ...' linux /boot/vmlinuz-4.12.14-lp151.28.52-default root=UUID=20f5f35a-fbab-4c9c-8532-bb6c66ce**** net.ifnames=0 console=tty0 console=ttyS0,115200n8 splash=silent mitigations=auto quiet idle=nomwait echo 'Loading initial ramdisk ...' initrd /boot/initrd-4.12.14-lp151.28.52-default }
Red Hat Enterprise Linux issues
Red Hat Enterprise Linux 8: Kernel update failure
Symptoms: On a Red Hat Enterprise Linux 8 64-bit ECS instance, you run the yum update command to update the kernel and restart the instance. After the restart, you find that the kernel version remains unchanged.
Cause: In Red Hat Enterprise Linux 8 64-bit, the /boot/grub2/grubenv file that stores GRUB2 environment variables has an abnormal size. The file is not the standard 1,024 bytes, which causes the kernel update to fail.
Resolution: After updating the kernel, you must manually set the new version as the default for booting. Follow these steps:
Update the kernel.
yum update kernel -yObtain the kernel boot parameters of the current operating system.
grub2-editenv list | grep kerneloptsBack up the old /grubenv file.
mv /boot/grub2/grubenv /home/grubenv.bakGenerate a new /grubenv file.
grub2-editenv /boot/grub2/grubenv createSet the new kernel version as the default boot version.
In this example, the updated kernel version is
/boot/vmlinuz-4.18.0-305.19.1.el8_4.x86_64.grubby --set-default /boot/vmlinuz-4.18.0-305.19.1.el8_4.x86_64Set the kernel boot parameters.
Set the
kerneloptsparameter to the value that you obtained in step 2.grub2-editenv - set kernelopts="root=UUID=0dd6268d-9bde-40e1-b010-0d3574b4**** ro crashkernel=auto net.ifnames=0 vga=792 console=tty0 console=ttyS0,115200n8 noibrs nosmt"Restart the ECS instance to boot into the new kernel.
rebootWarningThe restart operation stops the instance for a short period of time and may interrupt services that are running on the instance. We recommend that you restart the instance during off-peak hours.
SUSE Linux Enterprise Server issues
SUSE Linux Enterprise Server: SMT Server connection failure
Symptoms: When you use a paid SUSE Linux Enterprise Server or SUSE Linux Enterprise Server for SAP image, you may encounter connection timeouts or other issues with the Subscription Management Tool (SMT) server. When you try to download or update components, an error message similar to one of the following is returned:
Registration server returned 'This server could not verify that you are authorized to access this service.' (500)
Problem retrieving the respository index file for service 'SMT-http_mirrors_cloud_aliyuncs_com' location ****
Affected images: SUSE Linux Enterprise Server, SUSE Linux Enterprise Server for SAP
Resolution: You must re-register and activate the SMT service.
Run the following commands in sequence to re-register and activate the SMT service.
SUSEConnect -d SUSEConnect --cleanup systemctl restart guestregisterRun the following command to verify the activation status of the SMT service.
SUSEConnect -sOutput similar to the following indicates that the SMT service is successfully activated.
[{"identifier":"SLES_SAP","version":"12.5","arch":"x86_64","status":"Registered"}]
SUSE Linux Enterprise Server 12 SP5: Startup hangs after kernel update
Symptoms: After you upgrade from a kernel version earlier than SUSE Linux Enterprise Server (SLES) 12 SP5 to SLES 12 SP5, or after you perform an intra-version kernel upgrade on SLES 12 SP5, an instance may hang on startup on certain CPU types. The known affected CPU types are
Intel® Xeon® CPU E5-2682 v4 @ 2.50GHzandIntel® Xeon® CPU E7-8880 v4 @ 2.20GHz. The following is the call trace:[ 0.901281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 0.901281] CR2: ffffc90000d68000 CR3: 000000000200a001 CR4: 00000000003606e0 [ 0.901281] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.901281] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 0.901281] Call Trace: [ 0.901281] cpuidle_enter_state+0x6f/0x2e0 [ 0.901281] do_idle+0x183/0x1e0 [ 0.901281] cpu_startup_entry+0x5d/0x60 [ 0.901281] start_secondary+0x1b0/0x200 [ 0.901281] secondary_startup_64+0xa5/0xb0 [ 0.901281] Code: 6c 01 00 0f ae 38 0f ae f0 0f 1f 84 00 00 00 00 00 0f 1f 84 00 00 00 00 00 90 31 d2 65 48 8b 34 25 40 6c 01 00 48 89 d1 48 89 f0 <0f> 01 c8 0f 1f 84 00 00 00 00 00 0f 1f 84 00 00 00 00 00 ** **Cause: The new kernel version is incompatible with the CPU Microcode.
Resolution: In the
/boot/grub2/grub.cfgfile, add the kernel parameteridle=nomwaitto the line that starts withlinux. The following provides an example of the modified file:menuentry 'SLES 12-SP5' --class sles --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-fd7bda55-42d3-4fe9-a2b0-45efdced****' { load_video set gfxpayload=keep insmod gzio insmod part_msdos insmod ext2 set root='hd0,msdos1' if [ x$feature_platform_search_hint = xy ]; then search --no-floppy --fs-uuid --set=root --hint='hd0,msdos1' fd7bda55-42d3-4fe9-a2b0-45efdced**** else search --no-floppy --fs-uuid --set=root fd7bda55-42d3-4fe9-a2b0-45efdced**** fi echo 'Loading Linux 4.12.14-122.26-default ...' linux /boot/vmlinuz-4.12.14-122.26-default root=UUID=fd7bda55-42d3-4fe9-a2b0-45efdced**** net.ifnames=0 console=tty0 console=ttyS0,115200n8 mitigations=auto splash=silent quiet showopts idle=nomwait echo 'Loading initial ramdisk ...' initrd /boot/initrd-4.12.14-122.26-default }
AnolisOS issues
AnolisOS 8.9 RHCK: Startup failure on ecs.ebmc8i/ebmg8i
Due to a compatibility issue between AnolisOS 8.9 RHCK and Intel QAT, the system crashes during startup on ecs.ebmc8i and ecs.ebmg8i instances. If you need to use AnolisOS 8 RHCK on these instance types, we recommend that you use AnolisOS 8.10 RHCK.
The following is an example of the kernel crash log triggered during startup:
[ 31.165923] BUG: unable to handle kernel NULL pointer dereference at 0000000000000020
[ 31.174877] PGD 80a74ee067 P4D 0
[ 31.178620] Oops: 0000 [#1] SMP NOPTI
[ 31.182761] CPU: 134 PID: 2746 Comm: systemd-udevd Not tainted 4.18.0-513.18.1.0.1.an8.x86_64 #1
[ 31.192672] Hardware name: Alibaba Alibaba Cloud ECS/Alibaba Cloud ECS, BIOS 3.0.ES.AL.P.087.05 04/07/2024
[ 31.192673] RIP: 0010:qat_rsa_exit_tfm+0x14/0x40 [intel_qat]
[ 31.209951] Code: 00 c7 83 80 00 00 00 00 00 00 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 0f 1f 44 00 00 53 48 8b 87 c5 00
[ 31.209952] RSP: 0018:ff5c35909f277ab8 EFLAGS: 00010282
[ 31.209954] RAX: 0000000000000000 RBX: ff2aa603110ee100 RCX: 0000000000000091
[ 31.209955] RDX: 0000000000000090 RSI: ff2aa603110ee140 RDI: ff2aa603110ee100
[ 31.209956] RBP: ff2aa603110ee100 R08: ff5c35909f277a88 R09: ff2aa603110ee000
[ 31.209957] R10: 0000000000000000 R11: 000000000006000c0 R12: ff2aa603110ee100
[ 31.255995] 4xxx 0001:ed:00.0: qat_dev1 started 9 acceleration engines
[ 31.261146] R13: ff2aa603110ee000 R14: ff5c35909f277b50 R15: ff5c35909f277b30
[ 31.261148] FS: 00007fb8e8256280(0000) GS:ff2aa6807fd80000(0000) knlGS:0000000000000000
[ 31.276913] WARNING: CPU: 175 PID: 0 at kernel/workqueue.c:1650 __queue_delayed_work+0x68/0x80
[ 31.284627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 31.293749] Modules linked in:
[ 31.303466] CR2: 0000000000000020 CR3: 00000080a8aaa003 CR4: 00000000000771ee0
[ 31.309953] iTCO_wdt
[ 31.313408] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 31.321457] pmt_crashlog
[ 31.324032] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[ 31.332282] pmt_telemetry
[ 31.335566] PKRU: 55555554
[ 31.343894] intel_sdsi
[ 31.347296] Call Trace:
[ 31.350659] iTCO_vendor_support
[ 31.353751] ? __die_body+0x1a/0x60
[ 31.356805] pmt_class
[ 31.360774] ? no_context+0x1ba/0x3f0
[ 31.360779] ? __bad_area_nosemaphore+0x16c/0x1c0
[ 31.360781] ? do_page_fault+0x37/0x12d
[ 31.365016] joydev
[ 31.368003] ? page_fault+0x1e/0x30
[ 31.372437] ipmi_ssif
[ 31.378064] ? qat_rsa_exit_tfm+0x14/0x40 [intel_qat]
[ 31.382679] intel_uncore
[ 31.385367] ? public_key_verify_signature+0x249/0x320
[ 31.389592] cdc_ether
[ 31.392570] crypto_destroy_tfm+0x40/0xc0
[ 31.398562] pcspkr
[ 31.401833] crypto_destroy_tfm+0x40/0xc0
[ 31.407910] usbnet
[ 31.410885] public_key_verify_signature+0x254/0x320Other issues
Startup call trace with recent kernels
Symptoms: A call trace may occur when you start certain instance types, such as ecs.i2.4xlarge, that run an operating system with a recent kernel version, such as RHEL 8.3 or CentOS 8.3 with kernel
4.18.0-240.1.1.el8_3.x86_64. The following provides an example of the call trace:Dec 28 17:43:45 localhost SELinux: Initializing. Dec 28 17:43:45 localhost kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes) Dec 28 17:43:45 localhost kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes) Dec 28 17:43:45 localhost kernel: Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes) Dec 28 17:43:45 localhost kernel: Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes) Dec 28 17:43:45 localhost kernel: unchecked MSR access error: WRMSR to 0x3a (tried to write 0x000000000000****) at rIP: 0xffffffff8f26**** (native_write_msr+0x4/0x20) Dec 28 17:43:45 localhost kernel: Call Trace: Dec 28 17:43:45 localhost kernel: init_ia32_feat_ctl+0x73/0x28b Dec 28 17:43:45 localhost kernel: init_intel+0xdf/0x400 Dec 28 17:43:45 localhost kernel: identify_cpu+0x1f1/0x510 Dec 28 17:43:45 localhost kernel: identify_boot_cpu+0xc/0x77 Dec 28 17:43:45 localhost kernel: check_bugs+0x28/0xa9a Dec 28 17:43:45 localhost kernel: ? __slab_alloc+0x29/0x30 Dec 28 17:43:45 localhost kernel: ? kmem_cache_alloc+0x1aa/0x1b0 Dec 28 17:43:45 localhost kernel: start_kernel+0x4fa/0x53e Dec 28 17:43:45 localhost kernel: secondary_startup_64+0xb7/0xc0 Dec 28 17:43:45 localhost kernel: Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 Dec 28 17:43:45 localhost kernel: Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 Dec 28 17:43:45 localhost kernel: FEATURE SPEC_CTRL Present Dec 28 17:43:45 localhost kernel: FEATURE IBPB_SUPPORT PresentCause: Community updates for these kernel versions include a patch that attempts to write to Model-Specific Registers (MSRs). However, some instance types, such as ecs.i2.4xlarge, run on a virtualization version that does not support MSR writes, which causes the call trace.
Resolution: You can safely ignore this call trace because it does not affect system operation or stability.
hfg6 instance family: Kernel incompatibility causes panic
Symptoms: On instances that belong to the hfg6 instance family, upgrading to a new kernel may cause a kernel panic on some Linux distributions, such as CentOS 8, SUSE Linux Enterprise Server 15 SP2, and OpenSUSE 15.2. The following is an example call trace:
[ 0.005000] apic_timer_interrupt+0xf/0x20 [ 0.005000] </IRQ> [ 0.005000] RIP: 0010:smp_call_functioxx [ 0.005000] Code: 8b 4c 24 38 65 48 3xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx 3 e2 01 75 f5 eb ca 8b 05 b1 37 c0 01 85 xxx [ 0.005000] RSP: 000xxx cfd80 EFLAGS: 00xxx ORIG_RAX: ffxxx [ 0.005000] RAX: 000xxx RBX: fffxxx RCX: 00000000 [ 0.005000] RDX: 000xxx RSI: 000xxx RDI: 00000000 [ 0.005000] RBP: fffxxx R08: 000xxx R09: 00000000 [ 0.005000] R10: fffxxx R11: 000xxx R12: 00000000 [ 0.005000] R13: fffxxx R14: 000xxx R15: ffffffff [ 0.005000] ? sort_range+0x20/0x20 [ 0.005000] ? poke_int3_handler+0xe0/0xe0 [ 0.005000] ? poke_int3_handler+0xe0/0xe0 [ 0.005000] ? poke_int3_handler+0xe0/0xe0 [ 0.005000] on_each_cpu+0x28/0x60 [ 0.005000] text_poke_bp_batch+0xcd/0x160 [ 0.005000] ? set_rq_offline+0x60/0x60 [ 0.005000] arch_jump_label_transform_apply+0x2e/0x50 [ 0.005000] static_key_slow_inc_cpuslocked+0x88/0x90 [ 0.005000] sched_cpu_activate+0xf1/0x100 [ 0.005000] ? refresh_zone_stat_thresholds+0x140/0x140 [ 0.005000] cpuhp_invoke_callback+0x8d/0x500 [ 0.005000] ? sort_range+0x20/0x20 [ 0.005000] cpuhp_thread_fun+0xb0/0x110 [ 0.005000] smpboot_thread_fn+0xc5/0x160 [ 0.005000] kthread+0x112/0x130 [ 0.005000] ? kthread_flush_work_fn+0x10/0x10 [ 0.005000] ret_from_fork+0x35/0x40 [ 0.005000] Modules linked in: [ 0.005000] ---[ end trace 79c5ba462cfc4c1b ]--- [ 0.005000] RIP: 0010:arch_scale_freq_tick+0x67/0x7eCause: A compatibility issue exists between the hfg6 instance family and some Linux kernel versions.
Resolution:
The latest kernel versions for SUSE Linux Enterprise Server 15 SP2 and OpenSUSE 15.2 include a fix for this issue. If your kernel includes the following commits, it is compatible with the hfg6 instance family.
commit 1e33d5975b49472e286bd7002ad0f689af33fab8 Author: Giovanni Gherdovich <ggherdovich@suse.cz> Date: Thu Sep 24 16:51:09 2020 +0200 x86, sched: Bail out of frequency invariance if turbo_freq/base_freq gives 0 (bsc#1176925). suse-commit: a66109f44265ff3f3278fb34646152bc2b3224a5 commit dafb858aa4c0e6b0ce6a7ebec5e206f4b3cfc11c Author: Giovanni Gherdovich <ggherdovich@suse.cz> Date: Thu Sep 24 16:16:50 2020 +0200 x86, sched: Bail out of frequency invariance if turbo frequency is unknown (bsc#1176925). suse-commit: 53cd83ab2b10e7a524cb5a287cd61f38ce06aab7 commit 22d60a7b159c7851c33c45ada126be8139d68b87 Author: Giovanni Gherdovich <ggherdovich@suse.cz> Date: Thu Sep 24 16:10:30 2020 +0200 x86, sched: check for counters overflow in frequency invariant accounting (bsc#1176925).For CentOS 8, if you run the yum update command to upgrade to kernel version
kernel-4.18.0-240or later on an instance from the hfg6 instance family, a kernel panic may occur. If this happens, roll back to the previous kernel version.
pip: Request timeouts
Symptoms: pip requests occasionally time out or fail.
Affected images: CentOS, Debian, Ubuntu, SUSE, OpenSUSE, and Alibaba Cloud Linux.
Cause: Alibaba Cloud provides the following pip source endpoints. The default endpoint, mirrors.aliyun.com, requires a public internet connection. If your instance does not have a public IP address, pip requests may time out.
(Default) Public network: mirrors.aliyun.com
VPC internal network: mirrors.cloud.aliyuncs.com
Resolution: Use one of the following methods to resolve the issue.
Method 1
Assign a public IP address to your instance by associating an Elastic IP (EIP) address. For more information, see Associate an EIP with an instance.
For subscription instances, you can also assign a new public IP address when you change the instance type.
Method 2
If pip responses are delayed, run the fix_pypi.sh script on the ECS instance and retry the operation. Follow these steps:
Connect to the instance remotely.
For more information, see Connect to an instance by using a VNC client.
Run the following command to download the script file.
wget http://image-offline.oss-cn-hangzhou.aliyuncs.com/fix/fix_pypi.shRun the script.
For instances in a VPC, run the command
bash fix_pypi.sh "mirrors.cloud.aliyuncs.com".Retry the pip operation.
The fix_pypi.sh script contains the following:
#!/bin/bash function config_pip() { pypi_source=$1 if [[ ! -f ~/.pydistutils.cfg ]]; then cat > ~/.pydistutils.cfg << EOF [easy_install] index-url=http://$pypi_source/pypi/simple/ EOF else sed -i "s#index-url.*#index-url=http://$pypi_source/pypi/simple/#" ~/.pydistutils.cfg fi if [[ ! -f ~/.pip/pip.conf ]]; then mkdir -p ~/.pip cat > ~/.pip/pip.conf << EOF [global] index-url=http://$pypi_source/pypi/simple/ [install] trusted-host=$pypi_source EOF else sed -i "s#index-url.*#index-url=http://$pypi_source/pypi/simple/#" ~/.pip/pip.conf sed -i "s#trusted-host.*#trusted-host=$pypi_source#" ~/.pip/pip.conf fi } config_pip $1