Difference between revisions of "Migrating between architectures"
(→Install kernel (64-bit): make the reboot step explicit) |
(→Troubleshooting) |
||
(29 intermediate revisions by 12 users not shown) | |||
Line 1: | Line 1: | ||
− | [[Category:Arch64 | + | [[Category:Arch64]] |
− | [[Category:Getting and installing Arch | + | [[Category:Getting and installing Arch]] |
− | |||
[[fr:Migration 64 bits]] | [[fr:Migration 64 bits]] | ||
− | This page documents two potential methods of migrating installed systems between i686 (32-bit) and x86_64 (64-bit) architectures, in either direction. The methods avoid reinstalling the entire system. One method uses a liveCD, the other modifies the system from within | + | [[zh-CN:Migrating Between Architectures Without Reinstalling]] |
+ | This page documents two potential methods of migrating installed systems between i686 (32-bit) and x86_64 (64-bit) architectures, in either direction. The methods avoid reinstalling the entire system. One method uses a liveCD, the other modifies the system from within. | ||
{{Warning|Unless explicitly stated, all these methods are UNTESTED and may irreparably damage your system. Continue at your own risk.}} | {{Warning|Unless explicitly stated, all these methods are UNTESTED and may irreparably damage your system. Continue at your own risk.}} | ||
Line 47: | Line 47: | ||
# Configure your network on the LiveCD, then pacman to use your new architecture repos | # Configure your network on the LiveCD, then pacman to use your new architecture repos | ||
# Mount your existing installation to {{ic|/mnt}} directory. For example: {{ic|mount /dev/sda1 /mnt}} | # Mount your existing installation to {{ic|/mnt}} directory. For example: {{ic|mount /dev/sda1 /mnt}} | ||
− | # Use the following script to update the local pacman database, get a list of all your installed packages and then reinstall them | + | # Use the following script to update the local pacman database, get a list of all your installed packages and then reinstall them. |
+ | # You should probably run the script twice, because many packages fail to run their post-install scripts first time. This is due to sed, grep, perl, etc. being of the wrong architecture. | ||
+ | # You might also need to update the initrd, chroot into /mnt and run mkinitcpio -p linux. | ||
#!/bin/bash | #!/bin/bash | ||
Line 55: | Line 57: | ||
pacman --root $MOUNTED_INSTALL -Sy | pacman --root $MOUNTED_INSTALL -Sy | ||
− | pacman --root $MOUNTED_INSTALL - | + | pacman --root $MOUNTED_INSTALL --cachedir $MOUNTED_INSTALL/var/cache/pacman/pkg --noconfirm -Sg base base-devel |
− | + | pacman --root $MOUNTED_INSTALL -Qq > $TEMP_FILE | |
for PKG in $(cat $TEMP_FILE) ; do | for PKG in $(cat $TEMP_FILE) ; do | ||
− | pacman --root $MOUNTED_INSTALL - | + | pacman --root $MOUNTED_INSTALL --cachedir $MOUNTED_INSTALL/var/cache/pacman/pkg --noconfirm -S $PKG |
done | done | ||
exit 0 | exit 0 | ||
+ | |||
+ | After rebooting to your new 64-bit system, run this command to find out what 32-bit binaries you still have and reinstall them: | ||
+ | |||
+ | find /usr/bin -type f -exec bash -c 'file {} | grep 32-bit' \; | ||
== Method 2: From a running system == | == Method 2: From a running system == | ||
+ | |||
+ | Ensure that your system is fully updated and functioning before proceeding. | ||
+ | # pacman -Syu | ||
=== Package preparation === | === Package preparation === | ||
Line 73: | Line 82: | ||
If you do not have all your installed packages in your cache, download them (for the old architecture) for fallback purposes. | If you do not have all your installed packages in your cache, download them (for the old architecture) for fallback purposes. | ||
− | # pacman -Sw $(comm -23 <(pacman -Qq) <(pacman -Qmq)) | + | # pacman -Sw $(comm -23 <(pacman -Qq|sort) <(pacman -Qmq|sort)) |
or use bacman from pacman-contrib package to generate them. | or use bacman from pacman-contrib package to generate them. | ||
+ | |||
+ | The command above redownloads ALL packages, even the ones already in the cache. This script only downloads the ones not in the cache: | ||
+ | #!/bin/bash | ||
+ | |||
+ | cache=`pacman -v 2>/dev/null|grep "Cache Dirs"|cut -d ':' -f 2| sed 's/ //g'` | ||
+ | |||
+ | for pkg in `comm -23 <(pacman -Qq|sort) <(pacman -Qmq|sort)` | ||
+ | do | ||
+ | if ! ls $cache/`pacman -Q $pkg|sed 's/ /-/g'`* 2>/dev/null >&2;then | ||
+ | echo 'Y'|pacman -Sw $pkg | ||
+ | fi | ||
+ | done | ||
If you are migrating away from 32 bits, now is the time to install 32-bit Busybox: | If you are migrating away from 32 bits, now is the time to install 32-bit Busybox: | ||
Line 87: | Line 108: | ||
For x86_64: | For x86_64: | ||
− | # sed -i | + | # sed -i '/^Architecture =/s/auto/x86_64/' /etc/pacman.conf |
and for i686: | and for i686: | ||
− | # sed -i | + | # sed -i '/^Architecture =/s/auto/i686/' /etc/pacman.conf |
− | + | Make sure the server lists in ''/etc/pacman.conf'' and ''/etc/pacman.d/mirrorlist'' use ''$arch'' instead of explicitly specifying ''i686'' or ''x86_64''. Now force Pacman to synchronize with the new repositories: | |
− | + | # pacman -Syy # force sync new architecture repositories | |
− | # pacman - | ||
==== Download new packages ==== | ==== Download new packages ==== | ||
Line 104: | Line 124: | ||
# pacman -Sw $(pacman -Qq|sed '/^lib32-/ d') # download new package versions | # pacman -Sw $(pacman -Qq|sed '/^lib32-/ d') # download new package versions | ||
− | If there are some packages that cannot be downloaded, | + | If there are some packages, likely from the AUR, that cannot be downloaded, remove them from the list generated by pacman -Qq. |
+ | |||
+ | # pacman -Sw $(comm <(pacman -Qq|sed '/^lib32-/ d'|sort) <(pacman -Qqm|sort) -23) | ||
If migrating to 32 bits, install the 32-bit Busybox fallback now that Pacman has been configured with the 32-bit architecture: | If migrating to 32 bits, install the 32-bit Busybox fallback now that Pacman has been configured with the 32-bit architecture: | ||
Line 110: | Line 132: | ||
# pacman -S busybox | # pacman -S busybox | ||
− | + | {{Warning|Don't install the ''lib32-glibc'' package now. After a ''ldconfig'', when you install ''linux'', the generated image will have libraries like ''librt.so'' in ''/usr/lib32'', where binaries during boot won't search, resulting in a boot failure.}} | |
− | |||
− | |||
=== Package installation === | === Package installation === | ||
Line 123: | Line 143: | ||
# pacman -S linux | # pacman -S linux | ||
+ | |||
+ | Now is the time to install the ''lib32-glibc'' fallback (you will need to add the ''[multilib]'' repository in pacman.conf if you have not already): | ||
+ | |||
+ | # pacman -S lib32-glibc | ||
+ | |||
+ | {{Note|If this fails due to an existing file of a differently named package, use pacman's {{ic|-f}} flag.}} | ||
Reboot and verify it is running the x86_64 architecture: | Reboot and verify it is running the x86_64 architecture: | ||
Line 130: | Line 156: | ||
==== Console terminal ==== | ==== Console terminal ==== | ||
− | This is the time to switch to a text-mode virtual console (e.g. Ctrl+Alt+F1) for the rest of the process. | + | This is the time to switch to a text-mode virtual console (e.g. Ctrl+Alt+F1) for the rest of the process, if possible. Pseudo-terminals like SSH should work, but direct access is recommended as a precaution. There will be several packages removed and replaced during the update process that may cause X11 desktops to become unstable and leave your system in an unbootable state. |
==== Install Pacman ==== | ==== Install Pacman ==== | ||
Line 136: | Line 162: | ||
{{Warning|Once you start updating pacman and its dependencies it can not be interrupted. Pacman and all of its dependencies must be installed at the same time in a single command line.}} | {{Warning|Once you start updating pacman and its dependencies it can not be interrupted. Pacman and all of its dependencies must be installed at the same time in a single command line.}} | ||
− | + | Use pactree to install Pacman and all its dependencies: | |
# pactree -l pacman | pacman -S - | # pactree -l pacman | pacman -S - | ||
− | Immediately following this command only Busybox, Bash and Pacman will be executable until the other packages are migrated below. You must not reboot your system until the following commands have been completed. You have been warned. | + | Errors may be printed but they will not cause a problem as long as Pacman works. Immediately following this command only Busybox, Bash and Pacman will be executable until the other packages are migrated below. You must not reboot your system until the following commands have been completed. You have been warned. |
==== Install remaining packages ==== | ==== Install remaining packages ==== | ||
Line 148: | Line 174: | ||
# pacman -S $(pacman -Qq) | # pacman -S $(pacman -Qq) | ||
− | For migration away from 64 bits, you may want to skip installing a 32-bit kernel in the | + | If some packages didn't install correctly, you should now be able to reinstall them successfully; if you're lazy, you can just re-run the last command to reinstall everything. |
+ | |||
+ | For migration away from 64 bits, you may want to skip installing a 32-bit kernel in the commands above, since the old 64-bit kernel will still run 32-bit programs. | ||
After this step the migration in either direction should be complete and it should be safe to reboot the computer. | After this step the migration in either direction should be complete and it should be safe to reboot the computer. | ||
Line 183: | Line 211: | ||
# /lib/ld-linux.so.2 /bin/ls | # /lib/ld-linux.so.2 /bin/ls | ||
+ | |||
+ | === KDE doesn't start after switching from 32bit to 64bit === | ||
+ | |||
+ | KDE will crash when starting after switching from 32bit to 64bit. The cause are some leftover cached files from the 32 bit KDE packages in /var/tmp To fix this remove all kdecache folders in with | ||
+ | |||
+ | # rm -rf /var/tmp/kdecache-* | ||
+ | |||
+ | === Mutt issues with cache enabled === | ||
+ | |||
+ | If, after completion, you find that mutt hangs on opening mail folders, try renaming the cache directory. If this works, the renamed one can be deleted as mutt will have recreated a new one. | ||
==See also== | ==See also== | ||
*[[Migrate installation to new hardware]] | *[[Migrate installation to new hardware]] |
Revision as of 12:58, 28 February 2013
zh-CN:Migrating Between Architectures Without Reinstalling This page documents two potential methods of migrating installed systems between i686 (32-bit) and x86_64 (64-bit) architectures, in either direction. The methods avoid reinstalling the entire system. One method uses a liveCD, the other modifies the system from within.
Contents
General preparation
Confirm 64-bit architecture
If you are already running x86_64 but want to install i686 this is not relevant and you can skip this step.
In order to run 64-bit software, you must have a 64-bit capable CPU. Most modern CPUs are capable of running 64-bit software. You may check your CPU with the following command:
grep --color '\<lm\>' /proc/cpuinfo
For CPUs that support x86_64, this will return the lm
flag (“long mode”) highlighted. Beware that lahf_lm is a different flag and does not indicate 64-bit capability itself.
Disk space
You should be prepared for /var/cache/pacman/pkg
to grow approximately twice its current size during the migration. This is assumes only packages that are currently installed are in the cache, as if “pacman -Sc” (clean) was recently run. The disk space increase is due to duplication between the i686 and x86_64 versions of each package.
If you have not enough disk, please use gparted to resize the relevant partition, or mount another partition to /var/cache/pacman.
Please do not remove packages of the old architecture from the cache until the system is fully operating in the new architecture. Removing the packages too early may leave you unable to fall back and revert changes.
Power supply
The migration may take a substantial amount of time, and it would be inconvenient to interrupt the process. You should plan on at least an hour, depending on the number and size of your installed packages and internet connection speed (although you can download everything before starting the critical part). Please make sure you are connected to a stable power source, preferably with some sort of failover or battery backup.
Fallback packages
If the migration fails halfway through, there are packages that can help sort out the situation, but they should be installed before the main packages are migrated. More details about using them under #Troubleshooting below.
One package is busybox, which can be used to revert changes. It is statically linked and does not depend on any libraries. The 32-bit (i686) version should be installed, using
# pacman -S busybox
Another package is lib32-glibc, from the Multilib x86_64 repository. It is probably only useful when migrating away from 32 bits; in any case you may safely skip this package. You can use the package to run 32 bit programs by explicitly calling /lib/ld-linux.so.2
. Install with:
# pacman -S lib32-glibc
Method 1: Utilising the Arch LiveCD
- Download, burn and boot the 64-bit Arch ISO LiveCD
- Configure your network on the LiveCD, then pacman to use your new architecture repos
- Mount your existing installation to
/mnt
directory. For example:mount /dev/sda1 /mnt
- Use the following script to update the local pacman database, get a list of all your installed packages and then reinstall them.
- You should probably run the script twice, because many packages fail to run their post-install scripts first time. This is due to sed, grep, perl, etc. being of the wrong architecture.
- You might also need to update the initrd, chroot into /mnt and run mkinitcpio -p linux.
#!/bin/bash MOUNTED_INSTALL='/mnt' TEMP_FILE='/tmp/packages.list' pacman --root $MOUNTED_INSTALL -Sy pacman --root $MOUNTED_INSTALL --cachedir $MOUNTED_INSTALL/var/cache/pacman/pkg --noconfirm -Sg base base-devel pacman --root $MOUNTED_INSTALL -Qq > $TEMP_FILE for PKG in $(cat $TEMP_FILE) ; do pacman --root $MOUNTED_INSTALL --cachedir $MOUNTED_INSTALL/var/cache/pacman/pkg --noconfirm -S $PKG done exit 0
After rebooting to your new 64-bit system, run this command to find out what 32-bit binaries you still have and reinstall them:
find /usr/bin -type f -exec bash -c 'file {} | grep 32-bit' \;
Method 2: From a running system
Ensure that your system is fully updated and functioning before proceeding.
# pacman -Syu
Package preparation
Cache old packages
pacman -Rsn package_name
.If you do not have all your installed packages in your cache, download them (for the old architecture) for fallback purposes.
# pacman -Sw $(comm -23 <(pacman -Qq|sort) <(pacman -Qmq|sort))
or use bacman from pacman-contrib package to generate them.
The command above redownloads ALL packages, even the ones already in the cache. This script only downloads the ones not in the cache:
#!/bin/bash cache=`pacman -v 2>/dev/null|grep "Cache Dirs"|cut -d ':' -f 2| sed 's/ //g'` for pkg in `comm -23 <(pacman -Qq|sort) <(pacman -Qmq|sort)` do if ! ls $cache/`pacman -Q $pkg|sed 's/ /-/g'`* 2>/dev/null >&2;then echo 'Y'|pacman -Sw $pkg fi done
If you are migrating away from 32 bits, now is the time to install 32-bit Busybox:
# pacman -S busybox
Change Pacman architecture
Edit the /etc/pacman.conf file and change Architecture from auto
to the new value. These sed commands may be used:
For x86_64:
# sed -i '/^Architecture =/s/auto/x86_64/' /etc/pacman.conf
and for i686:
# sed -i '/^Architecture =/s/auto/i686/' /etc/pacman.conf
Make sure the server lists in /etc/pacman.conf and /etc/pacman.d/mirrorlist use $arch instead of explicitly specifying i686 or x86_64. Now force Pacman to synchronize with the new repositories:
# pacman -Syy # force sync new architecture repositories
Download new packages
Download the new architecture versions of all our currently installed packages:
# pacman -Sw $(pacman -Qq|sed '/^lib32-/ d') # download new package versions
If there are some packages, likely from the AUR, that cannot be downloaded, remove them from the list generated by pacman -Qq.
# pacman -Sw $(comm <(pacman -Qq|sed '/^lib32-/ d'|sort) <(pacman -Qqm|sort) -23)
If migrating to 32 bits, install the 32-bit Busybox fallback now that Pacman has been configured with the 32-bit architecture:
# pacman -S busybox
Package installation
Install kernel (64-bit)
Upgrading the kernel to 64 bits (x86_64) is safe and straightforward: 32 bit and 64 bit applications run equally well under a 64-bit kernel. For migration away from 64 bits, leave the 64-bit kernel installed and running for now and skip this step.
To install the standard Arch Linux kernel, use the following command:
# pacman -S linux
Now is the time to install the lib32-glibc fallback (you will need to add the [multilib] repository in pacman.conf if you have not already):
# pacman -S lib32-glibc
-f
flag.Reboot and verify it is running the x86_64 architecture:
$ uname -m
x86_64
Console terminal
This is the time to switch to a text-mode virtual console (e.g. Ctrl+Alt+F1) for the rest of the process, if possible. Pseudo-terminals like SSH should work, but direct access is recommended as a precaution. There will be several packages removed and replaced during the update process that may cause X11 desktops to become unstable and leave your system in an unbootable state.
Install Pacman
Use pactree to install Pacman and all its dependencies:
# pactree -l pacman | pacman -S -
Errors may be printed but they will not cause a problem as long as Pacman works. Immediately following this command only Busybox, Bash and Pacman will be executable until the other packages are migrated below. You must not reboot your system until the following commands have been completed. You have been warned.
Install remaining packages
Install all of the previously downloaded replacements for the new architecture. (Go get a drink and make a sandwich; this could take a while.)
# pacman -S $(pacman -Qq)
If some packages didn't install correctly, you should now be able to reinstall them successfully; if you're lazy, you can just re-run the last command to reinstall everything.
For migration away from 64 bits, you may want to skip installing a 32-bit kernel in the commands above, since the old 64-bit kernel will still run 32-bit programs.
After this step the migration in either direction should be complete and it should be safe to reboot the computer.
Cleanup
You are now free to remove Busybox and lib32-glibc.
# pacman -Rcn busybox lib32-glibc
Makepkg compiler flags
During the upgrade the new version of /etc/makepkg.conf
may be stored as /etc/makepkg.conf.pacnew
. You will have to replace the old version or modify it, if you want to compile anything with makepkg in the future.
# mv /etc/makepkg.conf /etc/makepkg.conf.backup && mv /etc/makepkg.conf.pacnew /etc/makepkg.conf
It might also be a good idea to just get a list of "new" additions to /etc
. You can get a list with the following command:
# find /etc/ -type f -name \*.pac\*
Troubleshooting
During the upgrade, when glibc is replaced by the new architecture version, old architecture versions of many programs will not run. If problems occur, you can solve them with busybox and lib32-glibc.
Busybox
In Arch, Busybox is statically linked; it can run without any libraries. There are many commands available to you. For example, to extract an i686 version of Pacman from a cached package:
# busybox tar xf /var/cache/pacman/pkg/pacman-3.3.2-1-i686.pkg.tar.gz -C <some folder>
Lib32-glibc
Example run 32 bit /bin/ls
:
# /lib/ld-linux.so.2 /bin/ls
KDE doesn't start after switching from 32bit to 64bit
KDE will crash when starting after switching from 32bit to 64bit. The cause are some leftover cached files from the 32 bit KDE packages in /var/tmp To fix this remove all kdecache folders in with
# rm -rf /var/tmp/kdecache-*
Mutt issues with cache enabled
If, after completion, you find that mutt hangs on opening mail folders, try renaming the cache directory. If this works, the renamed one can be deleted as mutt will have recreated a new one.