[Intel-SIG] Backport multifd live migration acceleration using HW accelerators · Pull Request !52 · anolis/qemu-kvm

# Description
This PR is to backport upstream patches for multifd live migration acceleration by using Intel IAA, QAT accelerators.

# Test
- “make check-unit && make check-qtest" PASS, no new failure is seen, and all 49 migration sub-tests PASS.
- Migrate using tcp, with various multifd mechanisms (qpl, qatzip, no-comp, zstd, zlib), run memory stress test in VM, and compare src vs. dst VM memory after migration. PASS
- Migrate using tcp, with legacy method (non multifd mechanism), run memory stress test in VM, compare src vs. dst VM memory after migration. PASS.
- Migrate using unix socket, with multifd method, run memory stress test in VM, and compare src vs. dst memory after migration. PASS. 
- Migrate using unix socket, with legacy method, run memory stress test in VM, and compare src vs. dst memory after migration. PASS. 
- Migrate using "exec:" mechanism by following method. PASS
    SRC: migrate "exec:gzip -c > STATEFILE.gz"
    DST: -incoming "exec: gzip -c -d STATEFILE.gz"

# Code Conflict Resolving Details
The following are the details for how code conflicts are resolved.
They are also recorded in commit message of each commit if there is conflict in that commit.

```
6c0dc352e6ff tests/qtest/migration: Use the new migration_test_add

[jz: resolve context conflicts due to live-suspend which is not backported]

20c73ce9a664 docs/migration: Create index page

[jz: resolve simple context conflict]

7e74a8c4a32e migration/multifd: Move multifd_send_setup into migration thread

[jz: upstream renamed qemu_mutex_lock_iothread() to bql_lock(), while
         we havenot yet. Resolve context conflict due to this]

c1a7d223d048 migration/multifd: Allow multifd without packets

[jz: make multifd_use_packet to always return true, since mapped-ram
         is not backported]

f26d12b6de65 migration/multifd: Add new migration option zero-page-detection.

[jz: resolve simple context conflicts]

9bd737ed2bf8 migration/multifd: Implement zero page transmission on the multifd thread.

[jz: there is no multifd_set_file_bitmap() because we didn't backport
         mapped-ram, so abandon changes in multifd_set_file_bitmap()]

1a5e7d9d1c12 migration/multifd: solve zero page causing multiple page faults

[jz: resolve context conflict due to mmaped-ram which is not backported]

a594a8ade977 docs/migration: add qpl compression feature

[jz: resolve simple context conflict]

6970d3b0616b tests/migration-test: add qpl compression test

[jz: resolve simple context conflict]

72a68fd234f4 docs/migration: add qatzip compression feature

[jz: resolve context conflict due to uadk which is not backported]

a7fbc45c7831 meson: Introduce 'qatzip' feature to the build system

[jz: resolve simple context conflicts]

458a130bbebc migration: Introduce 'qatzip' compression method

[jz: resolve context conflicts due to uadk which is not backported]

5c86088a1f9c migration/multifd: Fix rb->receivedmap cleanup race

[jz: resolve context conflict due to non-multifd compression which is
         already deleted in upstream while still in anolis]

dc83b3eec1d4 migration/multifd: Fix loop conditions in multifd_zstd_send_prepare and multifd_zstd_recv

[jz: resolve context conflict due to p->page which not renamed to page yet]

77987d9d6ef1 migration/multifd: Ensure packet->ramblock is null-terminated

[jz: upstream has split nocomp code into multifd-nocomp.c, while
         we havenot yet.  The function that needs to be fixed is
         still named multifd_send_fill_packet in multifd.c, so we fix
         it in multifd.c]

d9fbf1bcec83 migration/multifd: Zero p->flags before starting filling a packet

[jz: resolve simple context conflict]

73b540ec9c69 multifd: bugfix for migration using compression methods

[jz: upstream has split nocomp code into multifd-nocomp.c, while
         we havenot yet. The function that needs to be fixed is still
         in multifd.c, so we fix it in multifd.c]

07c4c3f072e3 (HEAD -> lm-acc-anolis) multifd: bugfix for incorrect migration data with qatzip compression

[jz: resolve simple context conflict]

```

类型	指派人员	状态
审查	guobin 已审查通过 shannon.zhao 已审查通过冯光辉已审查通过	已完成 (3/1人)
测试	guobin 已测试通过 shannon.zhao 已测试通过	已完成 (2/1人)

anolis/qemu-kvm .gitee-modal { width: 500px !important; }

搜索帮助

anolis/qemu-kvm