[Draft] cc rebase #1310

This series of changes aim to create a common base for running different CC architectures, and the updates will involve: 1)private and shared memory isolation. 2)hypercalls update for using shared memory. 3)vm initialization flow update. 4)use one more vcpu to handle io and scheduling inside kernel.

Now cc_all and cc_debug can compile with cc feature.

In normal vm, there is the common heap and an additional IO heap if enabled EnableIOBuf config. In cc, there are 4 heaps: 1)shared heap: qkernel stores in it the shared data(IObuffer, sharedspace etc.), then qvisor uses it after vm is launched. 2)IO heap: considered as shared heap here, used if enabled EnableIOBuf config. 3)guest private heap: qvisor stores necessary data during initialization (initial pagetable, gdt, kernel etc.) then qkernel uses it as the default heap. 4)host init heap: an additional heap is used by the qvisor for storing data before launching vm. It will not be used after vm launched.

Now qvisor will switch to different vm creation flow based on the CCMode config. If any cc mode is enabled, sharedspace will be initialized after vm is launched. Additionally, map the host initial heap to kvm if cc is compiled but not enabled.

Instead of setting registers to pass parameters, in cc mode, a sharapara page is used. This method only works when feature cc is compiled and CCMode config is not None.

Add a data structure p2pmap in the mappable which stores the mapping of private and shared memory, writeback if map shared and not readonly when unmapping the data. Besides, need to sync updates when fsync and writing with fd.

Instead of using cstring for passing parameters in call, in cc, sharestring is used to allocate string in shared memory directly.

Add a struct taskWrapper, has minimal host required data(ready, queueid and taskAddr), which should be allocated in the shared memory and read by the host.

1)Store Timer in shared heap, since the value of the btree in timestore is a reference 2)Make timekeepr shared, the timekeeper is initialized and stored in the sharespace, and cloned when the guest creates a TimeKeeperClock. The internal timekeeper is used by host. ProcessOnce() ->TIMER_STORE.Trigger() -> get the timer by GetFirst() then timer.Fire() ->Timeout() -> Now() 3)In the same Timeout function, the listener of the Timer is triggered to update the vdso, the update by host is banned now. 4)Store FdWaitInfo in shared heap, it may be set by the kernel and check by host in ProcessOnce() -> FD_NOTIFIER.HostEpollWait() -> FdNotify()

Now CCMode::NormalEmu can be set in the config to enable unidentical mapping. Private memory is mapped 30gb higher on the host.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Draft] cc rebase #1310

[Draft] cc rebase #1310

Commits on Jun 11, 2024

[Draft] cc rebase #1310

Are you sure you want to change the base?

[Draft] cc rebase #1310

Commits on Jun 11, 2024