Code

DProxy#4462

Code

Merged

john-sharratt merged 76 commits intomasterwasmerio/wasmer:masterfrom dproxywasmerio/wasmer:dproxyCopy head branch name to clipboardMar 21, 2024

+8,334-1,661

Commits

Commits on Jan 3, 2024

• First implementation of DProxy

  john-sharratt

  committed
  dd3bdb5

Commits on Jan 4, 2024

• Merge remote-tracking branch 'origin/master' into dproxy

  john-sharratt

  committed
  3b54706

• Simplifications of DProxy

  john-sharratt

  committed
  1c646e2

Commits on Jan 5, 2024

• Fixed an issue where the runtime would not load properly in DProxy

  john-sharratt

  committed
  09b7556

• Simplified the loopback listen method so that it fixes a multiplexing issue

  john-sharratt

  committed
  d82b1dc

Commits on Jan 7, 2024

• Merge remote-tracking branch 'origin/master' into dproxy

  john-sharratt

  committed
  6575b12

• Refactoring of the rewind handling for DProxy

  john-sharratt

  committed
  92ef764

Commits on Jan 8, 2024

• Fixed an issue where the caching compiled modules were not saving properly

  john-sharratt

  committed
  4f2e4a6

Commits on Jan 9, 2024

• Some minor journal optimizations for a restored state

  john-sharratt

  committed
  fbfbcef

• Renamed InstanceSnapshot to StoreSnapshot which better reflects its purpose

  john-sharratt

  committed
  13203fd

Commits on Jan 10, 2024

• No longer partially restoring orphaned snapshots

  john-sharratt

  committed
  bb1b647

Commits on Jan 17, 2024

• Added the capability for the file system to index the data from a mmap backing store

  john-sharratt

  committed
  6ea2ab2

Commits on Jan 21, 2024

• Added unit tests for offload file

  john-sharratt

  committed
  a40d69b

Commits on Jan 22, 2024

• Fixed some alignment and serialization issues on the journals

  john-sharratt

  committed
  026636d

• Fixed an issue with a lock on the file system

  john-sharratt

  committed
  1fab2ad

• Fixes for the journal fd seed

  john-sharratt

  committed
  88c984d

• Fixed some compile issues

  john-sharratt

  committed
  41528eb

• Finally fixed the journal alignment issues, once and for all

  john-sharratt

  committed
  020fcac

• Finished a mounting feature for the journals

  john-sharratt

  committed
  2fe6edc

• Now using COW on aligned vectors and strings

  john-sharratt

  committed
  5f4d2db

Commits on Jan 23, 2024

• Significant improvement in write performance

  john-sharratt

  committed
  173b07f

• Finished a progress bar for the loading of a journal

  john-sharratt

  committed
  e12e146

• Significant speedup of the extent table loading

  john-sharratt

  committed
  8aa4169

• Fixed a bug where file sizes could not be set

  john-sharratt

  committed
  ef2d7dc

Commits on Jan 25, 2024

• Fixed the IO operations on file system

  john-sharratt

  committed
  66374be

Commits on Feb 5, 2024

• Fixed the loading of mounted file systems with static web servers

  john-sharratt

  committed
  17be193

• Fixed a bug where journals that have incomplete write operations no longer crash the system

  john-sharratt

  committed
  28b9519

• Fixed an issue with the file system transversal on mounting file systems

  john-sharratt

  committed
  00ac9fa

• Fixed an issue where a terminating instance does not abort the connection attempt

  john-sharratt

  committed
  b3dca80

Commits on Feb 6, 2024

• DProxy now correctly snapshots threads to the journal

  john-sharratt

  committed
  45d9809

• The system now snapshots when a workload goes idle

  john-sharratt

  committed
  a467536

• Optimized the memory snapshots to reduce wastage

  john-sharratt

  committed
  71000db

• The memory snapshot functionality is now much faster using region combinations, zero copy on hashing and an optimized extent resolution

  john-sharratt

  committed
  3b2ec3a

• Added a todo on using dirty pages to optimize the hashing time when snapshotting

  john-sharratt

  committed
  967b83a

Commits on Feb 7, 2024

• Fixed the remote sockets

  john-sharratt

  committed
  36abb81

• Fixed the writing of the memory hashes to the bitmap

  john-sharratt

  committed
  aa64c36

Commits on Feb 8, 2024

• Added extra data for the threads so they can be more easily recreated

  john-sharratt

  committed
  d93a2fd

• Added the functionality that spawns threads

  john-sharratt

  committed
  3eeb86f

• Now spawning the sub threads correctly on journal resume

  john-sharratt

  committed
  c187126

• Fixed an issue where the main thread was not rewinding properly

  john-sharratt

  committed
  da21864

• Fixed an issue where the threads were not properly rewinding on journals

  john-sharratt

  committed
  f2dfd5c

• Failed WASM processes now properly terminate running connections

  john-sharratt

  committed
  354e38c

• Fixed the thread resuming however there is now a tokio runtime problem

  john-sharratt

  committed
  d7255c4

Commits on Feb 13, 2024

• Resolved merge conflicts

  john-sharratt

  committed
  d034c50

Commits on Feb 20, 2024

• Journal now properly cleans up when a snapshot is missing

  john-sharratt

  committed
  1fcf56b

Commits on Feb 22, 2024

• Fixed the final pieces for a single threaded dproxy

  john-sharratt

  committed
  6216634

• Merge remote-tracking branch 'origin/master' into dproxy

  john-sharratt

  committed
  2cbfb91

Commits on Feb 25, 2024

• Correctly connected up the signal process for the ctrl-c key

  john-sharratt

  committed
  de2606d

• Now taking snapshots on signal events however its not waking properly yet

  john-sharratt

  committed
  bb430fe

• Fixed an issue where ctrl-c was not triggering during deep threading and properly implemented the snapshot on sigint issue

  john-sharratt

  committed
  68fedb8

• Renaming some of the spawn functions to make them easier to understand

  john-sharratt

  committed
  3757754

• Renamed the journal syscall player

  john-sharratt

  committed
  f68f58d

• Added another struct for RemoteSocket to make it simplier

  john-sharratt

  committed
  bd95ef3

• Added a comment on one of the apply thread methods

  john-sharratt

  committed
  9b38ee5

• Added comments on VIRUTAL_FD_ROOT

  john-sharratt

  committed
  049f505

• Missed one

  john-sharratt

  committed
  2184922

• Added additional comments

  john-sharratt

  committed
  bc520d4

• Fixed a whole bunch of linting errors

  john-sharratt

  committed
  09672e9

Commits on Feb 26, 2024

• Fixed some compile issues for JS

  john-sharratt

  committed
  d064818

• Merge remote-tracking branch 'origin/master' into dproxy

  john-sharratt

  committed
  192f3e8

• Linting fix

  john-sharratt

  committed
  573b342

• More minor linting fixes

  john-sharratt

  committed
  502957f

• Removed fuse as a default dependency as it does not work on all platforms

  john-sharratt

  committed
  0b04236

• More linting fixes

  john-sharratt

  committed
  51e2e75

• More linting fixes

  john-sharratt

  committed
  fc85d90

• Fixed some unit tests

  john-sharratt

  committed
  62b7c72

• Fixed some unit tests

  john-sharratt

  committed
  0a6abfd

• Fixed one of the lints that was missed

  john-sharratt

  committed
  329f972

• Linting and unit test fixes

  john-sharratt

  committed
  de476a6

• Fixed multithreading for journals

  john-sharratt

  committed
  46914b9

• Fixed yet another linting issue

  john-sharratt

  committed
  f0290c8

Commits on Feb 27, 2024

• Merge branch 'master' into dproxy

  john-sharratt

  authored
  887e386

• Merge branch 'master' into dproxy

  john-sharratt

  authored
  1ee2392

• Exposing WASIX method so that it can be consumed by custom task managers

  john-sharratt

  committed
  028a5a8

Commits on Mar 11, 2024

• Merge branch 'master' into dproxy

  john-sharratt

  committed
  03678c9

Commits on Mar 20, 2024

• Merge branch 'master' into dproxy

  john-sharratt

  committed
  c09b105