Skip to content

Latest commit

 

History

History
372 lines (300 loc) · 18.6 KB

Modules.md

File metadata and controls

372 lines (300 loc) · 18.6 KB

Modules

The distributable, loadable, and executable unit of code in WebAssembly is called a module. At runtime, a module can be instantiated with a set of import values to produce an instance, which is an immutable tuple referencing all the state accessible to the running module. Multiple module instances can access the same shared state which is the basis for dynamic linking in WebAssembly. WebAssembly modules are also designed to integrate with ES6 modules.

A module contains the following sections:

A module also defines several index spaces which are statically indexed by various operators and section fields in the module:

Imports

A module can declare a sequence of imports which are provided, at instantiation time, by the host environment. There are several kinds of imports:

  • function imports, which can be called inside the module by the call operator;
  • global imports, which can be accessed inside the module by the global operators;
  • linear memory imports, which can be accessed inside the module by the memory operators; and
  • table imports, which can be accessed inside the module by call_indirect and other table operators in the future.

In the future, other kinds of imports may be added. Imports are designed to allow modules to share code and data while still allowing separate compilation and caching.

All imports include two opaque names: a module name and an export name. The interpretation of these names is up to the host environment but designed to allow a host environments, like the Web, to support a two-level namespace.

Each specific kind of import defines additional fields:

A function import includes a signature to use for the imported function inside the module. The checking of the signature against the imported function outside the module is defined by the host environment. However, if the imported function is a WebAssembly function, the host environment must raise an instantiation-time error if there is a signature mismatch.

A global variable import includes the value type and mutability of the global variable. These fields have the same meaning as in the Global section. In the MVP, global variable imports must be immutable.

A linear memory import includes the same set of fields defined in the Linear Memory section: default flag, initial length and optional maximum length. The host environment must only allow imports of WebAssembly linear memories that have initial length greater-or-equal than the initial length declared in the import and that have maximum length less-or-equal than the maximum length declared in the import. This ensures that separate compilation can assume: memory accesses below the declared initial length are always in-bounds, accesses above the declared maximum length are always out-of-bounds and if initial equals maximum, the length is fixed. If the default flag is set, the imported memory is used as the default memory and at most one linear memory definition (import or internal) may have the default flag set. In the MVP, it is a validation error not to set the default flag.

A table import includes the same set of fields defined in the Table section: default flag, element type, initial length and optional maximum length. As with the linear memory section, the host environment must ensure only WebAssembly tables are imported with exactly-matching element type, greater-or-equal initial length, and less-or-equal maximum length. If the default flag is set, the imported table is used as the default table and at most one table definition (import or internal) may have the default flag set. In the MVP, it is a validation error not to set the default flag.

Since the WebAssembly spec does not define how import names are interpreted:

  • the Web environment defines names to be UTF8-encoded strings;
  • the host environment can interpret the module name as a file path, a URL, a key in a fixed set of builtin modules or the host environment may invoke a user-defined hook to resolve the module name to one of these;
  • the module name does not need to resolve to a WebAssembly module; it could resolve to a builtin module (implemented by the host environment) or a module written in another, compatible language; and
  • the meaning of calling an imported function is host-defined.

The open-ended nature of module imports allow them to be used to expose arbitrary host environment functionality to WebAssembly code, similar to a native syscall. For example, a shell environment could define a builtin stdio module with an export puts.

Exports

A module can declare a sequence of exports which are returned at instantiation time to the host environment. Each export has three fields: a name, whose meaning is defined by the host environment, a type, indicating whether the export is a function, global, memory or table, and an index into the type's corresponding index space.

All definitions are exportable: functions, globals, linear memories and tables. The meaning an exported definition is defined by the host environment. However, if another WebAssembly instance imports the definition, then both instances will share the same definition and the associated state (global variable value, linear memory bytes, table elements) is shared.

In the MVP, only immutable global variables can be exported.

Integration with ES6 modules

While ES6 defines how to parse, link and execute a module, ES6 does not define when this parsing/linking/execution occurs. An additional extension to the HTML spec is required to say when a script is parsed as a module instead of normal global code. This work is ongoing. Currently, the following entry points for modules are being considered:

  • <script type="module">;
  • an overload to the Worker constructor;
  • an overload to the importScripts Worker API;

Additionally, an ES6 module can recursively import other modules via import statements.

For WebAssembly/ES6 module integration, the idea is that all the above module entry points could also load WebAssembly modules simply by passing the URL of a WebAssembly module. The distinction of whether the module was WebAssembly or ES6 code could be made by namespacing or by content sniffing the first bytes of the fetched resource (which, for WebAssembly, would be a non-ASCII—and thus illegal as JavaScript—magic number). Thus, the whole module-loading pipeline (resolving the name to a URL, fetching the URL, any other loader hooks) would be shared and only the final stage would fork into either the JavaScript parser or the WebAssembly decoder.

Any non-builtin imports from within a WebAssembly module would be treated as if they were import statements of an ES6 module. If an ES6 module imported a WebAssembly module, the WebAssembly module's exports would be linked as if they were the exports of an ES6 module. Once parsing and linking phases were complete, a WebAssembly module would have its start function, defined by the start module option, called in place of executing the ES6 module top-level script. By default, multiple loads of the same module URL (in the same realm) reuse the same instance. It may be worthwhile in the future to consider extensions to allow applications to load/compile/link a module once and instantiate multiple times (each with a separate linear memory).

This integration strategy should allow WebAssembly modules to be fairly interchangeable with ES6 modules (ignoring GC/Web API signature restrictions of the WebAssembly MVP) and thus it should be natural to compose a single application from both kinds of code. This goal motivates the semantic design of giving each WebAssembly module its own disjoint linear memory. Otherwise, if all modules shared a single linear memory (all modules with the same realm? origin? window?—even the scope of "all" is a nuanced question), a single app using multiple independent libraries would have to hope that all the WebAssembly modules transitively used by those libraries "played well" together (e.g., explicitly shared malloc and coordinated global address ranges). Instead, the dynamic linking future feature is intended to allow explicitly sharing state between module instances.

Module start function

If the module has a start node defined, the function it refers should be called by the loader after the instance is initialized and before the exported functions are called.

  • The start function must not take any arguments or return anything
  • The function is identified by function index and can also be exported
  • There can only be at most one start node per module

For example, a start node in a module will be:

(start $start_function)

or

(start 42)

In the first example, the environment is expected to call the function $start_function before calling any other module function. In the second case, the environment is expected to call the module function indexed 42. This number is the function index starting from 0 (same as for export).

A module can:

  • Only have at most a start node
  • If a module contains a start node, the function must be defined in the module
  • The start function will be called after module loading and before any call to the module function is done

Global section

The global section provides an internal definition of zero or more global variables.

Each global variable internal definition declares its type (a value type), mutability (boolean flag) and initializer (an initializer expression).

Linear memory section

The linear memory section provides an internal definition of zero or more linear memories. In the MVP, the total number of linear memory definitions is limited to 1, but this may be relaxed in the future.

A linear memory definition may declare itself to be the default linear memory of the module. At most one linear memory definition may declare itself to be the default. In the MVP, if there is a linear memory definition, it must declare itself the default (there is no way to access non-default linear memories anyhow).

Each linear memory section declares an initial memory size (which may be subsequently increased by grow_memory) and an optional maximum memory size.

grow_memory is guaranteed to fail if attempting to grow past the declared maximum. When declared, implementations should (non-normative) attempt to reserve virtual memory up to the maximum size. While failure to allocate the initial memory size is a runtime error, failure to reserve up to the maximum is not. When a maximum memory size is not declared, on architectures with limited virtual address space, engines should allocate only the initial size and reallocate on demand.

Data section

The initial contents of linear memory are zero. The data section contains a possibly-empty array of data segments which specify the initial contents of fixed (offset, length) ranges of a given memory, specified by its linear memory index. This section is analogous to the .data section of native executables. The length is an integer constant value (defining the length of the given segment). The offset is an initializer expression.

Table section

The table section contains zero or more definitions of distinct tables. In the MVP, the total number of table definitions is limited to 1, but this may be relaxed in the future.

A table definition may declare itself to be the default table of the module. At most one table definition may declare itself to be the default. In the MVP, if there is a table definition, it must declare itself the default (there is no way to access non-default tables anyhow).

Each table definition also includes an element type, initial length, and optional maximum length.

In the MVP, the only valid element type is "anyfunc", but in the future, more element types may be added.

In the MVP, tables can only be resized via host-defined APIs (such as the JavaScript WebAssembly.Table.prototype.grow). A grow_table may be added in the future. In either case, table growth is guaranteed to fail if attempting to grow past the declared maximum. As with linear memory, when a maximum is declared, implementations should (non-normative) attempt to reserve virtual memory up to the maximum size. While failure to allocate the initial memory size is a runtime error, failure to reserve up to the maximum is not. When a maximum memory size is not declared, on architectures with limited virtual address space, engines should allocate only the initial size and reallocate on demand.

Elements section

The intial contents of a tables' elements are sentinel values (that would trap if called). The elements section allows a module to initialize (at instantiation time) the elements of any imported or internally-defined table with any other definition in the module. This is symmetric to how the Data section allows a module to initialize the bytes of any imported or defined memory.

The elements section contains a possibly-empty array of element segments which specify the initial contents of fixed (offset, length) ranges of a given table, specified by its table index. The length is an integer constant value (defining the length of the given segment). The offset is an initializer expression. Elements are specified with a (type, index) pair where type is the element type of an index space that is compatible with the table's element type and index is an integer immediate into types index space.

Function and Code sections

A single logical function definition is defined in two sections:

  • the function section declares the signatures of each internal function definition in the module;
  • the code section contains the function body of each function declared by the function section.

This split aids in streaming compilation by putting the function bodies, which constitute most of the byte size of the module, near the end so that all metadata necessary for recursive module loading and parallel compilation is available before compilation begins.

Function Index Space

The function index space indexes all imported and internally-defined function definitions, assigning monotonically-increasing indices based on the order of definition in the module (as defined by the binary encoding).

The function index space is used by:

  • calls, to identify the callee of a direct call

Global Index Space

The global index space indexes all imported and internally-defined global definitions, assigning monotonically-increasing indices based on the order of definition in the module (as defined by the binary encoding).

The global index space is used by:

Linear Memory Index Space

The linear memory index space indexes all imported and internally-defined linear memory definitions, assigning monotonically-increasing indices based on the order of definition in the module (as defined by the binary encoding).

The linear memory index space is only used by the data section. In the MVP, there is at most one linear memory so this index space is just a placeholder for when there can be multiple memories.

Table Index Space

The table index space indexes all imported and internally-defined table definitions, assigning monotonically-increasing indices based on the order of definition in the module (as defined by the binary encoding).

The table index space is only used by the elements section. In the MVP, there is at most one table so this index space is just a placeholder for when there can be multiple tables.

Initializer Expression

Initializer expressions are evaluated at instantiation time and are currently used to:

An initializer expression is a pure WebAssembly expression that is encoded with the same binary encoding as WebAssembly expressions. Not all WebAssembly operators can or should be supported in initializer expressions; initializer expressions represent a minimal pure subset of WebAssembly expressions.

In the MVP, to keep things simple while still supporting the basic needs of dynamic linking, initializer expressions are restricted to the following nullary operators:

  • the four constant operators; and
  • get_global, where the global index must refer to an immutable import.

In the future, operators like i32.add could be added to allow more expressive base + offset load-time calculations.