Add u: options namespace

spec/README.md

@@ -16,7 +16,8 @@
    1. [Data Model Errors](errors.md#data-model-errors)
    1. [Resolution Errors](errors.md#resolution-errors)
    1. [Message Function Errors](errors.md#message-function-errors)
-1. [Default Function Registry](registry.md)
+1. [Default Function Registry](registry/default.md)
+1. [`u:` Unicode Registry](registry/unicode.md)
 1. [Formatting](formatting.md)
 1. [Interchange data model](data-model/README.md)
 

spec/formatting.md

@@ -214,9 +214,21 @@ the following steps are taken:
 
 3. Perform _option resolution_.
 
-4. Call the function implementation with the following arguments:
+4. Determine the **_<dfn>function context</dfn>_** for calling the function implementation.
+   This includes:
 
-   - The current _locale_.
+   - The current _locale_,
+     potentially including a fallback chain of locales.
+   - The base directionality of the _message_ and its _text_ tokens.
+
+   If the resolved mapping of _options_ includes any `u:` options
+   supported by the implementation,
+   process them as specified in the [Unicode Registry](/spec/registry/unicode.md).
+   Such `u:` options MAY be removed from the resolved mapping of _options_.
+
+5. Call the function implementation with the following arguments:
+
+   - The _function context_.
    - The resolved mapping of _options_.
    - If the _expression_ includes an _operand_, its resolved value.
 
@@ -303,7 +315,7 @@ the following steps are taken:
 
    Implementation-defined _functions_ SHOULD use an implementation-defined _namespace_.
 
-5. If the call succeeds,
+6. If the call succeeds,
    resolve the value of the _expression_ as the result of that function call.
 
    If the call fails or does not return a valid value,
@@ -344,6 +356,11 @@ The resolved value of _markup_ includes the following fields:
 - The _identifier_ of the _markup_
 - The resolved _options_ values after _option resolution_.
 
+If the resolved mapping of _options_ includes any `u:` options
+supported by the implementation,
+process them as specified in the [Unicode Registry](/spec/registry/unicode.md).
+Such `u:` options MAY be removed from the resolved mapping of _options_.
+
 The resolution of _markup_ MUST always succeed.
 
 ### Fallback Resolution

spec/registry/unicode.md

@@ -0,0 +1,63 @@
+# MessageFormat 2.0 Unicode Registry
+
+The `u:` namespace is reserved for use by the Unicode Consortium.
+
+## Options
+
+This section describes common options which each implementation SHOULD support
+for all _functions_ and _markup_.
+
+### `u:id`
+
+A string value that is included as an `id` or other suitable value
+in the formatted parts for the _placeholder_,
+or any other structured formatted results.
+
+Ignored when formatting a message to a string.
+
+Accepts string values, or values which can be stringified without error.
+For other values, a _Bad Option_ error is emitted
+and the `u:id` option is ignored.
+
+### `u:locale`
+
+A comma-delimited list of BCP 47 language tags,
+or an implementation-defined list of such tags.
+
+Replaces the _locale_ defined in the _function context_ for this _expression_.
+The value is ignored when set on _markup_.
+
+During processing, the `u:locale` option
+is always removed from the resolved mapping of _options_.
+
+Values matching the following ABNF are always accepted:
+```abnf
+u-locale-option = langtag *([s] "," [s] langtag)
+```
+using `langtag` as defined in [RFC 5646](https://www.rfc-editor.org/rfc/rfc5646).
+
+Implementations MAY support additional language tags,
+such as private-use or grandfathered tags,
+or tags using `_` instead of `-` as a separator.
+When the value of `u:locale` is set by a _variable_,
+implementations MAY support non-string values otherwise representing locales.
+
+For unsupported values, a _Bad Option_ error is emitted
+and the value of the `u:locale` option is ignored.
+
+### `u:dir`
+
+Replaces the base directionality defined in
+the _function context_ for this _expression_.
+The value is ignored when set on _markup_.
+
+During processing, the `u:dir` option
+is always removed from the resolved mapping of _options_.
+
+Accepts the following string values:
+- `ltr`: left-to-right directionality
+- `rtl`: right-to-left directionality
+- `auto`: directionality determined from _expression_ contents
+
+For other values, a _Bad Option_ error is emitted
+and the value of the `u:dir` option is ignored.

spec/syntax.md

@@ -548,7 +548,7 @@ whether an _operand_ is required,
 what form the values of an _operand_ can take,
 what _options_ and _option_ values are valid,
 and what outputs might result.
-See [function registry](./registry.md) for more information.
+See [function registry](/spec/registry/default.md) for more information.
 
 A _function_ starts with a prefix sigil `:` followed by an _identifier_.
 The _identifier_ MAY be followed by one or more _options_.

test/README.md

@@ -10,6 +10,8 @@ These test files are intended to be useful for testing multiple different messag
 - `data-model-errors.json` - Strings that should produce Data Model Error when processed.
   Error names are defined in ["MessageFormat 2.0 Errors"](../spec/errors.md) in the spec.
 
+- `unicode.md` — Test cases for the `u:` Unicode Registry, using built-in functions.
+
 - `functions/` — Test cases that correspond to built-in functions.
   The behaviour of the built-in formatters is implementation-specific so the `exp` field is often
   omitted and assertions are made on error cases.

test/schemas/v0/tests.schema.json

@@ -269,6 +269,9 @@
               "name": {
                 "type": "string"
               },
+              "id": {
+                "type": "string"
+              },
               "options": {
                 "type": "object"
               }

test/tests/unicode.json

@@ -0,0 +1,105 @@
+{
+  "$schema": "https://raw.githubusercontent.com/unicode-org/message-format-wg/main/test/schemas/v0/tests.schema.json",
+  "scenario": "Unicode u: Registry",
+  "description": "Common options affecting the function context",
+  "defaultTestProperties": {
+    "locale": "en-US"
+  },
+  "tests": [
+    {
+      "src": "{#tag u:id=x u:dir=rtl u:locale=ar}content{/ns:tag u:id=x}",
+      "exp": "content",
+      "expParts": [
+        {
+          "type": "markup",
+          "kind": "open",
+          "id": "x",
+          "name": "tag"
+        },
+        {
+          "type": "literal",
+          "value": "content"
+        },
+        {
+          "type": "markup",
+          "kind": "close",
+          "id": "x",
+          "name": "tag"
+        }
+      ]
+    },
+    {
+      "src": "hello {4.2 :number u:locale=fr}",
+      "exp": "hello 4,2"
+    },
+    {
+      "src": "hello {world :string u:dir=ltr u:id=foo}",
+      "exp": "hello world",
+      "expParts": [
+        {
+          "type": "literal",
+          "value": "hello "
+        },
+        {
+          "type": "string",
+          "source": "|world|",
+          "dir": "ltr",
+          "id": "foo",
+          "value": "world"
+        }
+      ]
+    },
+    {
+      "src": "hello {world :string u:dir=rtl}",
+      "exp": "hello \u2067world\u2069",
+      "expParts": [
+        {
+          "type": "literal",
+          "value": "hello "
+        },
+        {
+          "type": "string",
+          "source": "|world|",
+          "dir": "rtl",
+          "value": "world"
+        }
+      ]
+    },
+    {
+      "src": "hello {world :string u:dir=auto}",
+      "exp": "hello \u2068world\u2069",
+      "expParts": [
+        {
+          "type": "literal",
+          "value": "hello "
+        },
+        {
+          "type": "string",
+          "source": "|world|",
+          "dir": "auto",
+          "value": "world"
+        }
+      ]
+    },
+    {
+      "locale": "ar",
+      "src": "أهلاً {بالعالم :string u:dir=rtl}",
+      "exp": "أهلاً \u2067بالعالم\u2069"
+    },
+    {
+      "locale": "ar",
+      "src": "أهلاً {بالعالم :string u:dir=auto}",
+      "exp": "أهلاً \u2068بالعالم\u2069"
+    },
+    {
+      "locale": "ar",
+      "src": "أهلاً {world :string u:dir=ltr}",
+      "exp": "أهلاً \u2066world\u2069"
+    },
+    {
+      "locale": "ar",
+      "src": "أهلاً {بالعالم :string}",
+      "exp": "أهلاً \u2067بالعالم\u2069"
+    }
+  ]
+}