YAML: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
 
(71 intermediate revisions by the same user not shown)
Line 5: Line 5:
* http://docs.ansible.com/ansible/YAMLSyntax.html
* http://docs.ansible.com/ansible/YAMLSyntax.html
* Using YAML for Java Application Configuration https://dzone.com/articles/using-yaml-java-application
* Using YAML for Java Application Configuration https://dzone.com/articles/using-yaml-java-application
* http://www.yaml.org/spec/1.2/spec.html
* Specification https://yaml.org/spec/
 
=Internal=
* [[Serialization]]
* [[JSON]]


=Overview=
=Overview=
Line 11: Line 15:
YAML is a human-readable data serialization format. YAML syntax was designed to easily map on scalars, list and associative arrays. It is well suited for hierarchical data representation. It does not use enclosures such as quotation marks, brackets, braces and open/close tags, which can be hard fro the human eye to balance in nested hierarchies. Data structure hierarchy is maintained by outline indentation. The specific number of spaces in the indentation is not important as long as parallel elements have the same left justification, and the hierarchically nested elements are indented further.
YAML is a human-readable data serialization format. YAML syntax was designed to easily map on scalars, list and associative arrays. It is well suited for hierarchical data representation. It does not use enclosures such as quotation marks, brackets, braces and open/close tags, which can be hard fro the human eye to balance in nested hierarchies. Data structure hierarchy is maintained by outline indentation. The specific number of spaces in the indentation is not important as long as parallel elements have the same left justification, and the hierarchically nested elements are indented further.


Strings do not require enclosure in quotations.
Strings [[#String|do not require enclosure in quotations]].


The format has support for references, where sections in the document can be referenced, thus eliminating redundancy.
The format has support for references, where sections in the document can be referenced, thus eliminating redundancy.


Multiple documents can exist in a single file/stream and they are separated by "---".  
[[#Embedding_Multiple_Documents_in_One_File|Multiple documents]] can exist in a single file/stream and they are separated by "---".  


An optional "..." can be used at then of the file - useful for signaling an end in streamed communication without closing the pipe.
[[#YAML_is_a_Superset_of_JSON|YAML is a superset of JSON]].


YAML is a superset of JSON, so a YAML parser should understand JSON. See http://yaml.org/spec/1.2/spec.html#id2759572
=Comments=


=Comments=
# This is a comment
=Style=
There are two styles: flow and block. In the "flow" style, successive YAML elements are placed on the same line, directly next to each other. This style is different from the "block style", where separate YAML elements are arranged into separate blocks defined by the same indentation.


<pre>
=<span id='Data_Types'></span>Scalars=
# This is a comment
</pre>


=Scalars=
a: 10


<pre>
YAML auto-detects the data type. A good rule when writing YAML is to quote strings and allow implicit type conversion for everything else.
a: 10
</pre>


Types are auto-detected, see [[YAML#Data_Types|Data Types]].
==Devoid of Value==


==Data Types==
The <tt>null</tt> word is used to indicate a lack of value. This is typically converted into any native null-like value (e.g., null in Java). Note that a null is different from an empty string and that a mapping entry with some key and a null value is valid and different from not having that key in the mapping.


YAML auto-detects the datatype. A good rule when writing YAML is to quote strings and allow implicit type conversion for everything else.
b: null


===Core Data Types===
==Core Data Types==


Strings, ints, floats, lists and maps.
Strings, ints, floats, lists and maps.
Line 51: Line 53:
</pre>
</pre>


====Boolean Support====
===<span id='Boolean_Support'></span>Booleans===
 
<tt>true</tt> and <tt>false</tt> must not be enclosed in quotes to be recognized as booleans.
 
{{Warn|N, n, Y, y are automatically identified as boolean scalars, '''unless enclosed in quotes'''. If you intend to pass the character N as a string value, specify 'N' and not N.}}


Boolean scalar support:
Boolean scalar support:
Line 59: Line 65:
  a: Yes
  a: Yes
  a: ON
  a: ON
  b: false
  b: false
  b: n
  b: n
b: N


===Defined Data Types===
c: "true" # string not boolean


===User-Defined Data Types===
===Integer===
 
If a integral value is specified as an unquoted bare word, it is treated as a numeric type:
 
count: 1
 
The same quoted value is treated as [[#String|string]]:
 
count: "1" # string not int
 
count: '1' # string not int
 
====Leading-Zero Integer====
 
If using a leading zero (for example <code>09</code>) in a field without quoting the value in single quotes, the value may be interpreted incorrectly by the YAML parser. If the value is a valid octal, it is converted to an integer. If not, is converted to a float.
 
===Float===
 
If a float value is specified as an unquoted bare word, it is treated as a numeric type:
 
size: 32.1
 
The same quoted value is treated as [[#String|string]].
 
size: "32.1" # string not float
 
size: '32.1' # string not float
 
===String===
 
{{Internal|Strings_in_YAML#Overview|Strings in YAML}}
 
==Forced Type Inference==
 
Particular type inference can be forced with the <tt>!!''type''</tt> syntax:
 
age !!str 21 # will be a string, equivalent with "21"
port: !!int 80 # will be an integer, equivalent with bare, unquoted 80
 
==Defined Data Types==
 
==User-Defined Data Types==


=Collections=
=Collections=
Line 131: Line 178:
     option-1: value-1
     option-1: value-1
     option-2: value-2
     option-2: value-2
=<span id='Multi-line_Support'></span>Multi-Line String Support=
{{Internal|Strings in YAML|Strings in YAML}}
=Embedding Multiple Documents in One File=
It is possible to place more than one YAML documents into a single file. This is done by prefixing a new document with '---' and ending the document with '...'
<syntaxhighlight lang='yaml'>
---
document: 1
...
---
document: 2
...
</syntaxhighlight>
In many cases, either '---' or '...' may be omitted. The optional "..." is useful for signaling an end in streamed communication without closing the pipe.
<syntaxhighlight lang='yaml'>
---
document: 1
---
document: 2
</syntaxhighlight>
=YAML is a Superset of JSON=


Because YAML is a superset of JSON, any valid JSON document should be valid YAML. A YAML parser should understand JSON. See http://yaml.org/spec/1.2/spec.html#id2759572


=Multi-line Support=
JSON can be mixed into YAML, for the benefit of readability:


{{External|http://www.yaml.org/spec/1.2/spec.html#id2795688}}
<syntaxhighlight lang='yaml'>
coffees: [ "Latte", "Cappuccino", "Espresso" ]
</syntaxhighlight>


==Literal Style==
is equivalent with:
<syntaxhighlight lang='yaml'>
coffees:
- Latte
- Cappuccino
- Espresso
</syntaxhighlight>


Multi-line strings can be written using the '|' character followed by a new line. To be considered multi-line content, the first line under the '|'-terminated line must be indented on a level deeper that the line containing the '|'. Trailing white space is stripped. The new line characters are preserved.
=Conversion between YAML and JSON=
{{Internal|Conversion between YAML and JSON|Conversion between YAML and JSON}}


This is correct multi-line (the mult-lines must be indented under 'data'):
=<span id='Anchors'></span>Anchors, Aliases and Overrides=
{{External|https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases}}
{{External|https://support.atlassian.com/bitbucket-cloud/docs/yaml-anchors/}}
{{External|https://helm.sh/docs/chart_template_guide/#yaml-anchors}}
 
YAML anchors and aliases cannot contain the <code>[</code>, <code>]</code>, <code>{</code>, <code>}</code>, and <code>,</code> characters.
 
==Anchor==
The anchor is introduced with an <code>&</code> (ampersand) and lets you mark a YAML node (object) with the purpose of referring it later in the same document. The anchor name can then be invoked with an [[#Alias|alias]]. Note that <code>&</code> must '''precede''' the node:


<syntaxhighlight lang='yaml'>
<syntaxhighlight lang='yaml'>
data: |
suffix: &default_suffix 'py'
  This is a
  multi-line
  text section
</syntaxhighlight>
</syntaxhighlight>


This is NOT a correct mult-line, because the "mult-lines" are not correctly indented:
This notation marks the string 'py' with the anchor <code>default_suffix</code>.


It is acceptable to use the same name for the key and the anchor name:
<syntaxhighlight lang='yaml'>
<syntaxhighlight lang='yaml'>
data: |
suffix: &suffix 'py'
This is not
a correct multi-line
</syntaxhighlight>
</syntaxhighlight>


==Folded Style==
==Alias==
The value of a node that was previously marked with an [[#Anchor|anchor]] by using <code>&</code> can be inserted in the document by using the syntax <code>*<anchor_name></code> an arbitrary number of times. This syntax is called an alias. The alias refers to the most recent preceding node having the same anchor. It is an error for an alias node to use an anchor that does not previously occur in the document. Note that an alias node must not specify any properties or content, as these were already specified at the first occurrence of the node.


The '>' character followed by a new line folds all the new lines, after removing trailing white space '''and new lines'''.
Do NOT introduce spaces between <code>*</code> and anchor name, the YAML parser will fail.
 
For example:


<syntaxhighlight lang='yaml'>
<syntaxhighlight lang='yaml'>
data: >
suffix: &default_suffix 'py'
  This is another
suffixes:
  multi-line
- 'java'
  text section
- 'sh'
  but in the final form
- *default_suffix
  it will be just one long string
  without new lines
</syntaxhighlight>
</syntaxhighlight>
is equivalent with:
<syntaxhighlight lang='yaml'>
suffix: 'py'
suffixes:
- 'java'
- 'sh'
- 'py'
</syntaxhighlight>
==Override==
<code><<:</code>


=YAML support in Java=
=YAML support in Java=


<blockquote style="background-color: #f9f9f9; border: solid thin lightgrey;">
<blockquote style="background-color: #f9f9f9; border: solid thin lightgrey;">
: [[YAML_conversion_to_JSON_with_Jackson|Jackson]]
:[[snakeyaml]]
:[[YamlBeans]]
:[[YamlBeans]]
:[[snakeyaml]]
</blockquote>
</blockquote>

Latest revision as of 20:07, 4 October 2023

External

Internal

Overview

YAML is a human-readable data serialization format. YAML syntax was designed to easily map on scalars, list and associative arrays. It is well suited for hierarchical data representation. It does not use enclosures such as quotation marks, brackets, braces and open/close tags, which can be hard fro the human eye to balance in nested hierarchies. Data structure hierarchy is maintained by outline indentation. The specific number of spaces in the indentation is not important as long as parallel elements have the same left justification, and the hierarchically nested elements are indented further.

Strings do not require enclosure in quotations.

The format has support for references, where sections in the document can be referenced, thus eliminating redundancy.

Multiple documents can exist in a single file/stream and they are separated by "---".

YAML is a superset of JSON.

Comments

# This is a comment

Style

There are two styles: flow and block. In the "flow" style, successive YAML elements are placed on the same line, directly next to each other. This style is different from the "block style", where separate YAML elements are arranged into separate blocks defined by the same indentation.

Scalars

a: 10

YAML auto-detects the data type. A good rule when writing YAML is to quote strings and allow implicit type conversion for everything else.

Devoid of Value

The null word is used to indicate a lack of value. This is typically converted into any native null-like value (e.g., null in Java). Note that a null is different from an empty string and that a mapping entry with some key and a null value is valid and different from not having that key in the mapping.

b: null

Core Data Types

Strings, ints, floats, lists and maps.

a: 123                      # an integer
b: "123"                    # a string, disambiguated by quotes
c: 123.0                    # a float
d: !!float 123              # a 'casted' float
e: !!str 123                # a 'casted' string

Booleans

true and false must not be enclosed in quotes to be recognized as booleans.


N, n, Y, y are automatically identified as boolean scalars, unless enclosed in quotes. If you intend to pass the character N as a string value, specify 'N' and not N.

Boolean scalar support:

a: true
a: Y
a: Yes
a: ON
b: false
b: n
b: N
c: "true" # string not boolean

Integer

If a integral value is specified as an unquoted bare word, it is treated as a numeric type:

count: 1

The same quoted value is treated as string:

count: "1" # string not int
count: '1' # string not int

Leading-Zero Integer

If using a leading zero (for example 09) in a field without quoting the value in single quotes, the value may be interpreted incorrectly by the YAML parser. If the value is a valid octal, it is converted to an integer. If not, is converted to a float.

Float

If a float value is specified as an unquoted bare word, it is treated as a numeric type:

size: 32.1

The same quoted value is treated as string.

size: "32.1" # string not float
size: '32.1' # string not float

String

Strings in YAML

Forced Type Inference

Particular type inference can be forced with the !!type syntax:

age !!str 21 # will be a string, equivalent with "21"
port: !!int 80 # will be an integer, equivalent with bare, unquoted 80

Defined Data Types

User-Defined Data Types

Collections

There are two types of collections: lists (or sequences) and associative arrays (or maps).

List (or Sequence)

List elements are designated by hyphen + space, and have the same offset:

- Audi
- Mercedes
- BMW

A list may contain a combination of "simple" elements and "complex" elements:

- simple
- complex:
    key1: val1
    key2: val2

Optional In-Line List Format

List elements are enclosed in brackets, and the list elements are separated by comma + space.

cars: ['Audi', 'BMW', 'Chevrolet']

Associative Array (or Map)

Keys are separated from values by a colon + space.

 name: Audi
 color: black
 capacity: 5

Optional In-Line Associative Array Format

Associative array element are enclosed in braces, and they key: value pairs are separated by comma + space.

car: {brand: Audi, color: black, type: sedan}

Composite Collections

Collections can be combined:

List of Associative Arrays

- country: AU
  price: 6990000
- country: AT
  price: 4990000
- country: BE
  price: 4990000

The elements of an (associative array) list entry have the same indentation relative to each other, including the first one that follows the "-".

Associative Array of Associative Arrays

TODO, test:

command:
  command-a:
    option-1: value-1
    option-2: value-2
  command-b:
    option-1: value-1
    option-2: value-2

Multi-Line String Support

Strings in YAML

Embedding Multiple Documents in One File

It is possible to place more than one YAML documents into a single file. This is done by prefixing a new document with '---' and ending the document with '...'

---
document: 1
...
---
document: 2
...

In many cases, either '---' or '...' may be omitted. The optional "..." is useful for signaling an end in streamed communication without closing the pipe.

---
document: 1
---
document: 2

YAML is a Superset of JSON

Because YAML is a superset of JSON, any valid JSON document should be valid YAML. A YAML parser should understand JSON. See http://yaml.org/spec/1.2/spec.html#id2759572

JSON can be mixed into YAML, for the benefit of readability:

coffees: [ "Latte", "Cappuccino", "Espresso" ]

is equivalent with:

coffees: 
- Latte
- Cappuccino
- Espresso

Conversion between YAML and JSON

Conversion between YAML and JSON

Anchors, Aliases and Overrides

https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases
https://support.atlassian.com/bitbucket-cloud/docs/yaml-anchors/
https://helm.sh/docs/chart_template_guide/#yaml-anchors

YAML anchors and aliases cannot contain the [, ], {, }, and , characters.

Anchor

The anchor is introduced with an & (ampersand) and lets you mark a YAML node (object) with the purpose of referring it later in the same document. The anchor name can then be invoked with an alias. Note that & must precede the node:

suffix: &default_suffix 'py'

This notation marks the string 'py' with the anchor default_suffix.

It is acceptable to use the same name for the key and the anchor name:

suffix: &suffix 'py'

Alias

The value of a node that was previously marked with an anchor by using & can be inserted in the document by using the syntax *<anchor_name> an arbitrary number of times. This syntax is called an alias. The alias refers to the most recent preceding node having the same anchor. It is an error for an alias node to use an anchor that does not previously occur in the document. Note that an alias node must not specify any properties or content, as these were already specified at the first occurrence of the node.

Do NOT introduce spaces between * and anchor name, the YAML parser will fail.

For example:

suffix: &default_suffix 'py'
suffixes:
 - 'java'
 - 'sh'
 - *default_suffix

is equivalent with:

suffix: 'py'
suffixes:
 - 'java'
 - 'sh'
 - 'py'

Override

<<:

YAML support in Java

Jackson
snakeyaml
YamlBeans