xref: /qemu/docs/devel/qapi-code-gen.rst (revision 78f314cf)
1==================================
2How to use the QAPI code generator
3==================================
4
5..
6   Copyright IBM Corp. 2011
7   Copyright (C) 2012-2016 Red Hat, Inc.
8
9   This work is licensed under the terms of the GNU GPL, version 2 or
10   later.  See the COPYING file in the top-level directory.
11
12
13Introduction
14============
15
16QAPI is a native C API within QEMU which provides management-level
17functionality to internal and external users.  For external
18users/processes, this interface is made available by a JSON-based wire
19format for the QEMU Monitor Protocol (QMP) for controlling qemu, as
20well as the QEMU Guest Agent (QGA) for communicating with the guest.
21The remainder of this document uses "Client JSON Protocol" when
22referring to the wire contents of a QMP or QGA connection.
23
24To map between Client JSON Protocol interfaces and the native C API,
25we generate C code from a QAPI schema.  This document describes the
26QAPI schema language, and how it gets mapped to the Client JSON
27Protocol and to C.  It additionally provides guidance on maintaining
28Client JSON Protocol compatibility.
29
30
31The QAPI schema language
32========================
33
34The QAPI schema defines the Client JSON Protocol's commands and
35events, as well as types used by them.  Forward references are
36allowed.
37
38It is permissible for the schema to contain additional types not used
39by any commands or events, for the side effect of generated C code
40used internally.
41
42There are several kinds of types: simple types (a number of built-in
43types, such as ``int`` and ``str``; as well as enumerations), arrays,
44complex types (structs and unions), and alternate types (a choice
45between other types).
46
47
48Schema syntax
49-------------
50
51Syntax is loosely based on `JSON <http://www.ietf.org/rfc/rfc8259.txt>`_.
52Differences:
53
54* Comments: start with a hash character (``#``) that is not part of a
55  string, and extend to the end of the line.
56
57* Strings are enclosed in ``'single quotes'``, not ``"double quotes"``.
58
59* Strings are restricted to printable ASCII, and escape sequences to
60  just ``\\``.
61
62* Numbers and ``null`` are not supported.
63
64A second layer of syntax defines the sequences of JSON texts that are
65a correctly structured QAPI schema.  We provide a grammar for this
66syntax in an EBNF-like notation:
67
68* Production rules look like ``non-terminal = expression``
69* Concatenation: expression ``A B`` matches expression ``A``, then ``B``
70* Alternation: expression ``A | B`` matches expression ``A`` or ``B``
71* Repetition: expression ``A...`` matches zero or more occurrences of
72  expression ``A``
73* Repetition: expression ``A, ...`` matches zero or more occurrences of
74  expression ``A`` separated by ``,``
75* Grouping: expression ``( A )`` matches expression ``A``
76* JSON's structural characters are terminals: ``{ } [ ] : ,``
77* JSON's literal names are terminals: ``false true``
78* String literals enclosed in ``'single quotes'`` are terminal, and match
79  this JSON string, with a leading ``*`` stripped off
80* When JSON object member's name starts with ``*``, the member is
81  optional.
82* The symbol ``STRING`` is a terminal, and matches any JSON string
83* The symbol ``BOOL`` is a terminal, and matches JSON ``false`` or ``true``
84* ALL-CAPS words other than ``STRING`` are non-terminals
85
86The order of members within JSON objects does not matter unless
87explicitly noted.
88
89A QAPI schema consists of a series of top-level expressions::
90
91    SCHEMA = TOP-LEVEL-EXPR...
92
93The top-level expressions are all JSON objects.  Code and
94documentation is generated in schema definition order.  Code order
95should not matter.
96
97A top-level expressions is either a directive or a definition::
98
99    TOP-LEVEL-EXPR = DIRECTIVE | DEFINITION
100
101There are two kinds of directives and six kinds of definitions::
102
103    DIRECTIVE = INCLUDE | PRAGMA
104    DEFINITION = ENUM | STRUCT | UNION | ALTERNATE | COMMAND | EVENT
105
106These are discussed in detail below.
107
108
109Built-in Types
110--------------
111
112The following types are predefined, and map to C as follows:
113
114  ============= ============== ============================================
115  Schema        C              JSON
116  ============= ============== ============================================
117  ``str``       ``char *``     any JSON string, UTF-8
118  ``number``    ``double``     any JSON number
119  ``int``       ``int64_t``    a JSON number without fractional part
120                               that fits into the C integer type
121  ``int8``      ``int8_t``     likewise
122  ``int16``     ``int16_t``    likewise
123  ``int32``     ``int32_t``    likewise
124  ``int64``     ``int64_t``    likewise
125  ``uint8``     ``uint8_t``    likewise
126  ``uint16``    ``uint16_t``   likewise
127  ``uint32``    ``uint32_t``   likewise
128  ``uint64``    ``uint64_t``   likewise
129  ``size``      ``uint64_t``   like ``uint64_t``, except
130                               ``StringInputVisitor`` accepts size suffixes
131  ``bool``      ``bool``       JSON ``true`` or ``false``
132  ``null``      ``QNull *``    JSON ``null``
133  ``any``       ``QObject *``  any JSON value
134  ``QType``     ``QType``      JSON string matching enum ``QType`` values
135  ============= ============== ============================================
136
137
138Include directives
139------------------
140
141Syntax::
142
143    INCLUDE = { 'include': STRING }
144
145The QAPI schema definitions can be modularized using the 'include' directive::
146
147 { 'include': 'path/to/file.json' }
148
149The directive is evaluated recursively, and include paths are relative
150to the file using the directive.  Multiple includes of the same file
151are idempotent.
152
153As a matter of style, it is a good idea to have all files be
154self-contained, but at the moment, nothing prevents an included file
155from making a forward reference to a type that is only introduced by
156an outer file.  The parser may be made stricter in the future to
157prevent incomplete include files.
158
159.. _pragma:
160
161Pragma directives
162-----------------
163
164Syntax::
165
166    PRAGMA = { 'pragma': {
167                   '*doc-required': BOOL,
168                   '*command-name-exceptions': [ STRING, ... ],
169                   '*command-returns-exceptions': [ STRING, ... ],
170                   '*member-name-exceptions': [ STRING, ... ] } }
171
172The pragma directive lets you control optional generator behavior.
173
174Pragma's scope is currently the complete schema.  Setting the same
175pragma to different values in parts of the schema doesn't work.
176
177Pragma 'doc-required' takes a boolean value.  If true, documentation
178is required.  Default is false.
179
180Pragma 'command-name-exceptions' takes a list of commands whose names
181may contain ``"_"`` instead of ``"-"``.  Default is none.
182
183Pragma 'command-returns-exceptions' takes a list of commands that may
184violate the rules on permitted return types.  Default is none.
185
186Pragma 'member-name-exceptions' takes a list of types whose member
187names may contain uppercase letters, and ``"_"`` instead of ``"-"``.
188Default is none.
189
190.. _ENUM-VALUE:
191
192Enumeration types
193-----------------
194
195Syntax::
196
197    ENUM = { 'enum': STRING,
198             'data': [ ENUM-VALUE, ... ],
199             '*prefix': STRING,
200             '*if': COND,
201             '*features': FEATURES }
202    ENUM-VALUE = STRING
203               | { 'name': STRING,
204                   '*if': COND,
205                   '*features': FEATURES }
206
207Member 'enum' names the enum type.
208
209Each member of the 'data' array defines a value of the enumeration
210type.  The form STRING is shorthand for :code:`{ 'name': STRING }`.  The
211'name' values must be be distinct.
212
213Example::
214
215 { 'enum': 'MyEnum', 'data': [ 'value1', 'value2', 'value3' ] }
216
217Nothing prevents an empty enumeration, although it is probably not
218useful.
219
220On the wire, an enumeration type's value is represented by its
221(string) name.  In C, it's represented by an enumeration constant.
222These are of the form PREFIX_NAME, where PREFIX is derived from the
223enumeration type's name, and NAME from the value's name.  For the
224example above, the generator maps 'MyEnum' to MY_ENUM and 'value1' to
225VALUE1, resulting in the enumeration constant MY_ENUM_VALUE1.  The
226optional 'prefix' member overrides PREFIX.
227
228The generated C enumeration constants have values 0, 1, ..., N-1 (in
229QAPI schema order), where N is the number of values.  There is an
230additional enumeration constant PREFIX__MAX with value N.
231
232Do not use string or an integer type when an enumeration type can do
233the job satisfactorily.
234
235The optional 'if' member specifies a conditional.  See `Configuring the
236schema`_ below for more on this.
237
238The optional 'features' member specifies features.  See Features_
239below for more on this.
240
241
242.. _TYPE-REF:
243
244Type references and array types
245-------------------------------
246
247Syntax::
248
249    TYPE-REF = STRING | ARRAY-TYPE
250    ARRAY-TYPE = [ STRING ]
251
252A string denotes the type named by the string.
253
254A one-element array containing a string denotes an array of the type
255named by the string.  Example: ``['int']`` denotes an array of ``int``.
256
257
258Struct types
259------------
260
261Syntax::
262
263    STRUCT = { 'struct': STRING,
264               'data': MEMBERS,
265               '*base': STRING,
266               '*if': COND,
267               '*features': FEATURES }
268    MEMBERS = { MEMBER, ... }
269    MEMBER = STRING : TYPE-REF
270           | STRING : { 'type': TYPE-REF,
271                        '*if': COND,
272                        '*features': FEATURES }
273
274Member 'struct' names the struct type.
275
276Each MEMBER of the 'data' object defines a member of the struct type.
277
278.. _MEMBERS:
279
280The MEMBER's STRING name consists of an optional ``*`` prefix and the
281struct member name.  If ``*`` is present, the member is optional.
282
283The MEMBER's value defines its properties, in particular its type.
284The form TYPE-REF_ is shorthand for :code:`{ 'type': TYPE-REF }`.
285
286Example::
287
288 { 'struct': 'MyType',
289   'data': { 'member1': 'str', 'member2': ['int'], '*member3': 'str' } }
290
291A struct type corresponds to a struct in C, and an object in JSON.
292The C struct's members are generated in QAPI schema order.
293
294The optional 'base' member names a struct type whose members are to be
295included in this type.  They go first in the C struct.
296
297Example::
298
299 { 'struct': 'BlockdevOptionsGenericFormat',
300   'data': { 'file': 'str' } }
301 { 'struct': 'BlockdevOptionsGenericCOWFormat',
302   'base': 'BlockdevOptionsGenericFormat',
303   'data': { '*backing': 'str' } }
304
305An example BlockdevOptionsGenericCOWFormat object on the wire could use
306both members like this::
307
308 { "file": "/some/place/my-image",
309   "backing": "/some/place/my-backing-file" }
310
311The optional 'if' member specifies a conditional.  See `Configuring
312the schema`_ below for more on this.
313
314The optional 'features' member specifies features.  See Features_
315below for more on this.
316
317
318Union types
319-----------
320
321Syntax::
322
323    UNION = { 'union': STRING,
324              'base': ( MEMBERS | STRING ),
325              'discriminator': STRING,
326              'data': BRANCHES,
327              '*if': COND,
328              '*features': FEATURES }
329    BRANCHES = { BRANCH, ... }
330    BRANCH = STRING : TYPE-REF
331           | STRING : { 'type': TYPE-REF, '*if': COND }
332
333Member 'union' names the union type.
334
335The 'base' member defines the common members.  If it is a MEMBERS_
336object, it defines common members just like a struct type's 'data'
337member defines struct type members.  If it is a STRING, it names a
338struct type whose members are the common members.
339
340Member 'discriminator' must name a non-optional enum-typed member of
341the base struct.  That member's value selects a branch by its name.
342If no such branch exists, an empty branch is assumed.
343
344Each BRANCH of the 'data' object defines a branch of the union.  A
345union must have at least one branch.
346
347The BRANCH's STRING name is the branch name.  It must be a value of
348the discriminator enum type.
349
350The BRANCH's value defines the branch's properties, in particular its
351type.  The type must a struct type.  The form TYPE-REF_ is shorthand
352for :code:`{ 'type': TYPE-REF }`.
353
354In the Client JSON Protocol, a union is represented by an object with
355the common members (from the base type) and the selected branch's
356members.  The two sets of member names must be disjoint.
357
358Example::
359
360 { 'enum': 'BlockdevDriver', 'data': [ 'file', 'qcow2' ] }
361 { 'union': 'BlockdevOptions',
362   'base': { 'driver': 'BlockdevDriver', '*read-only': 'bool' },
363   'discriminator': 'driver',
364   'data': { 'file': 'BlockdevOptionsFile',
365             'qcow2': 'BlockdevOptionsQcow2' } }
366
367Resulting in these JSON objects::
368
369 { "driver": "file", "read-only": true,
370   "filename": "/some/place/my-image" }
371 { "driver": "qcow2", "read-only": false,
372   "backing": "/some/place/my-image", "lazy-refcounts": true }
373
374The order of branches need not match the order of the enum values.
375The branches need not cover all possible enum values.  In the
376resulting generated C data types, a union is represented as a struct
377with the base members in QAPI schema order, and then a union of
378structures for each branch of the struct.
379
380The optional 'if' member specifies a conditional.  See `Configuring
381the schema`_ below for more on this.
382
383The optional 'features' member specifies features.  See Features_
384below for more on this.
385
386
387Alternate types
388---------------
389
390Syntax::
391
392    ALTERNATE = { 'alternate': STRING,
393                  'data': ALTERNATIVES,
394                  '*if': COND,
395                  '*features': FEATURES }
396    ALTERNATIVES = { ALTERNATIVE, ... }
397    ALTERNATIVE = STRING : STRING
398                | STRING : { 'type': STRING, '*if': COND }
399
400Member 'alternate' names the alternate type.
401
402Each ALTERNATIVE of the 'data' object defines a branch of the
403alternate.  An alternate must have at least one branch.
404
405The ALTERNATIVE's STRING name is the branch name.
406
407The ALTERNATIVE's value defines the branch's properties, in particular
408its type.  The form STRING is shorthand for :code:`{ 'type': STRING }`.
409
410Example::
411
412 { 'alternate': 'BlockdevRef',
413   'data': { 'definition': 'BlockdevOptions',
414             'reference': 'str' } }
415
416An alternate type is like a union type, except there is no
417discriminator on the wire.  Instead, the branch to use is inferred
418from the value.  An alternate can only express a choice between types
419represented differently on the wire.
420
421If a branch is typed as the 'bool' built-in, the alternate accepts
422true and false; if it is typed as any of the various numeric
423built-ins, it accepts a JSON number; if it is typed as a 'str'
424built-in or named enum type, it accepts a JSON string; if it is typed
425as the 'null' built-in, it accepts JSON null; and if it is typed as a
426complex type (struct or union), it accepts a JSON object.
427
428The example alternate declaration above allows using both of the
429following example objects::
430
431 { "file": "my_existing_block_device_id" }
432 { "file": { "driver": "file",
433             "read-only": false,
434             "filename": "/tmp/mydisk.qcow2" } }
435
436The optional 'if' member specifies a conditional.  See `Configuring
437the schema`_ below for more on this.
438
439The optional 'features' member specifies features.  See Features_
440below for more on this.
441
442
443Commands
444--------
445
446Syntax::
447
448    COMMAND = { 'command': STRING,
449                (
450                '*data': ( MEMBERS | STRING ),
451                |
452                'data': STRING,
453                'boxed': true,
454                )
455                '*returns': TYPE-REF,
456                '*success-response': false,
457                '*gen': false,
458                '*allow-oob': true,
459                '*allow-preconfig': true,
460                '*coroutine': true,
461                '*if': COND,
462                '*features': FEATURES }
463
464Member 'command' names the command.
465
466Member 'data' defines the arguments.  It defaults to an empty MEMBERS_
467object.
468
469If 'data' is a MEMBERS_ object, then MEMBERS defines arguments just
470like a struct type's 'data' defines struct type members.
471
472If 'data' is a STRING, then STRING names a complex type whose members
473are the arguments.  A union type requires ``'boxed': true``.
474
475Member 'returns' defines the command's return type.  It defaults to an
476empty struct type.  It must normally be a complex type or an array of
477a complex type.  To return anything else, the command must be listed
478in pragma 'commands-returns-exceptions'.  If you do this, extending
479the command to return additional information will be harder.  Use of
480the pragma for new commands is strongly discouraged.
481
482A command's error responses are not specified in the QAPI schema.
483Error conditions should be documented in comments.
484
485In the Client JSON Protocol, the value of the "execute" or "exec-oob"
486member is the command name.  The value of the "arguments" member then
487has to conform to the arguments, and the value of the success
488response's "return" member will conform to the return type.
489
490Some example commands::
491
492 { 'command': 'my-first-command',
493   'data': { 'arg1': 'str', '*arg2': 'str' } }
494 { 'struct': 'MyType', 'data': { '*value': 'str' } }
495 { 'command': 'my-second-command',
496   'returns': [ 'MyType' ] }
497
498which would validate this Client JSON Protocol transaction::
499
500 => { "execute": "my-first-command",
501      "arguments": { "arg1": "hello" } }
502 <= { "return": { } }
503 => { "execute": "my-second-command" }
504 <= { "return": [ { "value": "one" }, { } ] }
505
506The generator emits a prototype for the C function implementing the
507command.  The function itself needs to be written by hand.  See
508section `Code generated for commands`_ for examples.
509
510The function returns the return type.  When member 'boxed' is absent,
511it takes the command arguments as arguments one by one, in QAPI schema
512order.  Else it takes them wrapped in the C struct generated for the
513complex argument type.  It takes an additional ``Error **`` argument in
514either case.
515
516The generator also emits a marshalling function that extracts
517arguments for the user's function out of an input QDict, calls the
518user's function, and if it succeeded, builds an output QObject from
519its return value.  This is for use by the QMP monitor core.
520
521In rare cases, QAPI cannot express a type-safe representation of a
522corresponding Client JSON Protocol command.  You then have to suppress
523generation of a marshalling function by including a member 'gen' with
524boolean value false, and instead write your own function.  For
525example::
526
527 { 'command': 'netdev_add',
528   'data': {'type': 'str', 'id': 'str'},
529   'gen': false }
530
531Please try to avoid adding new commands that rely on this, and instead
532use type-safe unions.
533
534Normally, the QAPI schema is used to describe synchronous exchanges,
535where a response is expected.  But in some cases, the action of a
536command is expected to change state in a way that a successful
537response is not possible (although the command will still return an
538error object on failure).  When a successful reply is not possible,
539the command definition includes the optional member 'success-response'
540with boolean value false.  So far, only QGA makes use of this member.
541
542Member 'allow-oob' declares whether the command supports out-of-band
543(OOB) execution.  It defaults to false.  For example::
544
545 { 'command': 'migrate_recover',
546   'data': { 'uri': 'str' }, 'allow-oob': true }
547
548See the :doc:`/interop/qmp-spec` for out-of-band execution syntax
549and semantics.
550
551Commands supporting out-of-band execution can still be executed
552in-band.
553
554When a command is executed in-band, its handler runs in the main
555thread with the BQL held.
556
557When a command is executed out-of-band, its handler runs in a
558dedicated monitor I/O thread with the BQL *not* held.
559
560An OOB-capable command handler must satisfy the following conditions:
561
562- It terminates quickly.
563- It does not invoke system calls that may block.
564- It does not access guest RAM that may block when userfaultfd is
565  enabled for postcopy live migration.
566- It takes only "fast" locks, i.e. all critical sections protected by
567  any lock it takes also satisfy the conditions for OOB command
568  handler code.
569
570The restrictions on locking limit access to shared state.  Such access
571requires synchronization, but OOB commands can't take the BQL or any
572other "slow" lock.
573
574When in doubt, do not implement OOB execution support.
575
576Member 'allow-preconfig' declares whether the command is available
577before the machine is built.  It defaults to false.  For example::
578
579 { 'enum': 'QMPCapability',
580   'data': [ 'oob' ] }
581 { 'command': 'qmp_capabilities',
582   'data': { '*enable': [ 'QMPCapability' ] },
583   'allow-preconfig': true }
584
585QMP is available before the machine is built only when QEMU was
586started with --preconfig.
587
588Member 'coroutine' tells the QMP dispatcher whether the command handler
589is safe to be run in a coroutine.  It defaults to false.  If it is true,
590the command handler is called from coroutine context and may yield while
591waiting for an external event (such as I/O completion) in order to avoid
592blocking the guest and other background operations.
593
594Coroutine safety can be hard to prove, similar to thread safety.  Common
595pitfalls are:
596
597- The global mutex isn't held across ``qemu_coroutine_yield()``, so
598  operations that used to assume that they execute atomically may have
599  to be more careful to protect against changes in the global state.
600
601- Nested event loops (``AIO_WAIT_WHILE()`` etc.) are problematic in
602  coroutine context and can easily lead to deadlocks.  They should be
603  replaced by yielding and reentering the coroutine when the condition
604  becomes false.
605
606Since the command handler may assume coroutine context, any callers
607other than the QMP dispatcher must also call it in coroutine context.
608In particular, HMP commands calling such a QMP command handler must be
609marked ``.coroutine = true`` in hmp-commands.hx.
610
611It is an error to specify both ``'coroutine': true`` and ``'allow-oob': true``
612for a command.  We don't currently have a use case for both together and
613without a use case, it's not entirely clear what the semantics should
614be.
615
616The optional 'if' member specifies a conditional.  See `Configuring
617the schema`_ below for more on this.
618
619The optional 'features' member specifies features.  See Features_
620below for more on this.
621
622
623Events
624------
625
626Syntax::
627
628    EVENT = { 'event': STRING,
629              (
630              '*data': ( MEMBERS | STRING ),
631              |
632              'data': STRING,
633              'boxed': true,
634              )
635              '*if': COND,
636              '*features': FEATURES }
637
638Member 'event' names the event.  This is the event name used in the
639Client JSON Protocol.
640
641Member 'data' defines the event-specific data.  It defaults to an
642empty MEMBERS object.
643
644If 'data' is a MEMBERS object, then MEMBERS defines event-specific
645data just like a struct type's 'data' defines struct type members.
646
647If 'data' is a STRING, then STRING names a complex type whose members
648are the event-specific data.  A union type requires ``'boxed': true``.
649
650An example event is::
651
652 { 'event': 'EVENT_C',
653   'data': { '*a': 'int', 'b': 'str' } }
654
655Resulting in this JSON object::
656
657 { "event": "EVENT_C",
658   "data": { "b": "test string" },
659   "timestamp": { "seconds": 1267020223, "microseconds": 435656 } }
660
661The generator emits a function to send the event.  When member 'boxed'
662is absent, it takes event-specific data one by one, in QAPI schema
663order.  Else it takes them wrapped in the C struct generated for the
664complex type.  See section `Code generated for events`_ for examples.
665
666The optional 'if' member specifies a conditional.  See `Configuring
667the schema`_ below for more on this.
668
669The optional 'features' member specifies features.  See Features_
670below for more on this.
671
672
673.. _FEATURE:
674
675Features
676--------
677
678Syntax::
679
680    FEATURES = [ FEATURE, ... ]
681    FEATURE = STRING
682            | { 'name': STRING, '*if': COND }
683
684Sometimes, the behaviour of QEMU changes compatibly, but without a
685change in the QMP syntax (usually by allowing values or operations
686that previously resulted in an error).  QMP clients may still need to
687know whether the extension is available.
688
689For this purpose, a list of features can be specified for definitions,
690enumeration values, and struct members.  Each feature list member can
691either be ``{ 'name': STRING, '*if': COND }``, or STRING, which is
692shorthand for ``{ 'name': STRING }``.
693
694The optional 'if' member specifies a conditional.  See `Configuring
695the schema`_ below for more on this.
696
697Example::
698
699 { 'struct': 'TestType',
700   'data': { 'number': 'int' },
701   'features': [ 'allow-negative-numbers' ] }
702
703The feature strings are exposed to clients in introspection, as
704explained in section `Client JSON Protocol introspection`_.
705
706Intended use is to have each feature string signal that this build of
707QEMU shows a certain behaviour.
708
709
710Special features
711~~~~~~~~~~~~~~~~
712
713Feature "deprecated" marks a command, event, enum value, or struct
714member as deprecated.  It is not supported elsewhere so far.
715Interfaces so marked may be withdrawn in future releases in accordance
716with QEMU's deprecation policy.
717
718Feature "unstable" marks a command, event, enum value, or struct
719member as unstable.  It is not supported elsewhere so far.  Interfaces
720so marked may be withdrawn or changed incompatibly in future releases.
721
722
723Naming rules and reserved names
724-------------------------------
725
726All names must begin with a letter, and contain only ASCII letters,
727digits, hyphen, and underscore.  There are two exceptions: enum values
728may start with a digit, and names that are downstream extensions (see
729section `Downstream extensions`_) start with underscore.
730
731Names beginning with ``q_`` are reserved for the generator, which uses
732them for munging QMP names that resemble C keywords or other
733problematic strings.  For example, a member named ``default`` in qapi
734becomes ``q_default`` in the generated C code.
735
736Types, commands, and events share a common namespace.  Therefore,
737generally speaking, type definitions should always use CamelCase for
738user-defined type names, while built-in types are lowercase.
739
740Type names ending with ``Kind`` or ``List`` are reserved for the
741generator, which uses them for implicit union enums and array types,
742respectively.
743
744Command names, member names within a type, and feature names should be
745all lower case with words separated by a hyphen.  However, some
746existing older commands and complex types use underscore; when
747extending them, consistency is preferred over blindly avoiding
748underscore.
749
750Event names should be ALL_CAPS with words separated by underscore.
751
752Member name ``u`` and names starting with ``has-`` or ``has_`` are reserved
753for the generator, which uses them for unions and for tracking
754optional members.
755
756Names beginning with ``x-`` used to signify "experimental".  This
757convention has been replaced by special feature "unstable".
758
759Pragmas ``command-name-exceptions`` and ``member-name-exceptions`` let
760you violate naming rules.  Use for new code is strongly discouraged. See
761`Pragma directives`_ for details.
762
763
764Downstream extensions
765---------------------
766
767QAPI schema names that are externally visible, say in the Client JSON
768Protocol, need to be managed with care.  Names starting with a
769downstream prefix of the form __RFQDN_ are reserved for the downstream
770who controls the valid, reverse fully qualified domain name RFQDN.
771RFQDN may only contain ASCII letters, digits, hyphen and period.
772
773Example: Red Hat, Inc. controls redhat.com, and may therefore add a
774downstream command ``__com.redhat_drive-mirror``.
775
776
777Configuring the schema
778----------------------
779
780Syntax::
781
782    COND = STRING
783         | { 'all: [ COND, ... ] }
784         | { 'any: [ COND, ... ] }
785         | { 'not': COND }
786
787All definitions take an optional 'if' member.  Its value must be a
788string, or an object with a single member 'all', 'any' or 'not'.
789
790The C code generated for the definition will then be guarded by an #if
791preprocessing directive with an operand generated from that condition:
792
793 * STRING will generate defined(STRING)
794 * { 'all': [COND, ...] } will generate (COND && ...)
795 * { 'any': [COND, ...] } will generate (COND || ...)
796 * { 'not': COND } will generate !COND
797
798Example: a conditional struct ::
799
800 { 'struct': 'IfStruct', 'data': { 'foo': 'int' },
801   'if': { 'all': [ 'CONFIG_FOO', 'HAVE_BAR' ] } }
802
803gets its generated code guarded like this::
804
805 #if defined(CONFIG_FOO) && defined(HAVE_BAR)
806 ... generated code ...
807 #endif /* defined(HAVE_BAR) && defined(CONFIG_FOO) */
808
809Individual members of complex types can also be made conditional.
810This requires the longhand form of MEMBER.
811
812Example: a struct type with unconditional member 'foo' and conditional
813member 'bar' ::
814
815 { 'struct': 'IfStruct',
816   'data': { 'foo': 'int',
817             'bar': { 'type': 'int', 'if': 'IFCOND'} } }
818
819A union's discriminator may not be conditional.
820
821Likewise, individual enumeration values may be conditional.  This
822requires the longhand form of ENUM-VALUE_.
823
824Example: an enum type with unconditional value 'foo' and conditional
825value 'bar' ::
826
827 { 'enum': 'IfEnum',
828   'data': [ 'foo',
829             { 'name' : 'bar', 'if': 'IFCOND' } ] }
830
831Likewise, features can be conditional.  This requires the longhand
832form of FEATURE_.
833
834Example: a struct with conditional feature 'allow-negative-numbers' ::
835
836 { 'struct': 'TestType',
837   'data': { 'number': 'int' },
838   'features': [ { 'name': 'allow-negative-numbers',
839                   'if': 'IFCOND' } ] }
840
841Please note that you are responsible to ensure that the C code will
842compile with an arbitrary combination of conditions, since the
843generator is unable to check it at this point.
844
845The conditions apply to introspection as well, i.e. introspection
846shows a conditional entity only when the condition is satisfied in
847this particular build.
848
849
850Documentation comments
851----------------------
852
853A multi-line comment that starts and ends with a ``##`` line is a
854documentation comment.
855
856If the documentation comment starts like ::
857
858    ##
859    # @SYMBOL:
860
861it documents the definition of SYMBOL, else it's free-form
862documentation.
863
864See below for more on `Definition documentation`_.
865
866Free-form documentation may be used to provide additional text and
867structuring content.
868
869
870Headings and subheadings
871~~~~~~~~~~~~~~~~~~~~~~~~
872
873A free-form documentation comment containing a line which starts with
874some ``=`` symbols and then a space defines a section heading::
875
876    ##
877    # = This is a top level heading
878    #
879    # This is a free-form comment which will go under the
880    # top level heading.
881    ##
882
883    ##
884    # == This is a second level heading
885    ##
886
887A heading line must be the first line of the documentation
888comment block.
889
890Section headings must always be correctly nested, so you can only
891define a third-level heading inside a second-level heading, and so on.
892
893
894Documentation markup
895~~~~~~~~~~~~~~~~~~~~
896
897Documentation comments can use most rST markup.  In particular,
898a ``::`` literal block can be used for examples::
899
900    # ::
901    #
902    #   Text of the example, may span
903    #   multiple lines
904
905``*`` starts an itemized list::
906
907    # * First item, may span
908    #   multiple lines
909    # * Second item
910
911You can also use ``-`` instead of ``*``.
912
913A decimal number followed by ``.`` starts a numbered list::
914
915    # 1. First item, may span
916    #    multiple lines
917    # 2. Second item
918
919The actual number doesn't matter.
920
921Lists of either kind must be preceded and followed by a blank line.
922If a list item's text spans multiple lines, then the second and
923subsequent lines must be correctly indented to line up with the
924first character of the first line.
925
926The usual ****strong****, *\*emphasized\** and ````literal```` markup
927should be used.  If you need a single literal ``*``, you will need to
928backslash-escape it.
929
930Use ``@foo`` to reference a name in the schema.  This is an rST
931extension.  It is rendered the same way as ````foo````, but carries
932additional meaning.
933
934Example::
935
936 ##
937 # Some text foo with **bold** and *emphasis*
938 #
939 # 1. with a list
940 # 2. like that
941 #
942 # And some code:
943 #
944 # ::
945 #
946 #   $ echo foo
947 #   -> do this
948 #   <- get that
949 ##
950
951For legibility, wrap text paragraphs so every line is at most 70
952characters long.
953
954Separate sentences with two spaces.
955
956
957Definition documentation
958~~~~~~~~~~~~~~~~~~~~~~~~
959
960Definition documentation, if present, must immediately precede the
961definition it documents.
962
963When documentation is required (see pragma_ 'doc-required'), every
964definition must have documentation.
965
966Definition documentation starts with a line naming the definition,
967followed by an optional overview, a description of each argument (for
968commands and events), member (for structs and unions), branch (for
969alternates), or value (for enums), a description of each feature (if
970any), and finally optional tagged sections.
971
972Descriptions start with '\@name:'.  The description text should be
973indented like this::
974
975 # @name: Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed
976 #     do eiusmod tempor incididunt ut labore et dolore magna aliqua.
977
978.. FIXME The parser accepts these things in almost any order.
979
980.. FIXME union branches should be described, too.
981
982Extensions added after the definition was first released carry a
983"(since x.y.z)" comment.
984
985The feature descriptions must be preceded by a line "Features:", like
986this::
987
988  # Features:
989  #
990  # @feature: Description text
991
992A tagged section starts with one of the following words:
993"Note:"/"Notes:", "Since:", "Example"/"Examples", "Returns:", "TODO:".
994The section ends with the start of a new section.
995
996The second and subsequent lines of sections other than
997"Example"/"Examples" should be indented like this::
998
999 # Note: Ut enim ad minim veniam, quis nostrud exercitation ullamco
1000 #     laboris nisi ut aliquip ex ea commodo consequat.
1001 #
1002 #     Duis aute irure dolor in reprehenderit in voluptate velit esse
1003 #     cillum dolore eu fugiat nulla pariatur.
1004
1005A "Since: x.y.z" tagged section lists the release that introduced the
1006definition.
1007
1008An "Example" or "Examples" section is rendered entirely
1009as literal fixed-width text.  "TODO" sections are not rendered at all
1010(they are for developers, not users of QMP).  In other sections, the
1011text is formatted, and rST markup can be used.
1012
1013For example::
1014
1015 ##
1016 # @BlockStats:
1017 #
1018 # Statistics of a virtual block device or a block backing device.
1019 #
1020 # @device: If the stats are for a virtual block device, the name
1021 #     corresponding to the virtual block device.
1022 #
1023 # @node-name: The node name of the device. (since 2.3)
1024 #
1025 # ... more members ...
1026 #
1027 # Since: 0.14.0
1028 ##
1029 { 'struct': 'BlockStats',
1030   'data': {'*device': 'str', '*node-name': 'str',
1031            ... more members ... } }
1032
1033 ##
1034 # @query-blockstats:
1035 #
1036 # Query the @BlockStats for all virtual block devices.
1037 #
1038 # @query-nodes: If true, the command will query all the block nodes
1039 #     ... explain, explain ...  (since 2.3)
1040 #
1041 # Returns: A list of @BlockStats for each virtual block devices.
1042 #
1043 # Since: 0.14.0
1044 #
1045 # Example:
1046 #
1047 # -> { "execute": "query-blockstats" }
1048 # <- {
1049 #      ... lots of output ...
1050 #    }
1051 #
1052 ##
1053 { 'command': 'query-blockstats',
1054   'data': { '*query-nodes': 'bool' },
1055   'returns': ['BlockStats'] }
1056
1057
1058Markup pitfalls
1059~~~~~~~~~~~~~~~
1060
1061A blank line is required between list items and paragraphs.  Without
1062it, the list may not be recognized, resulting in garbled output.  Good
1063example::
1064
1065 # An event's state is modified if:
1066 #
1067 # - its name matches the @name pattern, and
1068 # - if @vcpu is given, the event has the "vcpu" property.
1069
1070Without the blank line this would be a single paragraph.
1071
1072Indentation matters.  Bad example::
1073
1074 # @none: None (no memory side cache in this proximity domain,
1075 #              or cache associativity unknown)
1076 #     (since 5.0)
1077
1078The last line's de-indent is wrong.  The second and subsequent lines
1079need to line up with each other, like this::
1080
1081 # @none: None (no memory side cache in this proximity domain,
1082 #     or cache associativity unknown)
1083 #     (since 5.0)
1084
1085Section tags are case-sensitive and end with a colon.  Good example::
1086
1087 # Since: 7.1
1088
1089Bad examples (all ordinary paragraphs)::
1090
1091 # since: 7.1
1092
1093 # Since 7.1
1094
1095 # Since : 7.1
1096
1097Likewise, member descriptions require a colon.  Good example::
1098
1099 # @interface-id: Interface ID
1100
1101Bad examples (all ordinary paragraphs)::
1102
1103 # @interface-id   Interface ID
1104
1105 # @interface-id : Interface ID
1106
1107Undocumented members are not flagged, yet.  Instead, the generated
1108documentation describes them as "Not documented".  Think twice before
1109adding more undocumented members.
1110
1111When you change documentation comments, please check the generated
1112documentation comes out as intended!
1113
1114
1115Client JSON Protocol introspection
1116==================================
1117
1118Clients of a Client JSON Protocol commonly need to figure out what
1119exactly the server (QEMU) supports.
1120
1121For this purpose, QMP provides introspection via command
1122query-qmp-schema.  QGA currently doesn't support introspection.
1123
1124While Client JSON Protocol wire compatibility should be maintained
1125between qemu versions, we cannot make the same guarantees for
1126introspection stability.  For example, one version of qemu may provide
1127a non-variant optional member of a struct, and a later version rework
1128the member to instead be non-optional and associated with a variant.
1129Likewise, one version of qemu may list a member with open-ended type
1130'str', and a later version could convert it to a finite set of strings
1131via an enum type; or a member may be converted from a specific type to
1132an alternate that represents a choice between the original type and
1133something else.
1134
1135query-qmp-schema returns a JSON array of SchemaInfo objects.  These
1136objects together describe the wire ABI, as defined in the QAPI schema.
1137There is no specified order to the SchemaInfo objects returned; a
1138client must search for a particular name throughout the entire array
1139to learn more about that name, but is at least guaranteed that there
1140will be no collisions between type, command, and event names.
1141
1142However, the SchemaInfo can't reflect all the rules and restrictions
1143that apply to QMP.  It's interface introspection (figuring out what's
1144there), not interface specification.  The specification is in the QAPI
1145schema.  To understand how QMP is to be used, you need to study the
1146QAPI schema.
1147
1148Like any other command, query-qmp-schema is itself defined in the QAPI
1149schema, along with the SchemaInfo type.  This text attempts to give an
1150overview how things work.  For details you need to consult the QAPI
1151schema.
1152
1153SchemaInfo objects have common members "name", "meta-type",
1154"features", and additional variant members depending on the value of
1155meta-type.
1156
1157Each SchemaInfo object describes a wire ABI entity of a certain
1158meta-type: a command, event or one of several kinds of type.
1159
1160SchemaInfo for commands and events have the same name as in the QAPI
1161schema.
1162
1163Command and event names are part of the wire ABI, but type names are
1164not.  Therefore, the SchemaInfo for types have auto-generated
1165meaningless names.  For readability, the examples in this section use
1166meaningful type names instead.
1167
1168Optional member "features" exposes the entity's feature strings as a
1169JSON array of strings.
1170
1171To examine a type, start with a command or event using it, then follow
1172references by name.
1173
1174QAPI schema definitions not reachable that way are omitted.
1175
1176The SchemaInfo for a command has meta-type "command", and variant
1177members "arg-type", "ret-type" and "allow-oob".  On the wire, the
1178"arguments" member of a client's "execute" command must conform to the
1179object type named by "arg-type".  The "return" member that the server
1180passes in a success response conforms to the type named by "ret-type".
1181When "allow-oob" is true, it means the command supports out-of-band
1182execution.  It defaults to false.
1183
1184If the command takes no arguments, "arg-type" names an object type
1185without members.  Likewise, if the command returns nothing, "ret-type"
1186names an object type without members.
1187
1188Example: the SchemaInfo for command query-qmp-schema ::
1189
1190 { "name": "query-qmp-schema", "meta-type": "command",
1191   "arg-type": "q_empty", "ret-type": "SchemaInfoList" }
1192
1193   Type "q_empty" is an automatic object type without members, and type
1194   "SchemaInfoList" is the array of SchemaInfo type.
1195
1196The SchemaInfo for an event has meta-type "event", and variant member
1197"arg-type".  On the wire, a "data" member that the server passes in an
1198event conforms to the object type named by "arg-type".
1199
1200If the event carries no additional information, "arg-type" names an
1201object type without members.  The event may not have a data member on
1202the wire then.
1203
1204Each command or event defined with 'data' as MEMBERS object in the
1205QAPI schema implicitly defines an object type.
1206
1207Example: the SchemaInfo for EVENT_C from section Events_ ::
1208
1209    { "name": "EVENT_C", "meta-type": "event",
1210      "arg-type": "q_obj-EVENT_C-arg" }
1211
1212    Type "q_obj-EVENT_C-arg" is an implicitly defined object type with
1213    the two members from the event's definition.
1214
1215The SchemaInfo for struct and union types has meta-type "object" and
1216variant member "members".
1217
1218The SchemaInfo for a union type additionally has variant members "tag"
1219and "variants".
1220
1221"members" is a JSON array describing the object's common members, if
1222any.  Each element is a JSON object with members "name" (the member's
1223name), "type" (the name of its type), "features" (a JSON array of
1224feature strings), and "default".  The latter two are optional.  The
1225member is optional if "default" is present.  Currently, "default" can
1226only have value null.  Other values are reserved for future
1227extensions.  The "members" array is in no particular order; clients
1228must search the entire object when learning whether a particular
1229member is supported.
1230
1231Example: the SchemaInfo for MyType from section `Struct types`_ ::
1232
1233    { "name": "MyType", "meta-type": "object",
1234      "members": [
1235          { "name": "member1", "type": "str" },
1236          { "name": "member2", "type": "int" },
1237          { "name": "member3", "type": "str", "default": null } ] }
1238
1239"features" exposes the command's feature strings as a JSON array of
1240strings.
1241
1242Example: the SchemaInfo for TestType from section Features_::
1243
1244    { "name": "TestType", "meta-type": "object",
1245      "members": [
1246          { "name": "number", "type": "int" } ],
1247      "features": ["allow-negative-numbers"] }
1248
1249"tag" is the name of the common member serving as type tag.
1250"variants" is a JSON array describing the object's variant members.
1251Each element is a JSON object with members "case" (the value of type
1252tag this element applies to) and "type" (the name of an object type
1253that provides the variant members for this type tag value).  The
1254"variants" array is in no particular order, and is not guaranteed to
1255list cases in the same order as the corresponding "tag" enum type.
1256
1257Example: the SchemaInfo for union BlockdevOptions from section
1258`Union types`_ ::
1259
1260    { "name": "BlockdevOptions", "meta-type": "object",
1261      "members": [
1262          { "name": "driver", "type": "BlockdevDriver" },
1263          { "name": "read-only", "type": "bool", "default": null } ],
1264      "tag": "driver",
1265      "variants": [
1266          { "case": "file", "type": "BlockdevOptionsFile" },
1267          { "case": "qcow2", "type": "BlockdevOptionsQcow2" } ] }
1268
1269Note that base types are "flattened": its members are included in the
1270"members" array.
1271
1272The SchemaInfo for an alternate type has meta-type "alternate", and
1273variant member "members".  "members" is a JSON array.  Each element is
1274a JSON object with member "type", which names a type.  Values of the
1275alternate type conform to exactly one of its member types.  There is
1276no guarantee on the order in which "members" will be listed.
1277
1278Example: the SchemaInfo for BlockdevRef from section `Alternate types`_ ::
1279
1280    { "name": "BlockdevRef", "meta-type": "alternate",
1281      "members": [
1282          { "type": "BlockdevOptions" },
1283          { "type": "str" } ] }
1284
1285The SchemaInfo for an array type has meta-type "array", and variant
1286member "element-type", which names the array's element type.  Array
1287types are implicitly defined.  For convenience, the array's name may
1288resemble the element type; however, clients should examine member
1289"element-type" instead of making assumptions based on parsing member
1290"name".
1291
1292Example: the SchemaInfo for ['str'] ::
1293
1294    { "name": "[str]", "meta-type": "array",
1295      "element-type": "str" }
1296
1297The SchemaInfo for an enumeration type has meta-type "enum" and
1298variant member "members".
1299
1300"members" is a JSON array describing the enumeration values.  Each
1301element is a JSON object with member "name" (the member's name), and
1302optionally "features" (a JSON array of feature strings).  The
1303"members" array is in no particular order; clients must search the
1304entire array when learning whether a particular value is supported.
1305
1306Example: the SchemaInfo for MyEnum from section `Enumeration types`_ ::
1307
1308    { "name": "MyEnum", "meta-type": "enum",
1309      "members": [
1310        { "name": "value1" },
1311        { "name": "value2" },
1312        { "name": "value3" }
1313      ] }
1314
1315The SchemaInfo for a built-in type has the same name as the type in
1316the QAPI schema (see section `Built-in Types`_), with one exception
1317detailed below.  It has variant member "json-type" that shows how
1318values of this type are encoded on the wire.
1319
1320Example: the SchemaInfo for str ::
1321
1322    { "name": "str", "meta-type": "builtin", "json-type": "string" }
1323
1324The QAPI schema supports a number of integer types that only differ in
1325how they map to C.  They are identical as far as SchemaInfo is
1326concerned.  Therefore, they get all mapped to a single type "int" in
1327SchemaInfo.
1328
1329As explained above, type names are not part of the wire ABI.  Not even
1330the names of built-in types.  Clients should examine member
1331"json-type" instead of hard-coding names of built-in types.
1332
1333
1334Compatibility considerations
1335============================
1336
1337Maintaining backward compatibility at the Client JSON Protocol level
1338while evolving the schema requires some care.  This section is about
1339syntactic compatibility, which is necessary, but not sufficient, for
1340actual compatibility.
1341
1342Clients send commands with argument data, and receive command
1343responses with return data and events with event data.
1344
1345Adding opt-in functionality to the send direction is backwards
1346compatible: adding commands, optional arguments, enumeration values,
1347union and alternate branches; turning an argument type into an
1348alternate of that type; making mandatory arguments optional.  Clients
1349oblivious of the new functionality continue to work.
1350
1351Incompatible changes include removing commands, command arguments,
1352enumeration values, union and alternate branches, adding mandatory
1353command arguments, and making optional arguments mandatory.
1354
1355The specified behavior of an absent optional argument should remain
1356the same.  With proper documentation, this policy still allows some
1357flexibility; for example, when an optional 'buffer-size' argument is
1358specified to default to a sensible buffer size, the actual default
1359value can still be changed.  The specified default behavior is not the
1360exact size of the buffer, only that the default size is sensible.
1361
1362Adding functionality to the receive direction is generally backwards
1363compatible: adding events, adding return and event data members.
1364Clients are expected to ignore the ones they don't know.
1365
1366Removing "unreachable" stuff like events that can't be triggered
1367anymore, optional return or event data members that can't be sent
1368anymore, and return or event data member (enumeration) values that
1369can't be sent anymore makes no difference to clients, except for
1370introspection.  The latter can conceivably confuse clients, so tread
1371carefully.
1372
1373Incompatible changes include removing return and event data members.
1374
1375Any change to a command definition's 'data' or one of the types used
1376there (recursively) needs to consider send direction compatibility.
1377
1378Any change to a command definition's 'return', an event definition's
1379'data', or one of the types used there (recursively) needs to consider
1380receive direction compatibility.
1381
1382Any change to types used in both contexts need to consider both.
1383
1384Enumeration type values and complex and alternate type members may be
1385reordered freely.  For enumerations and alternate types, this doesn't
1386affect the wire encoding.  For complex types, this might make the
1387implementation emit JSON object members in a different order, which
1388the Client JSON Protocol permits.
1389
1390Since type names are not visible in the Client JSON Protocol, types
1391may be freely renamed.  Even certain refactorings are invisible, such
1392as splitting members from one type into a common base type.
1393
1394
1395Code generation
1396===============
1397
1398The QAPI code generator qapi-gen.py generates code and documentation
1399from the schema.  Together with the core QAPI libraries, this code
1400provides everything required to take JSON commands read in by a Client
1401JSON Protocol server, unmarshal the arguments into the underlying C
1402types, call into the corresponding C function, map the response back
1403to a Client JSON Protocol response to be returned to the user, and
1404introspect the commands.
1405
1406As an example, we'll use the following schema, which describes a
1407single complex user-defined type, along with command which takes a
1408list of that type as a parameter, and returns a single element of that
1409type.  The user is responsible for writing the implementation of
1410qmp_my_command(); everything else is produced by the generator. ::
1411
1412    $ cat example-schema.json
1413    { 'struct': 'UserDefOne',
1414      'data': { 'integer': 'int', '*string': 'str', '*flag': 'bool' } }
1415
1416    { 'command': 'my-command',
1417      'data': { 'arg1': ['UserDefOne'] },
1418      'returns': 'UserDefOne' }
1419
1420    { 'event': 'MY_EVENT' }
1421
1422We run qapi-gen.py like this::
1423
1424    $ python scripts/qapi-gen.py --output-dir="qapi-generated" \
1425    --prefix="example-" example-schema.json
1426
1427For a more thorough look at generated code, the testsuite includes
1428tests/qapi-schema/qapi-schema-tests.json that covers more examples of
1429what the generator will accept, and compiles the resulting C code as
1430part of 'make check-unit'.
1431
1432
1433Code generated for QAPI types
1434-----------------------------
1435
1436The following files are created:
1437
1438 ``$(prefix)qapi-types.h``
1439     C types corresponding to types defined in the schema
1440
1441 ``$(prefix)qapi-types.c``
1442     Cleanup functions for the above C types
1443
1444The $(prefix) is an optional parameter used as a namespace to keep the
1445generated code from one schema/code-generation separated from others so code
1446can be generated/used from multiple schemas without clobbering previously
1447created code.
1448
1449Example::
1450
1451    $ cat qapi-generated/example-qapi-types.h
1452    [Uninteresting stuff omitted...]
1453
1454    #ifndef EXAMPLE_QAPI_TYPES_H
1455    #define EXAMPLE_QAPI_TYPES_H
1456
1457    #include "qapi/qapi-builtin-types.h"
1458
1459    typedef struct UserDefOne UserDefOne;
1460
1461    typedef struct UserDefOneList UserDefOneList;
1462
1463    typedef struct q_obj_my_command_arg q_obj_my_command_arg;
1464
1465    struct UserDefOne {
1466        int64_t integer;
1467        char *string;
1468        bool has_flag;
1469        bool flag;
1470    };
1471
1472    void qapi_free_UserDefOne(UserDefOne *obj);
1473    G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOne, qapi_free_UserDefOne)
1474
1475    struct UserDefOneList {
1476        UserDefOneList *next;
1477        UserDefOne *value;
1478    };
1479
1480    void qapi_free_UserDefOneList(UserDefOneList *obj);
1481    G_DEFINE_AUTOPTR_CLEANUP_FUNC(UserDefOneList, qapi_free_UserDefOneList)
1482
1483    struct q_obj_my_command_arg {
1484        UserDefOneList *arg1;
1485    };
1486
1487    #endif /* EXAMPLE_QAPI_TYPES_H */
1488    $ cat qapi-generated/example-qapi-types.c
1489    [Uninteresting stuff omitted...]
1490
1491    void qapi_free_UserDefOne(UserDefOne *obj)
1492    {
1493        Visitor *v;
1494
1495        if (!obj) {
1496            return;
1497        }
1498
1499        v = qapi_dealloc_visitor_new();
1500        visit_type_UserDefOne(v, NULL, &obj, NULL);
1501        visit_free(v);
1502    }
1503
1504    void qapi_free_UserDefOneList(UserDefOneList *obj)
1505    {
1506        Visitor *v;
1507
1508        if (!obj) {
1509            return;
1510        }
1511
1512        v = qapi_dealloc_visitor_new();
1513        visit_type_UserDefOneList(v, NULL, &obj, NULL);
1514        visit_free(v);
1515    }
1516
1517    [Uninteresting stuff omitted...]
1518
1519For a modular QAPI schema (see section `Include directives`_), code for
1520each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1521
1522 SUBDIR/$(prefix)qapi-types-SUBMODULE.h
1523 SUBDIR/$(prefix)qapi-types-SUBMODULE.c
1524
1525If qapi-gen.py is run with option --builtins, additional files are
1526created:
1527
1528 ``qapi-builtin-types.h``
1529     C types corresponding to built-in types
1530
1531 ``qapi-builtin-types.c``
1532     Cleanup functions for the above C types
1533
1534
1535Code generated for visiting QAPI types
1536--------------------------------------
1537
1538These are the visitor functions used to walk through and convert
1539between a native QAPI C data structure and some other format (such as
1540QObject); the generated functions are named visit_type_FOO() and
1541visit_type_FOO_members().
1542
1543The following files are generated:
1544
1545 ``$(prefix)qapi-visit.c``
1546     Visitor function for a particular C type, used to automagically
1547     convert QObjects into the corresponding C type and vice-versa, as
1548     well as for deallocating memory for an existing C type
1549
1550 ``$(prefix)qapi-visit.h``
1551     Declarations for previously mentioned visitor functions
1552
1553Example::
1554
1555    $ cat qapi-generated/example-qapi-visit.h
1556    [Uninteresting stuff omitted...]
1557
1558    #ifndef EXAMPLE_QAPI_VISIT_H
1559    #define EXAMPLE_QAPI_VISIT_H
1560
1561    #include "qapi/qapi-builtin-visit.h"
1562    #include "example-qapi-types.h"
1563
1564
1565    bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp);
1566
1567    bool visit_type_UserDefOne(Visitor *v, const char *name,
1568                     UserDefOne **obj, Error **errp);
1569
1570    bool visit_type_UserDefOneList(Visitor *v, const char *name,
1571                     UserDefOneList **obj, Error **errp);
1572
1573    bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp);
1574
1575    #endif /* EXAMPLE_QAPI_VISIT_H */
1576    $ cat qapi-generated/example-qapi-visit.c
1577    [Uninteresting stuff omitted...]
1578
1579    bool visit_type_UserDefOne_members(Visitor *v, UserDefOne *obj, Error **errp)
1580    {
1581        bool has_string = !!obj->string;
1582
1583        if (!visit_type_int(v, "integer", &obj->integer, errp)) {
1584            return false;
1585        }
1586        if (visit_optional(v, "string", &has_string)) {
1587            if (!visit_type_str(v, "string", &obj->string, errp)) {
1588                return false;
1589            }
1590        }
1591        if (visit_optional(v, "flag", &obj->has_flag)) {
1592            if (!visit_type_bool(v, "flag", &obj->flag, errp)) {
1593                return false;
1594            }
1595        }
1596        return true;
1597    }
1598
1599    bool visit_type_UserDefOne(Visitor *v, const char *name,
1600                     UserDefOne **obj, Error **errp)
1601    {
1602        bool ok = false;
1603
1604        if (!visit_start_struct(v, name, (void **)obj, sizeof(UserDefOne), errp)) {
1605            return false;
1606        }
1607        if (!*obj) {
1608            /* incomplete */
1609            assert(visit_is_dealloc(v));
1610            ok = true;
1611            goto out_obj;
1612        }
1613        if (!visit_type_UserDefOne_members(v, *obj, errp)) {
1614            goto out_obj;
1615        }
1616        ok = visit_check_struct(v, errp);
1617    out_obj:
1618        visit_end_struct(v, (void **)obj);
1619        if (!ok && visit_is_input(v)) {
1620            qapi_free_UserDefOne(*obj);
1621            *obj = NULL;
1622        }
1623        return ok;
1624    }
1625
1626    bool visit_type_UserDefOneList(Visitor *v, const char *name,
1627                     UserDefOneList **obj, Error **errp)
1628    {
1629        bool ok = false;
1630        UserDefOneList *tail;
1631        size_t size = sizeof(**obj);
1632
1633        if (!visit_start_list(v, name, (GenericList **)obj, size, errp)) {
1634            return false;
1635        }
1636
1637        for (tail = *obj; tail;
1638             tail = (UserDefOneList *)visit_next_list(v, (GenericList *)tail, size)) {
1639            if (!visit_type_UserDefOne(v, NULL, &tail->value, errp)) {
1640                goto out_obj;
1641            }
1642        }
1643
1644        ok = visit_check_list(v, errp);
1645    out_obj:
1646        visit_end_list(v, (void **)obj);
1647        if (!ok && visit_is_input(v)) {
1648            qapi_free_UserDefOneList(*obj);
1649            *obj = NULL;
1650        }
1651        return ok;
1652    }
1653
1654    bool visit_type_q_obj_my_command_arg_members(Visitor *v, q_obj_my_command_arg *obj, Error **errp)
1655    {
1656        if (!visit_type_UserDefOneList(v, "arg1", &obj->arg1, errp)) {
1657            return false;
1658        }
1659        return true;
1660    }
1661
1662    [Uninteresting stuff omitted...]
1663
1664For a modular QAPI schema (see section `Include directives`_), code for
1665each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1666
1667 SUBDIR/$(prefix)qapi-visit-SUBMODULE.h
1668 SUBDIR/$(prefix)qapi-visit-SUBMODULE.c
1669
1670If qapi-gen.py is run with option --builtins, additional files are
1671created:
1672
1673 ``qapi-builtin-visit.h``
1674     Visitor functions for built-in types
1675
1676 ``qapi-builtin-visit.c``
1677     Declarations for these visitor functions
1678
1679
1680Code generated for commands
1681---------------------------
1682
1683These are the marshaling/dispatch functions for the commands defined
1684in the schema.  The generated code provides qmp_marshal_COMMAND(), and
1685declares qmp_COMMAND() that the user must implement.
1686
1687The following files are generated:
1688
1689 ``$(prefix)qapi-commands.c``
1690     Command marshal/dispatch functions for each QMP command defined in
1691     the schema
1692
1693 ``$(prefix)qapi-commands.h``
1694     Function prototypes for the QMP commands specified in the schema
1695
1696 ``$(prefix)qapi-commands.trace-events``
1697     Trace event declarations, see :ref:`tracing`.
1698
1699 ``$(prefix)qapi-init-commands.h``
1700     Command initialization prototype
1701
1702 ``$(prefix)qapi-init-commands.c``
1703     Command initialization code
1704
1705Example::
1706
1707    $ cat qapi-generated/example-qapi-commands.h
1708    [Uninteresting stuff omitted...]
1709
1710    #ifndef EXAMPLE_QAPI_COMMANDS_H
1711    #define EXAMPLE_QAPI_COMMANDS_H
1712
1713    #include "example-qapi-types.h"
1714
1715    UserDefOne *qmp_my_command(UserDefOneList *arg1, Error **errp);
1716    void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp);
1717
1718    #endif /* EXAMPLE_QAPI_COMMANDS_H */
1719
1720    $ cat qapi-generated/example-qapi-commands.trace-events
1721    # AUTOMATICALLY GENERATED, DO NOT MODIFY
1722
1723    qmp_enter_my_command(const char *json) "%s"
1724    qmp_exit_my_command(const char *result, bool succeeded) "%s %d"
1725
1726    $ cat qapi-generated/example-qapi-commands.c
1727    [Uninteresting stuff omitted...]
1728
1729    static void qmp_marshal_output_UserDefOne(UserDefOne *ret_in,
1730                                    QObject **ret_out, Error **errp)
1731    {
1732        Visitor *v;
1733
1734        v = qobject_output_visitor_new_qmp(ret_out);
1735        if (visit_type_UserDefOne(v, "unused", &ret_in, errp)) {
1736            visit_complete(v, ret_out);
1737        }
1738        visit_free(v);
1739        v = qapi_dealloc_visitor_new();
1740        visit_type_UserDefOne(v, "unused", &ret_in, NULL);
1741        visit_free(v);
1742    }
1743
1744    void qmp_marshal_my_command(QDict *args, QObject **ret, Error **errp)
1745    {
1746        Error *err = NULL;
1747        bool ok = false;
1748        Visitor *v;
1749        UserDefOne *retval;
1750        q_obj_my_command_arg arg = {0};
1751
1752        v = qobject_input_visitor_new_qmp(QOBJECT(args));
1753        if (!visit_start_struct(v, NULL, NULL, 0, errp)) {
1754            goto out;
1755        }
1756        if (visit_type_q_obj_my_command_arg_members(v, &arg, errp)) {
1757            ok = visit_check_struct(v, errp);
1758        }
1759        visit_end_struct(v, NULL);
1760        if (!ok) {
1761            goto out;
1762        }
1763
1764        if (trace_event_get_state_backends(TRACE_QMP_ENTER_MY_COMMAND)) {
1765            g_autoptr(GString) req_json = qobject_to_json(QOBJECT(args));
1766
1767            trace_qmp_enter_my_command(req_json->str);
1768        }
1769
1770        retval = qmp_my_command(arg.arg1, &err);
1771        if (err) {
1772            trace_qmp_exit_my_command(error_get_pretty(err), false);
1773            error_propagate(errp, err);
1774            goto out;
1775        }
1776
1777        qmp_marshal_output_UserDefOne(retval, ret, errp);
1778
1779        if (trace_event_get_state_backends(TRACE_QMP_EXIT_MY_COMMAND)) {
1780            g_autoptr(GString) ret_json = qobject_to_json(*ret);
1781
1782            trace_qmp_exit_my_command(ret_json->str, true);
1783        }
1784
1785    out:
1786        visit_free(v);
1787        v = qapi_dealloc_visitor_new();
1788        visit_start_struct(v, NULL, NULL, 0, NULL);
1789        visit_type_q_obj_my_command_arg_members(v, &arg, NULL);
1790        visit_end_struct(v, NULL);
1791        visit_free(v);
1792    }
1793
1794    [Uninteresting stuff omitted...]
1795    $ cat qapi-generated/example-qapi-init-commands.h
1796    [Uninteresting stuff omitted...]
1797    #ifndef EXAMPLE_QAPI_INIT_COMMANDS_H
1798    #define EXAMPLE_QAPI_INIT_COMMANDS_H
1799
1800    #include "qapi/qmp/dispatch.h"
1801
1802    void example_qmp_init_marshal(QmpCommandList *cmds);
1803
1804    #endif /* EXAMPLE_QAPI_INIT_COMMANDS_H */
1805    $ cat qapi-generated/example-qapi-init-commands.c
1806    [Uninteresting stuff omitted...]
1807    void example_qmp_init_marshal(QmpCommandList *cmds)
1808    {
1809        QTAILQ_INIT(cmds);
1810
1811        qmp_register_command(cmds, "my-command",
1812                             qmp_marshal_my_command, 0, 0);
1813    }
1814    [Uninteresting stuff omitted...]
1815
1816For a modular QAPI schema (see section `Include directives`_), code for
1817each sub-module SUBDIR/SUBMODULE.json is actually generated into::
1818
1819 SUBDIR/$(prefix)qapi-commands-SUBMODULE.h
1820 SUBDIR/$(prefix)qapi-commands-SUBMODULE.c
1821
1822
1823Code generated for events
1824-------------------------
1825
1826This is the code related to events defined in the schema, providing
1827qapi_event_send_EVENT().
1828
1829The following files are created:
1830
1831 ``$(prefix)qapi-events.h``
1832     Function prototypes for each event type
1833
1834 ``$(prefix)qapi-events.c``
1835     Implementation of functions to send an event
1836
1837 ``$(prefix)qapi-emit-events.h``
1838     Enumeration of all event names, and common event code declarations
1839
1840 ``$(prefix)qapi-emit-events.c``
1841     Common event code definitions
1842
1843Example::
1844
1845    $ cat qapi-generated/example-qapi-events.h
1846    [Uninteresting stuff omitted...]
1847
1848    #ifndef EXAMPLE_QAPI_EVENTS_H
1849    #define EXAMPLE_QAPI_EVENTS_H
1850
1851    #include "qapi/util.h"
1852    #include "example-qapi-types.h"
1853
1854    void qapi_event_send_my_event(void);
1855
1856    #endif /* EXAMPLE_QAPI_EVENTS_H */
1857    $ cat qapi-generated/example-qapi-events.c
1858    [Uninteresting stuff omitted...]
1859
1860    void qapi_event_send_my_event(void)
1861    {
1862        QDict *qmp;
1863
1864        qmp = qmp_event_build_dict("MY_EVENT");
1865
1866        example_qapi_event_emit(EXAMPLE_QAPI_EVENT_MY_EVENT, qmp);
1867
1868        qobject_unref(qmp);
1869    }
1870
1871    [Uninteresting stuff omitted...]
1872    $ cat qapi-generated/example-qapi-emit-events.h
1873    [Uninteresting stuff omitted...]
1874
1875    #ifndef EXAMPLE_QAPI_EMIT_EVENTS_H
1876    #define EXAMPLE_QAPI_EMIT_EVENTS_H
1877
1878    #include "qapi/util.h"
1879
1880    typedef enum example_QAPIEvent {
1881        EXAMPLE_QAPI_EVENT_MY_EVENT,
1882        EXAMPLE_QAPI_EVENT__MAX,
1883    } example_QAPIEvent;
1884
1885    #define example_QAPIEvent_str(val) \
1886        qapi_enum_lookup(&example_QAPIEvent_lookup, (val))
1887
1888    extern const QEnumLookup example_QAPIEvent_lookup;
1889
1890    void example_qapi_event_emit(example_QAPIEvent event, QDict *qdict);
1891
1892    #endif /* EXAMPLE_QAPI_EMIT_EVENTS_H */
1893    $ cat qapi-generated/example-qapi-emit-events.c
1894    [Uninteresting stuff omitted...]
1895
1896    const QEnumLookup example_QAPIEvent_lookup = {
1897        .array = (const char *const[]) {
1898            [EXAMPLE_QAPI_EVENT_MY_EVENT] = "MY_EVENT",
1899        },
1900        .size = EXAMPLE_QAPI_EVENT__MAX
1901    };
1902
1903    [Uninteresting stuff omitted...]
1904
1905For a modular QAPI schema (see section `Include directives`_), code for
1906each sub-module SUBDIR/SUBMODULE.json is actually generated into ::
1907
1908 SUBDIR/$(prefix)qapi-events-SUBMODULE.h
1909 SUBDIR/$(prefix)qapi-events-SUBMODULE.c
1910
1911
1912Code generated for introspection
1913--------------------------------
1914
1915The following files are created:
1916
1917 ``$(prefix)qapi-introspect.c``
1918     Defines a string holding a JSON description of the schema
1919
1920 ``$(prefix)qapi-introspect.h``
1921     Declares the above string
1922
1923Example::
1924
1925    $ cat qapi-generated/example-qapi-introspect.h
1926    [Uninteresting stuff omitted...]
1927
1928    #ifndef EXAMPLE_QAPI_INTROSPECT_H
1929    #define EXAMPLE_QAPI_INTROSPECT_H
1930
1931    #include "qapi/qmp/qlit.h"
1932
1933    extern const QLitObject example_qmp_schema_qlit;
1934
1935    #endif /* EXAMPLE_QAPI_INTROSPECT_H */
1936    $ cat qapi-generated/example-qapi-introspect.c
1937    [Uninteresting stuff omitted...]
1938
1939    const QLitObject example_qmp_schema_qlit = QLIT_QLIST(((QLitObject[]) {
1940        QLIT_QDICT(((QLitDictEntry[]) {
1941            { "arg-type", QLIT_QSTR("0"), },
1942            { "meta-type", QLIT_QSTR("command"), },
1943            { "name", QLIT_QSTR("my-command"), },
1944            { "ret-type", QLIT_QSTR("1"), },
1945            {}
1946        })),
1947        QLIT_QDICT(((QLitDictEntry[]) {
1948            { "arg-type", QLIT_QSTR("2"), },
1949            { "meta-type", QLIT_QSTR("event"), },
1950            { "name", QLIT_QSTR("MY_EVENT"), },
1951            {}
1952        })),
1953        /* "0" = q_obj_my-command-arg */
1954        QLIT_QDICT(((QLitDictEntry[]) {
1955            { "members", QLIT_QLIST(((QLitObject[]) {
1956                QLIT_QDICT(((QLitDictEntry[]) {
1957                    { "name", QLIT_QSTR("arg1"), },
1958                    { "type", QLIT_QSTR("[1]"), },
1959                    {}
1960                })),
1961                {}
1962            })), },
1963            { "meta-type", QLIT_QSTR("object"), },
1964            { "name", QLIT_QSTR("0"), },
1965            {}
1966        })),
1967        /* "1" = UserDefOne */
1968        QLIT_QDICT(((QLitDictEntry[]) {
1969            { "members", QLIT_QLIST(((QLitObject[]) {
1970                QLIT_QDICT(((QLitDictEntry[]) {
1971                    { "name", QLIT_QSTR("integer"), },
1972                    { "type", QLIT_QSTR("int"), },
1973                    {}
1974                })),
1975                QLIT_QDICT(((QLitDictEntry[]) {
1976                    { "default", QLIT_QNULL, },
1977                    { "name", QLIT_QSTR("string"), },
1978                    { "type", QLIT_QSTR("str"), },
1979                    {}
1980                })),
1981                QLIT_QDICT(((QLitDictEntry[]) {
1982                    { "default", QLIT_QNULL, },
1983                    { "name", QLIT_QSTR("flag"), },
1984                    { "type", QLIT_QSTR("bool"), },
1985                    {}
1986                })),
1987                {}
1988            })), },
1989            { "meta-type", QLIT_QSTR("object"), },
1990            { "name", QLIT_QSTR("1"), },
1991            {}
1992        })),
1993        /* "2" = q_empty */
1994        QLIT_QDICT(((QLitDictEntry[]) {
1995            { "members", QLIT_QLIST(((QLitObject[]) {
1996                {}
1997            })), },
1998            { "meta-type", QLIT_QSTR("object"), },
1999            { "name", QLIT_QSTR("2"), },
2000            {}
2001        })),
2002        QLIT_QDICT(((QLitDictEntry[]) {
2003            { "element-type", QLIT_QSTR("1"), },
2004            { "meta-type", QLIT_QSTR("array"), },
2005            { "name", QLIT_QSTR("[1]"), },
2006            {}
2007        })),
2008        QLIT_QDICT(((QLitDictEntry[]) {
2009            { "json-type", QLIT_QSTR("int"), },
2010            { "meta-type", QLIT_QSTR("builtin"), },
2011            { "name", QLIT_QSTR("int"), },
2012            {}
2013        })),
2014        QLIT_QDICT(((QLitDictEntry[]) {
2015            { "json-type", QLIT_QSTR("string"), },
2016            { "meta-type", QLIT_QSTR("builtin"), },
2017            { "name", QLIT_QSTR("str"), },
2018            {}
2019        })),
2020        QLIT_QDICT(((QLitDictEntry[]) {
2021            { "json-type", QLIT_QSTR("boolean"), },
2022            { "meta-type", QLIT_QSTR("builtin"), },
2023            { "name", QLIT_QSTR("bool"), },
2024            {}
2025        })),
2026        {}
2027    }));
2028
2029    [Uninteresting stuff omitted...]
2030