"Pact" is an implementation of "consumer driven contract" testing that allows mocking of responses in the consumer codebase, and verification of the interactions in the provider codebase. The initial implementation was written in Ruby for Rack apps, however a consumer and provider may be implemented in different programming languages, so the "mocking" and the "verifying" steps would be best supported by libraries in their respective project's native languages. Given that the pact file is written in JSON, it should be straightforward to implement a pact library in any language, however, to get the best experience and most reliability of out mixing pact libraries, the matching logic for the requests and responses needs to be identical. There is little confidence to be gained in having your pacts "pass" if the logic used to verify a "pass" is inconsistent between implementations.
To support consistency of matching logic, this specification has been developed as a benchmark that all pact libraries can check themselves against if they want to ensure consistency with other pact libraries.
- Be as strict as we reasonably can with what we send out (requests). We should know and be able to control exactly what a consumer is sending out. Information should not be allowed to "leak" silently.
- Be as loose as we reasonably can with what we accept (responses). A provider should be able to send extra information that this particular consumer does not care about, without breaking this consumer.
- When writing the matching rules, err on the side of being more strict now, because it will break fewer things to be looser later, than to get stricter later.
Note: One implications of this philosophy is that you cannot verify, using pact, that a key or a header will not be present in a response. You can only verify what is.
See this gist for an idea of where version 2.0 is came from.
For a declarative, structured format of this version of the specification, see its JSON Schema.
Exact string match, case insensitive.
Exact string match, case sensitive, as paths are generally case sensitive. Trailing slashes should not be ignored, as they could potentially have significance.
Query strings must have the same key-value pairs. Keys can be present in any order, but when the same key occurs multiple times, the values must be in the same order.
Exact string match for expected header names and values. Allow unexpected headers to be sent out, as frameworks and network utilities are likely to set their own headers (eg. User-Agent), and it would increase the maintenance burden to have to track all of those.
- Do not allow unexpected keys to be sent in the body. See "Pact Specificaton Philosophy" in main README.
- Do not allow unexpected items in an array. Most parsing code will do a "for each" on an array, and if we expect one item, but two go out, we have "leaked" information.
Exact integer match.
Exact string match for expected header names and values. Allow unexpected headers to be sent back, as in reality, as extra headers will be added by network utilities and server frameworks.
- Allow unexpected keys to be sent back in the body. See "Pact Specification Philosophy" in main README.
- Do not allow unexpected items in an array. Most parsing code will do a "for each" on an array, and if we expect one item, but receive two, we might not have exercised the correct code to handle that second item in our consumer tests.
The main difference from V1 is the semantics around the body element in the pact files and the addition of matchers. This specification defines the following conditions:
If the body of the request or response is present, then follow the normal rules for matching the bodies.
If there is no body in the pact file, then this indicates that the body contents are not important, and can be ignored.
If the body is present in the pact file, but is an empty string, then this indicates that the request or response body must be empty.
This is a side effect of JSON and language implementations with NULL values. It has the following semantics:
- Where the content type is
application\json
, this represents a valid JSON document consisting of the single JSON value ofnull
. It may be treated as either an empty body or follow the rules for matching bodies. The preference would be to treat it as a JSON body and use an empty string for an absent body. - For other content types, it is treated as an empty body for matching purposes.
By default, the content type comes from the Content-Type
header. The following rules determine the content type:
- If there is a
Content-Type
header, the value of the header determines the content type. - If the
Content-Type
header, is not present, then:- OPTIONAL - The content type can be determined from the first few characters of the body (know as a magic number test).
- default to either
application/json
(as V1) ortext/plain
.
Pact supports extending the matching rules on each type of object (Request or Response) with a matchingRules
element in the pact file.
This is a map of JSON path strings to a matcher. When an item is being compared, if there is an entry in the matching
rules that corresponds to the path to the item, the comparison will be delegated to the defined matcher. Note that the
matching rules cascade, so a rule can be specified on a value and will apply to all children of that value.
Pact does not support the full JSON path expressions, only ones that match the following rules:
- All paths start with a dollar (
$
), representing the root. - All path elements are either separated by periods (
.
) or use the JSON path bracket notation (square brackets and single quotes around the values: e.g.['x.y']
), except array indices which use square brackets ([]
). For elements where the value contains white space or non-alphanumeric characters, the JSON path bracket notation (['']
) should be used. - The second element of the path is the http type that the matcher is applied to (e.g.,
$.body
or$.header
). - Path elements represent keys.
- A star (
*
) can be used to match all keys of a map or all items of an array (one level only).
So the expression $.body.item1.level[1].id
will match the highlighted item in the following body:
{
"item1": {
"level": [
{
"id": 100
},
{
"id": 101 // <---- $.body.item1.level[1].id
},
{
"id": 102
},
{
"id": 103
}
]
}
}
while $.body.*.level[*].id
will match all the ids of all the levels for all items.
Due to the star notation, there can be multiple matcher paths defined that correspond to an item. The first, most specific expression is selected by assigning weightings to each path element and taking the product of the weightings. The matcher with the path with the largest weighting is used.
- The root node (
$
) is assigned the value 2. - Any path element that does not match is assigned the value 0.
- Any property name that matches a path element is assigned the value 2.
- Any array index that matches a path element is assigned the value 2.
- Any star (
*
) that matches a property or array index is assigned the value 1. - Everything else is assigned the value 0.
So for the body with highlighted item:
{
"item1": {
"level": [
{
"id": 100
},
{
"id": 101 // <--- Item under consideration
},
{
"id": 102
},
{
"id": 103
}
]
}
}
The expressions will have the following weightings:
expression | weighting calculation | weighting |
---|---|---|
$ | $(2) | 2 |
$.body | $(2).body(2) | 4 |
$.body.item1 | $(2).body(2).item1(2) | 8 |
$.body.item2 | $(2).body(2).item2(0) | 0 |
$.header.item1 | $(2).header(0).item1(2) | 0 |
$.body.item1.level | $(2).body(2).item1(2).level(2) | 16 |
$.body.item1.level[1] | $(2).body(2).item1(2).level(2)[1(2)] | 32 |
$.body.item1.level[1].id | $(2).body(2).item1(2).level(2)[1(2)].id(2) | 64 |
$.body.item1.level[1].name | $(2).body(2).item1(2).level(2)[1(2)].name(0) | 0 |
$.body.item1.level[2] | $(2).body(2).item1(2).level(2)[2(0)] | 0 |
$.body.item1.level[2].id | $(2).body(2).item1(2).level(2)[2(0)].id(2) | 0 |
$.body.item1.level[*].id | $(2).body(2).item1(2).level(2)[*(1)].id(2) | 32 |
$.body.*.level[*].id | $(2).body(2).(1).level(2)[(1)].id(2) | 16 |
So for the item with id 101, the matcher with path $.body.item1.level[1].id
and weighting 64 will be selected.
The following matchers are supported:
matcher | example configuration | description |
---|---|---|
Regex | { "match": "regex", "regex": "\\d+" } |
This executes a regular expression match against the string representation of a values. |
Type | { "match": "type" } |
This executes a type based match against the values, that is, they are equal if they are the same type. |
MinType | { "match": "type", "min": 2 } |
This executes a type based match against the values, that is, they are equal if they are the same type. In addition, if the values represent a collection, the length of the actual value is compared against the minimum. |
MaxType | { "match": "type", "max": 10 } |
This executes a type based match against the values, that is, they are equal if they are the same type. In addition, if the values represent a collection, the length of the actual value is compared against the maximum. |
If no matcher is specified an equality matcher will be used, which relies on the equals operator.
This is an example of a pact file:
{
"provider": {
"name": "266_provider"
},
"consumer": {
"name": "test_consumer"
},
"interactions": [
{
"description": "get all users for max",
"request": {
"method": "GET",
"path": "/idm/user"
},
"response": {
"status": 200,
"headers": {
"Content-Type": "application/json; charset=UTF-8"
},
"body": [
[
{
"email": "rddtGwwWMEhnkAPEmsyE",
"id": "eb0f8c17-c06a-479e-9204-14f7c95b63a6",
"userName": "AJQrokEGPAVdOHprQpKP"
}
]
],
"matchingRules": {
"$.body[0][*].email": {
"match": "type"
},
"$.body[0][*].id": {
"regex": "[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}"
},
"$.body[0]": {
"max": 5,
"match": "type"
},
"$.body[0][*].userName": {
"match": "type"
}
}
},
"providerState": "a user with an id named 'user' exists"
},
{
"description": "get all users for min",
"request": {
"method": "GET",
"path": "/idm/user"
},
"response": {
"status": 200,
"headers": {
"Content-Type": "application/json; charset=UTF-8"
},
"body": [
[
{
"email": "DPvAfkCZpOBZWzKYiDMC",
"id": "95d0371b-bf30-4943-90a8-8bb1967c4cb2",
"userName": "GIUlVKoiLdHLYNKGbcSy"
}
]
],
"matchingRules": {
"$.body[0][*].email": {
"match": "type"
},
"$.body[0][*].id": {
"regex": "[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}"
},
"$.body[0]": {
"min": 5,
"match": "type"
},
"$.body[0][*].userName": {
"match": "type"
}
}
},
"providerState": "a user with an id named 'user' exists"
}
],
"metadata": {
"pactSpecification": {
"version": "2.0.0"
},
"pact-jvm": {
"version": "3.2.11"
}
}
}