Last updated

Table of Contents

Introduction

Data Workspace- Data Flow Services expose many services which enable an application developer to perform various data transformation workflows. One such transformation workflow is merging wks data records from different sources (public, 3rd party, etc.) to build an improved or more complete version of a record. This workflow can add missing values or update existing ones from more trustworthy sources, which is called the Master record. The process of creating a Master record is called the Data Mastering workflow. The Data Mastering service collects and transforms all of the data from one or more sources for the same entity type and creates a blended record based on source attribute prioritization rules. For example, a data manager can declare that corporate sources have a higher priority than public sources for specific attributes.

Data Mastering Workflow

Pre-requisites

The Data Mastering service performs the merging of attributes on the basis of the "Source" attribute present in a WKS record. To have this "Source" information in a WKS record, your mapping file, which maps the attributes of a RAW record to a WKS record, must contain the mapping of the "Source" attribute.

The following examples show the mapping of the "source" attribute which must exist in the RAW to WKS transformation mapping file:

Source attribute mapping with kind
        {
          "identifier": "Source",
          "operations": [
            {
              "type": "COPY",
              "sourceProperty": "kind",
              "targetProperty": "data.Source"
            }
          ]
        }

Source attribute mapping with constant value
        {
          "identifier": "Source",
          "operations": [
            {
              "type": "CONSTANT",
              "sourceProperty": "CorporateDB",
              "targetProperty": "data.Source"
            }
          ]
        }

You can create the Source(RAW) to WKS mapping file by using the Data Flow - Mapping Service - POST /mappings endpoint as shown here. For more details about creating the Mapping file, refer to the Mapping Service tutorial.


Back to table of contents

Configurations

This service requires the following information to perform the Data Mastering process:

  • A. Match Rules:
    • WKS Record Kind: This refers to the kind of record that is in process for Master record creation. (For example, "osdu:wks:master-data--Wellbore:1.0.0", "osdu:wks:master-data--Well:1.0.0", "osdu:wks:master-data--Field:1.0.0" etc.)
    • Source: This refers to the source from which above WKS record is derived and for which priorities to merge the attributes are present in MergeRules.
    • MatchKey(s): This is required to search the already created Master record. If the service finds the already created Master record, then it starts the merging process; otherwise it creates a new Master record.
  • B. MergeRules: MergeRules specifies conditions and priorities based on which multiple source records can be merged to produce a single golden (Master) record. Refer to the example presented here to better understand the MergeRules.

Back to table of contents

How to create the configurations

You can create these configurations using Data Flow Service - Data Mastering Configurations APIs.API reference. For more details about these configurations, refer to the Mastering Configuration.


Back to table of contents

Example of the Data Mastering Workflow using the sample configurations

The following is an example of Match Rules, Merge Rules, WKS records of different sources, and a generated Master record that explains the Data Mastering Workflow (merging of the attributes) as per its actual use:

Match Rules for master-data--Wellbore and Source-A
        {
          "kind": "osdu:wks:master-data--Wellbore:1.*.*",
          "source": "Source-A",
          "matchRules": [
            {
              "priority": 1,
              "matchKeys": [
                {
                  "matchKey": "data.NameAliases[#].AliasName",
                  "andCondition": [
                    {
                      "type": "equals",
                      "attribute": "data.NameAliases[#].AliasNameTypeID",
                      "value": "{datapartition}:reference-data--AliasNameType:UniqueIdentifier:"
                    }
                  ]
                }
              ]
            },
            {
              "priority": 2,
              "matchKeys": [
                {
                  "matchKey": "data.FacilityID"
                }
              ]
            },
            {
              "priority": 3,
              "matchKeys": [
                {
                  "matchKey": "data.SpatialLocation.AsIngestedCoordinates.features[#].geometry.coordinates"
                }
              ]
            }
          ]
        }

Match Rules for master-data--Wellbore and Source-B
        {
          "kind": "osdu:wks:master-data--Wellbore:1.*.*",
          "source": "Source-B",
          "matchRules": [
            {
              "priority": 1,
              "matchKeys": [
                {
                  "matchKey": "data.FacilityID"
                }
              ]
            }
          ]
        }

Merge Rules
        {
          "kind": "osdu:wks:master-data--Wellbore:1.*.*",
          "mergeRules": [
            {
              "attribute": "data.FacilityName",
              "rules": [
                {
                  "priorities": [
                    "Source-A",
                    "Source-B"
                  ]
                }
              ]
            },
            {
              "attribute": "data.FacilityID",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ]
                }
              ]
            },
            {
              "attribute": "data.FacilitySpecifications[*]",
              "rules": [
                {
                  "priorities": [
                    "Source-A",
                    "Source-B"
                  ]
                }
              ]
            },
            {
              "attribute": "data.FacilityStates[*]",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ]
                }
              ]
            },
            {
              "attribute": "data.VerticalMeasurements[*]",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ],
                  "andCondition": [
                    {
                      "type": "notEquals",
                      "attribute": "data.VerticalMeasurements[#].VerticalMeasurementTypeID",
                      "values": [
                        "{datapartition}:reference-data--VerticalMeasurementType:KB:",
                        "{datapartition}:reference-data--VerticalMeasurementType:TVD:"
                      ]
                    }
                  ]
                }
              ]
            },
            {
              "attribute": "data.SpatialLocation",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ]
                }
              ]
            },
            {
              "attribute": "data.KickOffWellbore",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ]
                }
              ]
            },
            {
              "attribute": "data.NameAliases[*]",
              "rules": [
                {
                  "priorities": [
                    "Source-A",
                    "Source-B"
                  ],
                  "andCondition": [
                    {
                      "type": "equals",
                      "attribute": "data.NameAliases[#].AliasNameTypeID",
                      "values": [
                        "{datapartition}:reference-data--AliasNameType:UniqueIdentifier:",
                        "{datapartition}:reference-data--AliasNameType:LeaseIdentifier:"
                      ]
                    }
                  ]
                },
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ],
                  "andCondition": [
                    {
                      "type": "equals",
                      "attribute": "data.NameAliases[#].AliasNameTypeID",
                      "values": [
                        "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:"
                      ]
                    }
                  ]
                }
              ]
            },
            {
              "attribute": "data.ExtensionProperties.SLBWellContexts",
              "rules": [
                {
                  "priorities": [
                    "Source-A",
                    "Source-B"
                  ]
                }
              ]
            },
            {
              "attribute": "data.ExtensionProperties.LocationContexts.Country",
              "rules": [
                {
                  "priorities": [
                    "Source-A",
                    "Source-B"
                  ]
                }
              ]
            },
            {
              "attribute": "data.ExtensionProperties.LocationContexts.EwDirection",
              "rules": [
                {
                  "priorities": [
                    "Source-B",
                    "Source-A"
                  ]
                }
              ]
            }
          ]
        }

WKS record from Source-A
       {
          "data": {
            "NameAliases": [
              {
                "AliasName": "SLB-UWI-A101",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:UniqueIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              },
              {
                "AliasName": "Lease-A",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:LeaseIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              },
              {
                "AliasName": "Field-A",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              }
            ],
            "FacilitySpecifications": [
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:SlotName:",
                "EffectiveDateTime": "2022-01-15T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2022-03-22T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              },
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:PermitNumber:",
                "TerminationDateTime": "2022-02-15T09:13:15.55Z",
                "EffectiveDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              }
            ],
            "FacilityStates": [
              {
                "EffectiveDateTime": "2021-02-13T08:13:15.55Z",
                "TerminationDateTime": "2021-09-10T10:15:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Planning:"
              }
            ],
            "FacilityEvents": [
              {
                "FacilityEventTypeID": "{datapartition}:reference-data--FacilityEventType:WorkoverFinish:",
                "EffectiveDateTime": "2021-08-25T11:45:25.45Z"
              }
            ],
            "FacilityOperators": [
              {
                "FacilityOperatorID": "SLB-Trusted-Operator",
                "FacilityOperatorOrganisationID": "{datapartition}:master-data--Organisation:48428bc276a94fbab522c3e8dac2d11a",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2022-03-25T09:13:15.55Z"
              }
            ],
            "SpatialLocation": {
              "AsIngestedCoordinates": {
                "CoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:BoundCRS.SLB.32021.15852:",
                "features": [
                  {
                    "geometry": {
                      "coordinates": [
                        -73.771724,
                        42.516771
                      ],
                      "type": "AnyCrsPoint"
                    },
                    "type": "AnyCrsFeature",
                    "properties": {}
                  }
                ],
                "persistableReferenceCrs": "{\\lateBoundCRS\\\":{\\\"wkt\\\":\\\"PROJCS[\\\\\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],PROJECTION[\\\\\\\"Lambert_Conformal_Conic\\\\\\\"],PARAMETER[\\\\\\\"False_Easting\\\\\\2000000.0],PARAMETER[\\\\\\\"False_Northing\\\\\\0.0],PARAMETER[\\\\\\\"Central_Meridian\\\\\\-100.5],PARAMETER[\\\\\\\"Standard_Parallel_1\\\\\\46.1833333333333],PARAMETER[\\\\\\\"Standard_Parallel_2\\\\\\47.4833333333333],PARAMETER[\\\\\\\"Latitude_Of_Origin\\\\\\45.6666666666667],UNIT[\\\\\\\"Foot_US\\\\\\0.304800609601219],AUTHORITY[\\\\\\\"EPSG\\\\\\32021]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"32021\\\"},\\\"type\\\":\\\"LBC\\\"},\\\"singleCT\\\":{\\\"wkt\\\":\\\"GEOGTRAN[\\\\\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],GEOGCS[\\\\\\\"GCS_WGS_1984\\\\\\DATUM[\\\\\\\"D_WGS_1984\\\\\\SPHEROID[\\\\\\\"WGS_1984\\\\\\6378137.0,298.257223563]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],METHOD[\\\\\\\"NADCON\\\\\\\"],PARAMETER[\\\\\\\"Dataset_conus\\\\\\0.0],AUTHORITY[\\\\\\\"EPSG\\\\\\15851]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"15851\\\"},\\\"type\\\":\\\"ST\\\"},\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD27 * OGP-Usa Conus / North Dakota South [32021,15851]\\\\\"authCode\\\":{\\\"auth\\\":\\\"SLB\\\\\"code\\\":\\\"32021079\\\"},\\\"type\\\":\\\"EBC\\\"}\"",
                "persistableReferenceUnitZ": "{\\scaleOffset\\\":{\\\"scale\\\":1.0,\\\"offset\\\":0.0},\\\"symbol\\\":\\\"m\\\\\"baseMeasurement\\\":{\\\"ancestry\\\":\\\"Length\\\\\"type\\\":\\\"UM\\\"},\\\"type\\\":\\\"USO\\\"}\"",
                "persistableReferenceVerticalCrs": "{\\authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"5773\\\"},\\\"type\\\":\\\"LBC\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"EGM96_Geoid\\\\\"wkt\\\":\\\"VERTCS[\\\\\\\"EGM96_Geoid\\\\\\VDATUM[\\\\\\\"EGM96_Geoid\\\\\\\"],PARAMETER[\\\\\\\"Vertical_Shift\\\\\\0.0],PARAMETER[\\\\\\\"Direction\\\\\\1.0],UNIT[\\\\\\\"Meter\\\\\\1.0],AUTHORITY[\\\\\\\"EPSG\\\\\\5773]]\\\"}\"",
                "type": "AnyCrsFeatureCollection",
                "VerticalCoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:VerticalCRS.EPSG.5773:"
              },
              "CoordinateQualityCheckPerformedBy": "Example CoordinateQualityCheckPerformedBy",
              "CoordinateQualityCheckDateTime": "2020-02-13T09:13:15.55Z",
              "SpatialLocationCoordinatesDate": "2020-02-13T09:13:15.55Z"
            },
            "FacilityName": "SLB-A-101",
            "Source": "Source-A",
            "FacilityID": "SLB-Trusted-External-Facility-A",
            "VerticalMeasurements": [
              {
                "VerticalMeasurement": 1001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:KB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 2001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:RB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 3001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:MD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 4001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:TVD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              }
            ],
            "KickOffWellbore": "{datapartition}:master-data--Wellbore:8cf5990a5f434cd189212b1fbf66c513:",
            "ExtensionProperties": {
              "SLBWellContexts": {
                "AbstractNum": 415.28,
                "ApiStateCode": 75,
                "CoordSystemId": "{datapartition}:slb:system-ea34fed542:12467824126"
              },
              "LocationContexts": {
                "Country": "AUSTRALIA",
                "EwDirection": "North-West",
                "PrimaryKeyNodeID": "0123456789000020",
                "PREMASFLAG": true
              }
            }
          },
          "meta": [
            {
              "kind": "Unit",
              "name": "m",
              "persistableReference": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"L\",\"type\":\"UM\"},\"type\":\"USO\"}",
              "unitOfMeasureID": "{datapartition}:reference-data--UnitOfMeasure:ft",
              "propertyNames": [
                "VerticalMeasurements[0].VerticalMeasurement",
                "VerticalMeasurements[1].VerticalMeasurement",
                "VerticalMeasurements[2].VerticalMeasurement",
                "VerticalMeasurements[3].VerticalMeasurement"
              ]
            }
          ],
          "id": "{datapartition}:master-data--Wellbore:33655890e0054c4991f12fd3c1edd089",
          "version": 1648625779422061,
          "kind": "osdu:wks:master-data--Wellbore:1.0.0",
          "acl": {
            "viewers": [
              "data.default.viewers@{datapartition}.enterprisedata.slb.com"
            ],
            "owners": [
              "data.default.owners@{datapartition}.enterprisedata.slb.com"
            ]
          },
          "legal": {
            "legaltags": [
              "{datapartition}-default-legal"
            ],
            "otherRelevantDataCountries": [
              "US"
            ],
            "status": "compliant"
          }
        }

You can search the corresponding Master record of the above WKS record with the following payload using the OSDU Core - Search Service - here.

Searching for the corresponding Master record
        {
            "kind": "osdu:wks:master-data--Wellbore:1.0.0",
            "query": "data.FacilityID:\"SLB-Trusted-External-Facility-A\" AND tags.DataMastering:\"Master\""
        }

Generated Master record from the above WKS record of Source-A
        {
          "data": {
            "NameAliases": [
              {
                "AliasName": "SLB-UWI-A101",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:UniqueIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              },
              {
                "AliasName": "Lease-A",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:LeaseIdentifier:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:"
              },
              {
                "AliasName": "Field-A",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:"
              }
            ],
            "FacilitySpecifications": [
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:SlotName:",
                "EffectiveDateTime": "2022-01-15T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2022-03-22T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              },
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:PermitNumber:",
                "TerminationDateTime": "2022-02-15T09:13:15.55Z",
                "EffectiveDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              }
            ],
            "FacilityStates": [
              {
                "EffectiveDateTime": "2021-02-13T08:13:15.55Z",
                "TerminationDateTime": "2021-09-10T10:15:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Planning:"
              }
            ],
            "SpatialLocation": {
              "AsIngestedCoordinates": {
                "CoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:BoundCRS.SLB.32021.15852:",
                "features": [
                  {
                    "geometry": {
                      "coordinates": [
                        -73.771724,
                        42.516771
                      ],
                      "type": "AnyCrsPoint"
                    },
                    "type": "AnyCrsFeature",
                    "properties": {}
                  }
                ],
                "persistableReferenceCrs": "{\\lateBoundCRS\\\":{\\\"wkt\\\":\\\"PROJCS[\\\\\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],PROJECTION[\\\\\\\"Lambert_Conformal_Conic\\\\\\\"],PARAMETER[\\\\\\\"False_Easting\\\\\\2000000.0],PARAMETER[\\\\\\\"False_Northing\\\\\\0.0],PARAMETER[\\\\\\\"Central_Meridian\\\\\\-100.5],PARAMETER[\\\\\\\"Standard_Parallel_1\\\\\\46.1833333333333],PARAMETER[\\\\\\\"Standard_Parallel_2\\\\\\47.4833333333333],PARAMETER[\\\\\\\"Latitude_Of_Origin\\\\\\45.6666666666667],UNIT[\\\\\\\"Foot_US\\\\\\0.304800609601219],AUTHORITY[\\\\\\\"EPSG\\\\\\32021]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"32021\\\"},\\\"type\\\":\\\"LBC\\\"},\\\"singleCT\\\":{\\\"wkt\\\":\\\"GEOGTRAN[\\\\\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],GEOGCS[\\\\\\\"GCS_WGS_1984\\\\\\DATUM[\\\\\\\"D_WGS_1984\\\\\\SPHEROID[\\\\\\\"WGS_1984\\\\\\6378137.0,298.257223563]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],METHOD[\\\\\\\"NADCON\\\\\\\"],PARAMETER[\\\\\\\"Dataset_conus\\\\\\0.0],AUTHORITY[\\\\\\\"EPSG\\\\\\15851]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"15851\\\"},\\\"type\\\":\\\"ST\\\"},\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD27 * OGP-Usa Conus / North Dakota South [32021,15851]\\\\\"authCode\\\":{\\\"auth\\\":\\\"SLB\\\\\"code\\\":\\\"32021079\\\"},\\\"type\\\":\\\"EBC\\\"}\"",
                "persistableReferenceUnitZ": "{\\scaleOffset\\\":{\\\"scale\\\":1.0,\\\"offset\\\":0.0},\\\"symbol\\\":\\\"m\\\\\"baseMeasurement\\\":{\\\"ancestry\\\":\\\"Length\\\\\"type\\\":\\\"UM\\\"},\\\"type\\\":\\\"USO\\\"}\"",
                "persistableReferenceVerticalCrs": "{\\authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"5773\\\"},\\\"type\\\":\\\"LBC\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"EGM96_Geoid\\\\\"wkt\\\":\\\"VERTCS[\\\\\\\"EGM96_Geoid\\\\\\VDATUM[\\\\\\\"EGM96_Geoid\\\\\\\"],PARAMETER[\\\\\\\"Vertical_Shift\\\\\\0.0],PARAMETER[\\\\\\\"Direction\\\\\\1.0],UNIT[\\\\\\\"Meter\\\\\\1.0],AUTHORITY[\\\\\\\"EPSG\\\\\\5773]]\\\"}\"",
                "type": "AnyCrsFeatureCollection",
                "VerticalCoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:VerticalCRS.EPSG.5773:"
              },
              "CoordinateQualityCheckPerformedBy": "Example CoordinateQualityCheckPerformedBy",
              "CoordinateQualityCheckDateTime": "2020-02-13T09:13:15.55Z",
              "SpatialLocationCoordinatesDate": "2020-02-13T09:13:15.55Z"
            },
            "FacilityName": "SLB-A-101",
            "Source": "Data Mastering Service",
            "FacilityID": "SLB-Trusted-External-Facility-A",
            "VerticalMeasurements": [
              {
                "VerticalMeasurement": 2001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:RB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 3001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:MD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              }
            ],
            "ExtensionProperties": {
              "SLBWellContexts": {
                "AbstractNum": 415.28,
                "ApiStateCode": 75,
                "CoordSystemId": "{datapartition}:slb:system-ea34fed542:12467824126"
              },
              "LocationContexts": {
                "Country": "AUSTRALIA",
                "EwDirection": "North-West",
                "PrimaryKeyNodeID": "0123456789000020",
                "PREMASFLAG": true
              },
              "wkeLatestLineageId": "{datapartition}:master-data--Wellbore:1f98fbe8-d015-41c0-b455-12a2fc6db261",
              "wkeVersion": 1,
              "wkeEntityId": "6f3d82d031fe4d290879e512c47e1e0"
            },
            "KickOffWellbore": "{datapartition}:master-data--Wellbore:6f3d82d031fe4d290879e512c47e1e0.data.master:"
          },
          "meta": [
            {
              "kind": "Unit",
              "name": "m",
              "persistableReference": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"L\",\"type\":\"UM\"},\"type\":\"USO\"}",
              "propertyNames": [
                "VerticalMeasurements[0].VerticalMeasurement",
                "VerticalMeasurements[1].VerticalMeasurement"
              ]
            }
          ],
          "id": "{datapartition}:master-data--Wellbore:3d24901874f766ac6cf1181cd287ca8d97f0a625ddf1502e6f070d61be226d4d.data.master",
          "version": 1648626079104980,
          "kind": "osdu:wks:master-data--Wellbore:1.0.0",
          "acl": {
            "viewers": [
              "data.default.viewers@{datapartition}.enterprisedata.slb.com"
            ],
            "owners": [
              "data.default.owners@{datapartition}.enterprisedata.slb.com"
            ]
          },
          "legal": {
            "legaltags": [
              "{datapartition}-default-legal"
            ],
            "otherRelevantDataCountries": [
              "US"
            ],
            "status": "compliant"
          },
          "tags": {
            "DataMastering": "Master"
          },
          "ancestry": {
            "parents": [
              "{datapartition}:master-data--Wellbore:33655890e0054c4991f12fd3c1edd089:1648625779422061"
            ]
          }
        }

Things to observe in this Master record -

  • It contains all of the attributes for which the source priorities are set in MergeRules.
  • It contains only those objects of "VerticalMeasurements" attribute where VerticalMeasurementTypeID is not equals to "{datapartition}:reference-data--VerticalMeasurementType:KB:" and "{datapartition}:reference-data--VerticalMeasurementType:TVD:" (as defined in the Merge Rules).
  • For all attributes marked as "x-osdu-relationship" in the schema, the Data Mastering service finds the related Master counterpart or preserves the relationship as provided in the WKS record. In this example,"KickOffWellbore" contains the Master counterpart (such as "{datapartition}:master-data--Wellbore:6f3d82d031fe4d290879e512c47e1e0.data.master") of WKS ("{datapartition}:master-data--Wellbore:8cf5990a5f434cd189212b1fbf66c513")).
  • It is created with kind:"osdu:wks:master-data--Wellbore:*" for which the curation configurations are created and the record will have a tag "DataMastering": "Master" added to it.
  • Also, it contains "Source" value as "Data Mastering Service" as it is generated by this service.

WKS record from Source-B
        {
          "data": {
            "NameAliases": [
              {
                "AliasName": "Lease-B",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:LeaseIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              },
              {
                "AliasName": "Field-B",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              }
            ],
            "SpatialLocation": {
              "AsIngestedCoordinates": {
                "CoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:BoundCRS.SLB.32021.15852:",
                "features": [
                  {
                    "geometry": {
                      "coordinates": [
                        -73.771724,
                        42.516771
                      ],
                      "type": "AnyCrsPoint"
                    },
                    "type": "AnyCrsFeature",
                    "properties": {}
                  }
                ],
                "persistableReferenceCrs": "{\\lateBoundCRS\\\":{\\\"wkt\\\":\\\"PROJCS[\\\\\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],PROJECTION[\\\\\\\"Lambert_Conformal_Conic\\\\\\\"],PARAMETER[\\\\\\\"False_Easting\\\\\\2000000.0],PARAMETER[\\\\\\\"False_Northing\\\\\\0.0],PARAMETER[\\\\\\\"Central_Meridian\\\\\\-100.5],PARAMETER[\\\\\\\"Standard_Parallel_1\\\\\\46.1833333333333],PARAMETER[\\\\\\\"Standard_Parallel_2\\\\\\47.4833333333333],PARAMETER[\\\\\\\"Latitude_Of_Origin\\\\\\45.6666666666667],UNIT[\\\\\\\"Foot_US\\\\\\0.304800609601219],AUTHORITY[\\\\\\\"EPSG\\\\\\32021]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"32021\\\"},\\\"type\\\":\\\"LBC\\\"},\\\"singleCT\\\":{\\\"wkt\\\":\\\"GEOGTRAN[\\\\\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],GEOGCS[\\\\\\\"GCS_WGS_1984\\\\\\DATUM[\\\\\\\"D_WGS_1984\\\\\\SPHEROID[\\\\\\\"WGS_1984\\\\\\6378137.0,298.257223563]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],METHOD[\\\\\\\"NADCON\\\\\\\"],PARAMETER[\\\\\\\"Dataset_conus\\\\\\0.0],AUTHORITY[\\\\\\\"EPSG\\\\\\15851]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"15851\\\"},\\\"type\\\":\\\"ST\\\"},\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD27 * OGP-Usa Conus / North Dakota South [32021,15851]\\\\\"authCode\\\":{\\\"auth\\\":\\\"SLB\\\\\"code\\\":\\\"32021079\\\"},\\\"type\\\":\\\"EBC\\\"}\"",
                "persistableReferenceUnitZ": "{\\scaleOffset\\\":{\\\"scale\\\":1.0,\\\"offset\\\":0.0},\\\"symbol\\\":\\\"m\\\\\"baseMeasurement\\\":{\\\"ancestry\\\":\\\"Length\\\\\"type\\\":\\\"UM\\\"},\\\"type\\\":\\\"USO\\\"}\"",
                "persistableReferenceVerticalCrs": "{\\authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"5773\\\"},\\\"type\\\":\\\"LBC\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"EGM96_Geoid\\\\\"wkt\\\":\\\"VERTCS[\\\\\\\"EGM96_Geoid\\\\\\VDATUM[\\\\\\\"EGM96_Geoid\\\\\\\"],PARAMETER[\\\\\\\"Vertical_Shift\\\\\\0.0],PARAMETER[\\\\\\\"Direction\\\\\\1.0],UNIT[\\\\\\\"Meter\\\\\\1.0],AUTHORITY[\\\\\\\"EPSG\\\\\\5773]]\\\"}\"",
                "type": "AnyCrsFeatureCollection",
                "VerticalCoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:VerticalCRS.EPSG.5773:"
              },
              "CoordinateQualityCheckPerformedBy": "Example CoordinateQualityCheckPerformedBy",
              "CoordinateQualityCheckDateTime": "2020-02-13T09:13:15.55Z",
              "SpatialLocationCoordinatesDate": "2020-02-13T09:13:15.55Z"
            },
            "FacilityName": "SLB-A-101",
            "Source": "Source-B",
            "FacilityID": "SLB-Trusted-External-Facility-A",
            "FacilitySpecifications": [
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:SlotName:",
                "EffectiveDateTime": "2022-03-22T09:13:15.55Z",
                "TerminationDateTime": "2022-04-25T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2022-03-22T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              }
            ],
            "FacilityStates": [
              {
                "EffectiveDateTime": "2021-02-13T08:13:15.55Z",
                "TerminationDateTime": "2021-09-10T10:15:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Planning:"
              },
              {
                "EffectiveDateTime": "2021-10-15T08:13:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Operating:"
              }
            ],
            "VerticalMeasurements": [
              {
                "VerticalMeasurement": 1001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:KB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 5001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:RB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 4001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:DF:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 6001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:TD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              }
            ],
            "KickOffWellbore": "{datapartition}:master-data--Wellbore:8cf5990a5f434cd189212b1fbf66c513:",
            "ExtensionProperties": {
              "SLBWellContexts": {
                "AbstractNum": 515.28,
                "ApiStateCode": 85,
                "CoordSystemId": "{datapartition}:slb:system-ea34fed542:12467824126"
              },
              "LocationContexts": {
                "Country": "NEW ZEALAND",
                "EwDirection": "East-South",
                "PrimaryKeyNodeID": "0123456789000020"
              }
            }
          },
          "meta": [
            {
              "kind": "Unit",
              "name": "m",
              "persistableReference": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"L\",\"type\":\"UM\"},\"type\":\"USO\"}",
              "propertyNames": [
                "VerticalMeasurements[0].VerticalMeasurement",
                "VerticalMeasurements[1].VerticalMeasurement",
                "VerticalMeasurements[2].VerticalMeasurement",
                "VerticalMeasurements[3].VerticalMeasurement"
              ]
            }
          ],
          "id": "{datapartition}:master-data--Wellbore:fc2d90eeccde4c6a895c1c269b02696a",
          "version": 1648629067707806,
          "kind": "osdu:wks:master-data--Wellbore:1.0.0",
          "acl": {
            "viewers": [
              "data.default.viewers@{datapartition}.enterprisedata.slb.com"
            ],
            "owners": [
              "data.default.owners@{datapartition}.enterprisedata.slb.com"
            ]
          },
          "legal": {
            "legaltags": [
              "{datapartition}-default-legal"
            ],
            "otherRelevantDataCountries": [
              "US"
            ],
            "status": "compliant"
          }
        }

Final Master record merged by WKS of Source-B
        {
          "data": {
            "NameAliases": [
              {
                "AliasName": "SLB-UWI-A101",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:UniqueIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              },
              {
                "AliasName": "Lease-A",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:LeaseIdentifier:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:"
              },
              {
                "AliasName": "Field-B",
                "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:",
                "DefinitionOrganisationID": "{datapartition}:master-data--Organisation:c5a035f54c7646449fe1a87c9606de3e:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2023-03-13T09:13:15.55Z"
              }
            ],
            "FacilitySpecifications": [
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:SlotName:",
                "EffectiveDateTime": "2022-01-15T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2022-03-22T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              },
              {
                "FacilitySpecificationText": "Example FacilitySpecificationText",
                "ParameterTypeID": "{datapartition}:reference-data--ParameterType:PermitNumber:",
                "TerminationDateTime": "2022-02-15T09:13:15.55Z",
                "EffectiveDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationDateTime": "2021-01-10T09:13:15.55Z",
                "FacilitySpecificationIndicator": "False"
              }
            ],
            "FacilityStates": [
              {
                "EffectiveDateTime": "2021-02-13T08:13:15.55Z",
                "TerminationDateTime": "2021-09-10T10:15:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Planning:"
              },
              {
                "EffectiveDateTime": "2021-10-15T08:13:15.55Z",
                "FacilityStateTypeID": "{datapartition}:reference-data--FacilityStateType:Operating:"
              }
            ],
            "SpatialLocation": {
              "AsIngestedCoordinates": {
                "CoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:BoundCRS.SLB.32021.15852:",
                "features": [
                  {
                    "geometry": {
                      "coordinates": [
                        -73.771724,
                        42.516771
                      ],
                      "type": "AnyCrsPoint"
                    },
                    "type": "AnyCrsFeature",
                    "properties": {}
                  }
                ],
                "persistableReferenceCrs": "{\\lateBoundCRS\\\":{\\\"wkt\\\":\\\"PROJCS[\\\\\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],PROJECTION[\\\\\\\"Lambert_Conformal_Conic\\\\\\\"],PARAMETER[\\\\\\\"False_Easting\\\\\\2000000.0],PARAMETER[\\\\\\\"False_Northing\\\\\\0.0],PARAMETER[\\\\\\\"Central_Meridian\\\\\\-100.5],PARAMETER[\\\\\\\"Standard_Parallel_1\\\\\\46.1833333333333],PARAMETER[\\\\\\\"Standard_Parallel_2\\\\\\47.4833333333333],PARAMETER[\\\\\\\"Latitude_Of_Origin\\\\\\45.6666666666667],UNIT[\\\\\\\"Foot_US\\\\\\0.304800609601219],AUTHORITY[\\\\\\\"EPSG\\\\\\32021]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_StatePlane_North_Dakota_South_FIPS_3302\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"32021\\\"},\\\"type\\\":\\\"LBC\\\"},\\\"singleCT\\\":{\\\"wkt\\\":\\\"GEOGTRAN[\\\\\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\\GEOGCS[\\\\\\\"GCS_North_American_1927\\\\\\DATUM[\\\\\\\"D_North_American_1927\\\\\\SPHEROID[\\\\\\\"Clarke_1866\\\\\\6378206.4,294.9786982]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],GEOGCS[\\\\\\\"GCS_WGS_1984\\\\\\DATUM[\\\\\\\"D_WGS_1984\\\\\\SPHEROID[\\\\\\\"WGS_1984\\\\\\6378137.0,298.257223563]],PRIMEM[\\\\\\\"Greenwich\\\\\\0.0],UNIT[\\\\\\\"Degree\\\\\\0.0174532925199433]],METHOD[\\\\\\\"NADCON\\\\\\\"],PARAMETER[\\\\\\\"Dataset_conus\\\\\\0.0],AUTHORITY[\\\\\\\"EPSG\\\\\\15851]]\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD_1927_To_WGS_1984_79_CONUS\\\\\"authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"15851\\\"},\\\"type\\\":\\\"ST\\\"},\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"NAD27 * OGP-Usa Conus / North Dakota South [32021,15851]\\\\\"authCode\\\":{\\\"auth\\\":\\\"SLB\\\\\"code\\\":\\\"32021079\\\"},\\\"type\\\":\\\"EBC\\\"}\"",
                "persistableReferenceUnitZ": "{\\scaleOffset\\\":{\\\"scale\\\":1.0,\\\"offset\\\":0.0},\\\"symbol\\\":\\\"m\\\\\"baseMeasurement\\\":{\\\"ancestry\\\":\\\"Length\\\\\"type\\\":\\\"UM\\\"},\\\"type\\\":\\\"USO\\\"}\"",
                "persistableReferenceVerticalCrs": "{\\authCode\\\":{\\\"auth\\\":\\\"EPSG\\\\\"code\\\":\\\"5773\\\"},\\\"type\\\":\\\"LBC\\\\\"ver\\\":\\\"PE_10_3_1\\\\\"name\\\":\\\"EGM96_Geoid\\\\\"wkt\\\":\\\"VERTCS[\\\\\\\"EGM96_Geoid\\\\\\VDATUM[\\\\\\\"EGM96_Geoid\\\\\\\"],PARAMETER[\\\\\\\"Vertical_Shift\\\\\\0.0],PARAMETER[\\\\\\\"Direction\\\\\\1.0],UNIT[\\\\\\\"Meter\\\\\\1.0],AUTHORITY[\\\\\\\"EPSG\\\\\\5773]]\\\"}\"",
                "type": "AnyCrsFeatureCollection",
                "VerticalCoordinateReferenceSystemID": "namespace:reference-data--CoordinateReferenceSystem:VerticalCRS.EPSG.5773:"
              },
              "CoordinateQualityCheckPerformedBy": "Example CoordinateQualityCheckPerformedBy",
              "CoordinateQualityCheckDateTime": "2020-02-13T09:13:15.55Z",
              "SpatialLocationCoordinatesDate": "2020-02-13T09:13:15.55Z"
            },
            "FacilityName": "SLB-A-101",
            "Source": "Data Mastering Service",
            "FacilityID": "SLB-Trusted-External-Facility-B",
            "VerticalMeasurements": [
              {
                "VerticalMeasurement": 5001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:RB:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 3001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:MD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 4001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:DF:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              },
              {
                "VerticalMeasurement": 6001.54,
                "VerticalMeasurementTypeID": "{datapartition}:reference-data--VerticalMeasurementType:TD:",
                "EffectiveDateTime": "2021-02-13T09:13:15.55Z",
                "TerminationDateTime": "2030-02-13T09:13:15.55Z"
              }
            ],
            "ExtensionProperties": {
              "SLBWellContexts": {
                "AbstractNum": 415.28,
                "ApiStateCode": 75,
                "CoordSystemId": "{datapartition}:slb:system-ea34fed542:12467824126"
              },
              "LocationContexts": {
                "Country": "AUSTRALIA",
                "EwDirection": "East-South"
              },
              "wkeLatestLineageId": "{datapartition}:master-data--Wellbore:cbc198b6-e031-475f-a15d-a6080cc2e7f3",
              "wkeVersion": 2,
              "wkeEntityId": "6f3d82d031fe4d290879e512c47e1e0"
            },
            "KickOffWellbore": "{datapartition}:master-data--Wellbore:6f3d82d031fe4d290879e512c47e1e0.data.master:"
          },
          "meta": [
            {
              "kind": "Unit",
              "name": "m",
              "persistableReference": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"L\",\"type\":\"UM\"},\"type\":\"USO\"}",
              "propertyNames": [
                "VerticalMeasurements[0].VerticalMeasurement",
                "VerticalMeasurements[1].VerticalMeasurement",
                "VerticalMeasurements[2].VerticalMeasurement",
                "VerticalMeasurements[3].VerticalMeasurement"
              ]
            }
          ],
          "id": "{datapartition}:master-data--Wellbore:3d24901874f766ac6cf1181cd287ca8d97f0a625ddf1502e6f070d61be226d4d.data.master",
          "version": 1648626079104980,
          "kind": "osdu:wks:master-data--Wellbore:1.0.0",
          "acl": {
            "viewers": [
              "data.default.viewers@{datapartition}.enterprisedata.slb.com"
            ],
            "owners": [
              "data.default.owners@{datapartition}.enterprisedata.slb.com"
            ]
          },
          "legal": {
            "legaltags": [
              "{datapartition}-default-legal"
            ],
            "otherRelevantDataCountries": [
              "US"
            ],
            "status": "compliant"
          },
          "tags": {
            "DataMastering": "Master"
          },
          "ancestry": {
            "parents": [
              "{datapartition}:master-data--Wellbore:33655890e0054c4991f12fd3c1edd089:1648625779422061",
              "{datapartition}:master-data--Wellbore:fc2d90eeccde4c6a895c1c269b02696a:1648629067707806"
            ]
          }
        }

Things to observe in the merged Master record -

  • The values of the "VerticalMeasurement" attribute are merged and modified by "Source-B".
  • In the "NameAliases" attribute, only those values are updated where the priority of "Source-B" is higher than "Source-A"(i.e "AliasName": "Field-B" where "AliasNameTypeID": "{datapartition}:reference-data--AliasNameType:RegulatoryIdentifier:")).
  • The values of the "FacilityStates" attribute got updated as the source priorities of "Source-B" is higher than "Source-A".
  • The values of the "FacilitySpecifications" attribute did not change because the source priorities of "Source-B" is lower than "Source-A".

So we see: The priority definition at the array level will update the entire array substructure from the higher priority source (like for FacilityStates), while the granular priority definition (such as NameAliases, VerticalMeasurements) applies the merge priority per attribute.

Here, the Data Mastering service adds "wkeLatestLineageId", "wkeVersion" and "wkeEntityId" values inside the "ExtensionProperties" block which helps in internal computation. "wkeVersion" indicates the number of times the Master record was updated.

"wkeLatestLineageId" is the lineage record which contains information about the contributing source for every attribute.

Back to table of contents

Best Practices to follow while using this service

  • As Data Mastering process includes the merging of the attributes from different sources, it is always recommended to start Data Mastering process of WKS records belonging to any one source and then for other source(s). You can do it by ingesting the WKS records of one source first, let the Data Mastering Service completes it's processing and then ingest the WKS record of second/subsequent source(s).

Back to table of contents