Skip to content

Commit 734cd98

Browse files
Merge pull request #990 from mandy-chessell/code2024
Release 5.2 descriptions
2 parents 73d77e9 + d4e101e commit 734cd98

File tree

48 files changed

+854
-276
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

48 files changed

+854
-276
lines changed

Diff for: site/docs/connectors/index.md

+44-38
Original file line numberDiff line numberDiff line change
@@ -7,19 +7,61 @@ Egeria has a growing collection of *connectors* to third party technologies. The
77

88
A connector is a client to a third party technology. It supports a standard API that Egeria calls, and it then translates these calls into requests to the third party technology. Some connectors are also able to listen for notifications from the third party technology. When a notification is received, the connector converts its content into a call to Egeria to distribute the information to the open metadata ecosystem.
99

10-
Connectors enable Egeria to operate in many environments and with many types of third party technologies, just by managing the configuration of the [OMAG servers](/concepts/omag-server). The Connector Catalog list the connector implementations supplied by the Egeria community. There are three broad categories of connectors and the connector catalog is organized accordingly:
10+
Connectors enable Egeria to operate in many environments and with many types of third party technologies, just by managing the configuration of the [OMAG servers](/concepts/omag-server). The Connector Catalog list the connector implementations supplied by the Egeria community. There are four broad categories of connectors and the connector catalog is organized accordingly:
11+
12+
* Connectors that support the [security of the open metadata ecosystem](#open-metadata-security-connectors).
1113

1214
* Connectors that support the [exchange and maintenance of metadata](#metadata-exchange-and-maintenance-connectors) with third party technology. This includes the resource connectors, survey action connectors, integration connectors and adapter repository connectors. These connectors are organized by the type of third part technology type work with.
1315

1416
* Connectors that support the [governance of open metadata](#open-metadata-governance-connectors). This includes the context event services and governance action services. These connectors are organized by function.
1517

1618
* Connectors that support the integration of [Egeria’s runtimes](#runtime-connectors) into the IT infrastructure where it is running. This includes the native repository connectors, event bus connectors, cohort registry stores, configuration stores, audit log destination connectors, open metadata archive stores, REST client connectors and the cohort member remote repository connectors. These connectors are organized by connector type.
1719

20+
## Open Metadata Security Connectors
21+
22+
The connectors that support the security of the open metadata ecosystem are:
23+
24+
* [Secrets Store connectors](#secrets-stores) manage the retrieval of secrets (passwords, certificates, ...) from secured locations at runtime.
25+
* [Metadata Security connectors](#metadata-security-connectors) provides authorization support for the OMAG Server Platform and the OMAG Servers that run on it.
26+
27+
### Secrets Stores
28+
29+
[Secrets stores](/concepts/secrets-store-connector) externalize secrets such as passwords, tokens and certificates so they do not need to be stored in either the [configuration document](/concepts/configuration-document) or [open metadata repositories](/concepts/open-metadata-repository).
30+
31+
* The [YAML File Secret Store connector](/connectors/secrets/yaml-file-secrets-store-connector) retrieves secret values from environment variables.
32+
* The [Environment Variables Secret Store connector](/connectors/secrets/environment-variable-secrets-store-connector) retrieves secret values from environment variables.
33+
34+
### Metadata Security Connectors
35+
36+
The Metadata Security Connectors manage authorization requests for the open metadata and governance servers.
37+
Strictly speaking there are two types of metadata security connectors:
38+
39+
* *Platform Metadata Security Connectors* manage authorization of OMAG Server Platform's services.
40+
* *Server Metadata Security Connectors* manage authorization requests for the OMAG Server's services.
41+
42+
==== Platform Metadata Security Connectors
43+
44+
--8<-- "snippets/connectors/platform-metadata-security-connector-intro.md"
45+
46+
==== Server Metadata Security Connectors
47+
48+
--8<-- "snippets/connectors/server-metadata-security-connector-intro.md"
49+
50+
Egeria has a single metadata security connector that implements both interfaces:
51+
52+
* The [Open Metadata Access Security Connector](/connectors/metadata-security/open-metadata-access-security-connector) uses information from an embedded [secrets store connector](/concepts/secrests-store-connector) so all authorization decisions can be controlled through the contents of the externalized secrets store.
53+
54+
??? education "Further information relating to Metadata Security Connectors"
55+
- [Metadata Security Overview](/features/metadata-security/overview) to understand the metadata security connectors in the context of all of the security features.
56+
- [Configuring a Platform Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
57+
- [Configuring a Server Metadata Security Connector](/guides/admin/servers/by-section/server-security-connection-section) in the [OMAG Server](/concepts/omag-server)
58+
- [Writing a Platform Metadata Security Connector](/guides/developer/runtime-connectors/platform-metadata-security-connector).
59+
- [Writing a Server Metadata Security Connector](/guides/developer/runtime-connectors/server-metadata-security-connector).
60+
1861
## Metadata exchange and maintenance connectors
1962

2063
The connectors that support the exchange and maintenance of metadata help to accelerate the rollout of your open metadata ecosystem, since they can be used to automate the extraction and distribution of metadata to the third party technologies.
2164

22-
* [Secrets Store connectors](#secrets-stores) manage the retrieval of secrets (passwords, certificates, ...) from secured locations at runtime.
2365
* [File connectors](#files) work with different types of files.
2466
* [JDBC Database connectors](#relational-databases) make use of the JDBC standards to work with different types of relational databases.
2567
* [Apache Kafka connectors](#apache-kafka) work with the topics and/or events passing through the Apache Kafka event broker.
@@ -28,12 +70,6 @@ The connectors that support the exchange and maintenance of metadata help to acc
2870
* [Open API Specification connectors](#open-api-specification) extract metadata about APIs through the Open API interfaces provided through the Swagger API.
2971
* [Open Lineage Event connectors](#open-lineage-events) works with the open lineage event standard.
3072

31-
### Secrets Stores
32-
33-
[Secrets stores](/concepts/secrets-store-connector) externalize secrets such as passwords, tokens and certificates so they do not need to be stored in either the [configuration document](/concepts/configuration-document) or [open metadata repositories](/concepts/open-metadata-repository).
34-
35-
* The [Environment Variables Secret Store connector](/connectors/secrets/environment-variable-secrets-store-connector) retrieves secret values from environment variables.
36-
* The [YAML File Secret Store connector](/connectors/secrets/yaml-secrets-store-connector) retrieves secret values from environment variables.
3773

3874
### Files
3975

@@ -130,8 +166,6 @@ The open lineage connectors work with the [Open Lineage standard](/features/line
130166
| Type | Description |
131167
|-------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
132168
| [Repository and Event Mapper connectors](#repository-and-event-mapper-connectors) | Integrate metadata repositories into the open metadata ecosystem so that they can interact with one or more [open metadata repository cohorts](/services/omrs/cohort). |
133-
| [Platform Metadata Security Connectors](#platform-metadata-security-connectors) | manage authorization requests for the OMAG Server Platform's services. |
134-
| [Server Metadata Security Connectors](#server-metadata-security-connectors) | manage authorization requests for the OMAG Server's services. |
135169
| [Configuration Document Store Connectors](#configuration-document-store-connectors) | manage the persistence and retrieval of [configuration documents](/concepts/configuration-document). |
136170
| [Cohort Registry Store Connectors](#cohort-registry-store-connectors) | store the [open metadata repository cohort](/concepts/cohort-member) membership details in the [cohort registry store](/concepts/cohort-registry-store). |
137171
| [Open Metadata Archive Store Connectors](#open-metadata-archive-store-connectors) | read and write [open metadata archives](/concepts/open-metadata-archive). |
@@ -171,34 +205,6 @@ The table below lists the repository connectors that act as an adapter for third
171205
- [Writing repository and event mapper connectors](/guides/developer/repository-connectors/overview) for more information on writing new repository and event mapper connectors.
172206

173207

174-
### Platform Metadata Security Connectors
175-
176-
---8<-- "snippets/connectors/platform-metadata-security-connector-intro.md"
177-
178-
There is one implementation of the platform metadata security connector provided by Egeria. It is a sample that encodes information from the Coco Pharmaceutical scenarios.
179-
180-
* **[Coco Pharmaceuticals Platform Metadata Security Connector :material-github:](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-samples/open-metadata-security-samples){ target=gh }**
181-
182-
??? education "Further information relating to Platform Metadata Security Connectors"
183-
184-
- [Configuring a Platform Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
185-
- [Metadata Security](/features/metadata-security/overview) to understand the platform metadata security connector in the context of all of the security features.
186-
- [Writing a Platform Metadata Security Connector](/guides/developer/runtime-connectors/platform-metadata-security-connector).
187-
188-
### Server Metadata Security Connectors
189-
190-
---8<-- "snippets/connectors/server-metadata-security-connector-intro.md"
191-
192-
There is one implementation of the server metadata security connector provided by Egeria. It is a sample that encodes information from the Coco Pharmaceuticals scenarios.
193-
194-
* **[Coco Pharmaceuticals Server Metadata Security Connector :material-github:](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-samples/open-metadata-security-samples){ target=gh }**
195-
196-
??? education "Further information relating to Server Metadata Security Connectors"
197-
198-
- [Configuring a Server Metadata Security Connector](/guides/admin/configuring-the-omag-server-platform/#platform-security) in the [OMAG Server Platform](/concepts/omag-server-platform)
199-
- [Metadata Security](/features/metadata-security/overview) to understand the server metadata security connector in the context of all of the security features.
200-
- [Writing a Server Metadata Security Connector](/guides/developer/runtime-connectors/server-metadata-security-connector).
201-
202208
### Configuration Document Store Connectors
203209

204210
---8<-- "snippets/connectors/configuration-document-store-connector-intro.md"
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
<!-- SPDX-License-Identifier: CC-BY-4.0 -->
2+
<!-- Copyright Contributors to the ODPi Egeria project. -->
3+
4+
--8<-- "snippets/content-status/stable.md"
5+
6+
# Open Metadata Access Security Connector
7+
8+
!!! info "Connector details"
9+
- Connector Category: [Metadata Security Connector](/features/metadata-security/overview)
10+
- Source Module: [metadata-access-secrets-store-connector :material-github:](https://github.com/odpi/egeria/tree/main/open-metadata-implementation/adapters/open-connectors/metadata-security-connectors/open-metadata-access-security-connector){ target=gh }
11+
- Jar File Name: `yaml-secrets-store-connector.jar`
12+
13+
## Overview
14+
15+
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secrets-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
16+
17+
![Figure 1](yaml-file-secrets-store-connector.svg)
18+
> **Figure 1:** Operation of the YAML File Secrets Store Connector
19+
20+
Secrets within the YAML file are organized into collections. Each collection represents a set of secrets needed by a particular type of caller. When the YAML File Secrets Store Connector starts up, it opens the YAML file using the address passed in the endpoint of its connection. It located the appropriate collection using the name specified in the `secretsCollectionName` property found in the connection's `configurationProperties`. The connector will fail if either of these two values are missing.
21+
22+
23+
24+
Inside a collection are:
25+
26+
* A refresh time interval (`refreshTimeInterval`) that defines how long the secrets can be cached. When the time expires, the connector retrieves the secrets from the cache.
27+
* A map of named secrets (`secrets`) - such as details of certificates or userId and passwords. These secrets are used by other connectors, and automated services to log on to remote services.
28+
* The details of an API to call to retrieve a token (`tokenAPI`). This includes the HTTP request type, URL and details fo the request and response body. This supplements the secrets map allowing certain secrets to be retrieved dynamically.
29+
* A map of userIds to user account details (`users`). This is needed by a connector that is supporting a user authentication service.
30+
* A map of named lists (`namedLists`) that is used to represent organizational units, security roles and groups needed by an authorization service.
31+
32+
Complete details of this structure can be found in [Egeria's Javadoc](https://odpi.github.io/egeria/org/odpi/openmetadata/adapters/connectors/secretsstore/yaml/secretsstore/package-summary.html) and an example can be found in [GitHub](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-deployment/secrets).
33+
34+
## Configuration
35+
36+
This is its connection definition to embed into a calling connector's connection object.
37+
38+
!!! example "Connection configuration for the environment variable secrets store connector"
39+
```json linenums="1" hl_lines="14"
40+
{
41+
"connection" :
42+
{
43+
"class" : "Connection",
44+
"qualifiedName" : "Egeria:SecretsStoreConnector:YAML File Connection",
45+
"connectorType" :
46+
{
47+
"class" : "ConnectorType",
48+
"connectorProviderClassName" : "org.odpi.openmetadata.adapters.connectors.secretsstore.yaml.YAMLSecretsStoreProvider"
49+
},
50+
"endpoint" :
51+
{
52+
"class" : "Endpoint",
53+
"address" : {{secretsStoreFileLocation}}
54+
},
55+
"configurationProperties" :
56+
{
57+
"secretsCollectionName" : {{secretsCollectionName}}
58+
}
59+
}
60+
}
61+
```
62+
63+
---8<-- "snippets/abbr.md"

Diff for: site/docs/connectors/secrets/yaml-file-secrets-store-connector.md

+2-4
Original file line numberDiff line numberDiff line change
@@ -6,21 +6,19 @@
66
# YAML File Secrets Store Connector
77

88
!!! info "Connector details"
9-
- Connector Category: [Secret Store Connector](/concepts/secrets-store-connector)
9+
- Connector Category: [Secrets Store Connector](/concepts/secrets-store-connector)
1010
- Source Module: [yaml-secrets-store-connector :material-github:](https://github.com/odpi/egeria/tree/main/open-metadata-implementation/adapters/open-connectors/secrets-store-connectors/yaml-secrets-store-connector){ target=gh }
1111
- Jar File Name: `yaml-secrets-store-connector.jar`
1212

1313
## Overview
1414

15-
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secret-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
15+
The *YAML File Secrets Store Connector* is a [Secrets Store Connector](/concepts/secrets-store-connector) that retrieves secrets from a named YAML file. By convention, these YAML files have a file extension of `omsecrets`.
1616

1717
![Figure 1](yaml-file-secrets-store-connector.svg)
1818
> **Figure 1:** Operation of the YAML File Secrets Store Connector
1919
2020
Secrets within the YAML file are organized into collections. Each collection represents a set of secrets needed by a particular type of caller. When the YAML File Secrets Store Connector starts up, it opens the YAML file using the address passed in the endpoint of its connection. It located the appropriate collection using the name specified in the `secretsCollectionName` property found in the connection's `configurationProperties`. The connector will fail if either of these two values are missing.
2121

22-
23-
2422
Inside a collection are:
2523

2624
* A refresh time interval (`refreshTimeInterval`) that defines how long the secrets can be cached. When the time expires, the connector retrieves the secrets from the cache.

Diff for: site/docs/content-packs/apache-atlas-content-pack/overview.md

+1
Original file line numberDiff line numberDiff line change
@@ -5,5 +5,6 @@
55

66
The *ApacheAtlasContentPack* contains the connector definitions for the Apache Atlas connectors and governance services supplied in the *omag-server-platform* distribution along with the valid metadata values for the technologies they support. This content pack is designed to provide a good starting point for connecting Egeria to Apache Atlas.
77

8+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
89

910
--8<-- "snippets/abbr.md"

Diff for: site/docs/content-packs/apache-kafka-content-pack/overview.md

+2
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,6 @@
66
The *ApacheKafkaContentPack* contains the connector definitions for the Apache Kafka connectors and governance services supplied in the *omag-server-platform* distribution along with the valid metadata values for the technologies they support. This content pack is designed to provide a good starting point for connecting Egeria to Apache Kafka in order ti access its metadata.
77

88

9+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
10+
911
--8<-- "snippets/abbr.md"

Diff for: site/docs/content-packs/apis-content-pack/overview.md

+1
Original file line numberDiff line numberDiff line change
@@ -5,5 +5,6 @@
55

66
The *APIsContentPack* contains the connector definitions for the connector the catalogs an open API through its swagger REST API. This connector is supplied in the *omag-server-platform* distribution. This content pack is designed to provide a good starting point for connecting Egeria to applications supporting the open API specification in order to build an API catalog.
77

8+
This content pack is built by the [core-content-pack](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-archives/) module.
89

910
--8<-- "snippets/abbr.md"

Diff for: site/docs/content-packs/cim-content-pack/overview.md

+2
Original file line numberDiff line numberDiff line change
@@ -12,4 +12,6 @@ The *CloudInformationModel* content pack is an extraction for a glossary for the
1212

1313
This archive is available on GitHub as `CloudInformationModel.omarchive` at [https://github.com/odpi/egeria/blob/main/content-packs/CloudInformationModel.json](https://github.com/odpi/egeria/blob/main/content-packs/CloudInformationModel.json). It is also included in Egeria's standard `omag-server-platform` distribution built from the `egeria.git` repository.
1414

15+
This content pack is built by the [cloud-information-model](https://github.com/odpi/egeria/tree/main/open-metadata-resources/open-metadata-samples/cloud-information-model) module.
16+
1517
--8<-- "snippets/abbr.md"

0 commit comments

Comments
 (0)